Jobs at Central Business Solutions, Inc

View all jobs

Software Engineer (Big Data - Spark)

San Francisco, CA
Position Role/Tile: Software Engineer (Big Data - Spark)
Location: San Francisco, CA.

 Required Skills Summary: Apache Spark, Apache Kafka, Scala/Java, NoSQL Databases, Elasticsearch & Kibana, Kubernetes, Docker Containers
Preferred Skills/Experience
•        10+ years of overall experience in software development with 5-6 years of relevant experience in designing, developing, deploying and operating data streaming pipelines at scale.
•        3-4 years' experience with Apache Kafka and Apache Spark Streaming
•        Hands on experience with Spark Structured Streaming
•        Experience in tuning Spark Data pipeline to achieve high throughput.
•        Drive efforts to improve the data quality across data pipelines and implement system controls for managing data quality
•        Programming proficiency in Scala or Java.
•        Open Source Committer (Apache Spark or related Big Data open source technologies)
•        Experience with Containers, Kubernetes and scaling elastically
•        Strong background in algorithms and data structures and continuously develop and acquire new technical skills
•        Lead and mentor junior engineers to ensure systems are built with highest quality and leveraging best practices.
•        Experience in automating Spark pipeline deployment/testing (DevOps, CI/CD)
•        Passion for data engineering and for enabling others by making the product easier to use.

Central Business Solutions, Inc,
37600 Central Ct.
Suite #214
Newark, CA 94560.
Central Business Solutions, Inc(A Certified Minority Owned Organization)
Checkout our excellent assessment tool:
Checkout our job board :
Central Business Solutions, Inc
37600 Central Court Suite 214 Newark CA, 94560
Phone: (833)247-8800 Fax: (510)-740-3677

Share This Job

Powered by