Senior Big Data Engineer

Location: Durham, NC, United States
Date Posted: 10-30-2018
Position Role/Tile: Senior Big Data Engineer
Location: Durham , NC.


The Senior Data Engineer will be responsible for finding trends in datasets and developing workflows and algorithms to help make raw data more useful to the enterprise. He or she will also be responsible for creating data acquisition strategy and develops data set processes. 
You should be enthusiastic about learning new technologies and be able to implement solutions using them to provide new functionality to the users or to scale the existing platform. 
Excellent written and verbal communication skills are required as the person will work very closely with diverse teams. Having strong analytical skills is a plus. 
Primary Responsibility 
- As a Senior Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies. 
- You will architect and drive the build out of next generation data platform. 
- You will build reusable code, with the ability to scale with very large data volumes. 
- Everything you build will need to scale and perform. 
- Define and lead the frameworks for compliance with data management standards for emerging technologies (streaming platforms, cloud integration, etc.) 
- You will drive the build out of next generation data platform. 
General Responsibilities 
- Be part of a core team leading migration to new data technologies for unstructured, streaming and high volume data. 
- Overall accountability of your work and adopt established data management frameworks to prevent data lakes from becoming data swamps. 
- Provide senior level technical consulting to application development teams during application design and development for highly complex or critical projects 
- As a hands-on engineer, you will influence all architecture decisions. 
Job Functions: 
- Provide technical leadership to build and implement data and big data solutions 
- Articulate pros and cons of various technologies, platforms and tools. 
- Demonstrated work experience with distributed, scalable Big Data programming model and technologies such as Hadoop, Hive, Pig, etc. 
- Demonstrated hands-on experience with at-least one of the major Hadoop distributions (Preferrably Cloudera). 
- Deep technical Expertise in Hadoop eco system components. 
- Experience designing, developing and implementing online-machine learning libraries. 
Minimum Experience:  
8+ years’ experience in dimensional data modeling, ETL development, and Data Warehousing. 
Business Consulting-ETL Processes: 5+ years 
BIG Data ( Client)-Apache Hadoop (HDFS)-Base/Hive/Pig/Mahout/Flume/Scoop/MapReduce/Yarn: 3-5 years 
Cloud Dev and Migration-AWS-Analytics/DW/Redshift : 1+ year 
Travel:  Need locals 
Degree: Bachelors in Computer Science or equivalent work experience 
Desirable Skills: 
- Master’s degree in Information Systems or a related field. 
- Hadoop/Cloud Developer Certification 
- Experience deploying applications in a cloud environment; ability to architect, design, deploy and manage cloud based Hadoop clusters 
- Exposure to cloud infrastructure 
- Experience with Redshift and other AWS services. "

Central Business Solutions, Inc,
37600 Central Ct.
Suite #214
Newark, CA 94560.
Central Business Solutions, Inc(A Certified Minority Owned Organization)
Checkout our excellent assessment tool:
Checkout our job board :
Central Business Solutions, Inc
37600 Central Court Suite 214 Newark CA, 94560
Phone: (510)-713-9900, 510-573-5500 Fax: (510)-740-3677
this job portal is powered by CATS