Hadoop Resource - Research

Location: ., ., United States
Date Posted: 12-10-2016
Job Title : Hadoop Resource - Research

Job Description:
  • Define the integration points and technologies as per customer agreement
  • Ingestion of data from multiple sources internal and external to the system
  • Use Pivotal tool stack to provide real-time and batch ingestion into the lake using Hadoop/Spring XD / Spark / Pig /Greenplum/GemFire.
  • Provide implementation points for data quality and profiling as per the business requirements and design
  • Implement data lineage and metadata integrations by using the tools agreed upon by customer such as Falcon / Atlas
  • Implement database structure in Hawq as per the design finalized by customer and facilitate data movement across the lake
  • Implement Rabbit MQ as the enterprise Bus and implement a publish, subscribe architecture
  • Provide build services for micro-service implementations
  • Leverage the existing APIs provided by Gemfire / Spring XD for integrations to applications
  • Provide continuous Integration and Continuous Deployment methodologies for the microservices, ETL scripts, unix scripts and other code development for the project.
  • Team will actively participate in the enhancement, estimation, and delivery of business defined User Stories
  • Contractor Team will also work with the Data Quality Office to document Data Quality Rules in the Customer Toolset (Collibra and Ab Initio > Express IT).
  • Implementation to be carried out in Agile methodology
  • Operate as a member of the core EDL Agile Scrum Team
  • Define specific technical tasks on user stories
  • Update tasks progress during Sprints
  • Participate in Sprint Planning, Sprint Retrospectives
  • Recommend Big Data technology to support the Epics and User stories defined by the Product Owner
  • Lead Design, Build, Test for tasks / user stories assigned during the Sprint time boxes
  • Provide analytical insights for the data by creating models using statistical and machine language libraries
  • Use of R and SAS for advanced analytics
  • Status reporting for the tasks and deliveries
  • Release management team will provide Production support for the applications in EDL  

Central Business Solutions, Inc,
37600 Central Ct.
Suite #214
Newark, CA 94560.
Central Business Solutions, Inc(A Certified Minority Owned Organization)
Checkout our excellent assessment tool: http://www.skillexam.com/
Checkout our job board : http://www.job-360.net/
Central Business Solutions, Inc
37600 Central Court Suite 214 Newark CA, 94560
Phone: (510)-713-9900, 510-573-5500 Fax: (510)-740-3677
Web: http://www.cbsinfosys.com
this job portal is powered by CATS