Data Engineer

AWS, Spark, SQL, Python, HDFS
Contract Corp-To-Corp, Contract Independent, Contract W2, 12 Months
Work from home not available Travel not required

Job Description

Job Description: 

Primary Responsibilities:

  • Develop and maintain existing ingestion & processing pipelines that processes raw data into shareable data layers for wider analyst consumption
  • Work with analysts and our larger data engineering group to ensure smooth migration of data, analytics tools and our jobs and scripts to AWS
  • Design and build automated code development & deployment systems that simplify analyst work and make our work more consistent and predictable. Eg: Maintaining GitHub and using Jenkins for automate code deployment in AWS
  • Analyze data-related systems integration opportunities and challenges, validating data models from a data integration perspective for current projects as well as other impacted projects and drive quality improvements
  • Help Proof-of-Concept tools & technologies that can ease analyst work


  • Experience working with AWS platform and tools like EMR, S3, Data Pipelines etc.
  • Advanced knowledge of SQL, Python or other scripting languages, Shell scripting
  • Knowledge of Big Data and related technologies: HDFS, Hive etc. (Spark, Presto etc. would be awesome!)
  • Understanding of Big Data tech stack and architecture
  • Great product/project management skills

Posted By

Rachit Sarda

1551 McCarthy Blvd Milpitas, CA, 95035

Dice Id : 90989446
Position Id : 567234
Have a Job? Post it