Data Engineering Lead - ETL

ETL, Hadoop, Hive, Python, SQL
Contract W2, Contract Independent, Contract Corp-To-Corp, 24 Months
$80 - $120
Work from home not available Travel not required

Job Description

Job Description:

  • Data modeling, coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers, architects & other engineering teams.
  • Adopting and enforcing best practices related to data ingestion and extraction of data from the big data platform.
  • Extract business data from multiple data sources and store in MapR DB HDFS location.
  • Work with Data Scientists and build scripts to meet their data needs
  • Work with Enterprise Data Lake team to maintain data and information security for all use cases
  • Design and develop scripts and configurations to successfully load data using Data Ingestion Frameworks
  • Supporting end-to-end Platform application delivery, including Infrastructure provisioning & automation and integration with Continuous Integration/Continuous Development (CI/CD) platforms, using existing and emerging technologies

Required Qualifications

  • 1+ year experience with ETL suite of tools 
  • 3+ years' experience with Big Data platforms Hadoop, MapR, Hive, Parquet
  • 5+ years of ETL (Extract, Transform, Load) Programming with tools including Informatica
  • 2+ years of Unix or Linux systems with scripting experience in Shell, Perl or Python
  • Experience with Advanced SQL preferably Teradata
  • Strong Hadoop scripting skills to process petabytes of data
  • Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, HBase, Pig, Apache Spark, etc.).
  • Demonstrated ability to transform business requirements to code, metadata specifications, specific analytical reports and tools

Posted By

Deepak Bhanu

238 Udyog Vihar Phase-IV Gurgaon HARYANA, 122016

Dice Id : 10494547
Position Id : 5954545
Have a Job? Post it

Similar Positions

Big Data Architect/Engg
  • 8K Miles Software Services, Inc.
  • Pleasanton, CA
Google Cloud Data Engineer
  • Virtusa
  • Santa Clara, CA
Big Data Developer
  • LaresIT Solutions Inc.
  • Pleasanton, CA
Data Engineer
  • Xoriant Corporation
  • Sunnyvale, CA
Big Data Engineer
  • 8K Miles Software Services, Inc.
  • Pleasanton, CA
Sr GCP Data Engineer
  • Standav Corp
  • Santa Clara, CA
Big Data Engineer
  • The Jobrocket
  • Sunnyvale, California
Data Engineer
  • Mainz Brady Group
  • Sunnyvale, CA
Big Data Engineer
  • HCL America Inc.
  • Sunnyvale, CA
Data Engineer
  • Openmind Technologies
  • San Jose, CA
Big Data/HadoopDeveloper
  • Innova Consulting Services, LLC DBA Celerus Consulting
  • San Jose, California
Big Data Engineer Hadoop
  • Prontoux INC
  • Sunnyvale, CA
Data Engineer
  • Vimerse Infotech Inc
  • Sunnyvale, CA