Lead Data Engineer

Hybrid in Atlanta, GA, US • Posted 9 hours ago • Updated 9 hours ago
Contract Independent
Contract W2
12 Months
No Travel Required
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • SQL
  • Python
  • Pyspark
  • Azure
  • GCP

Summary

Job Title: Lead Data Engineer

Location: Atlanta, GA(Onsite)

Contract Duration: Long term Contract

 

Job Description:

Senior hands-on Data Engineer responsible for designing, building and operating scalable batch/streaming data pipelines and data products across Azure and Google Cloud Platform.

Own end-to-end engineering covering ingestion, transformation, data modeling, orchestration, testing, deployment and production support.

Build reusable engineering frameworks and support analytics/ML workloads while providing technical leadership and mentoring.

 

Relevant Experience: 10+ years

 

Mandatory skills:

  • SQL, Python, PySpark;
  • strong ETL/ELT, data modeling and distributed processing;
  • hands-on Azure + Google Cloud Platform experience;
  • Azure Data Factory/Fabric/Databricks/Data Lake and Google Cloud Platform BigQuery/Dataflow/Dataproc/Cloud Storage/Pub/Sub;
  • GitHub, CI/CD, automated testing, IaC;
  • DevOps/MLOps;
  • production support and performance tuning.

 

Desired skills:

  • Applied data science/ML understanding including feature engineering, statistics and model lifecycle;
  • streaming pipelines;
  • observability and cloud-cost optimization;
  • experience with consumer, media, customer, commerce or marketing data;
  • data governance, lineage, privacy and access controls;
  • mentoring/code reviews.

 

Domain (Industry):

Consumer Packaged Goods (CPG) / Beverage Alcohol/ Retail / Consumer Goods

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: mategr
  • Position Id: Nilesh_Payal 216
  • Posted 9 hours ago
Contact the job poster
Murtuza Tajir

Murtuza Tajir

Recruiter @ ClifyX

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.