Data Engineer Lead

Remote • Posted 4 hours ago • Updated 4 hours ago
Full Time
No Travel Required
Able to Sponsor
Remote
$80 - $90/hr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • GCP
  • SQL
  • Kafka

Summary

Job Title: Data Engineer Lead

Location: 
Remote

Duration: 6 Months + Extension

Bill Rate: $83/hour

Job Type: W-2 Contract

Client: To Be Discussed Later

Work Authorization:s

  • USC
  • GC
  • H-1B
  • OPT-EAD
  • GC-EAD

Job Description:

  • Data Engineering Lead excels in data modeling, Lakehouse and Medallion Architecture concepts, and data/ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including Spark, Kafka, Kubernetes, SageMaker, DBT, Juniper Notebooks, Docker, SQL, and visualization tools such as Power BI/Tableau with the following track record:

Required Skills:

  • Hand-on experience is required in hydrating the enterprise Data Lake on a Cloud Service Provider (AWS, Azure, or Google) from relational, semi-structured and unstructured data sources by building Extract and Load Data Pipelines.
  • Hands-on experience is required in Transforming the datasets in a Data Lake on a Cloud Service Provider to deliver Data Products with traceability of their attributes / features to the Critical Data Elements in the systems of record.
  • Experience is required in enforcing Data Sharing Policies to Data Products to ensure that User get to see only the version of the Data Product the User is entitled to get access to at the time of subscription.

Preferred Skills:

  • Proficiency desirable in DevOps tools including Github/Jenkins/Terraform/YAML/DAGs/Docker/Databricks/SageMaker etc. for building Data/ML pipelines to extract/store data from multiple sources to parquet destinations.
  • Experience desirable in promoting Data Engineering Standards and Best Practices among the community of developers to influence the enterprise towards building scalable and supportable Data/ML Products delivery and their usage by the community of data, analytics, and ML product users.
  • Experience desirable in implementing Data Governance and Data Security tools available on a CSP to automate the enforcement of Data Sharing Policies at the point of subscription of a Data Product by a subscriber.

Roles and Responsibilities:

  • Data Engineering Lead excels in data modeling, Lakehouse, and ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including DataBricks, Sagemaker, Spark, Kafka, Kubernetes, SQL, NoSQL DBs, Graph DBs, and visualization tools such as Power BI/Tableau.
  • The Data Engineer Lead serves as the primary State of Michigan technology lead engaging with the UoM proof of concept team to support best practice adoption within the state hosting environment and provides training to DAV data engineers. This role’s responsibilities include:
  • Oversee the design, development, and maintenance of data pipelines that move, transform, and prepare data for analytics and operational systems.
  • Architect and optimize data infrastructure, including storage solutions, orchestration frameworks, and ETL/ELT processes.
  • Ensure data quality, reliability, and security by establishing standards, monitoring systems, and implementing validation and governance practices.
  • Lead and mentor data engineering staff, providing technical guidance, reviewing designs/code, and supporting professional growth.
  • Collaborate with cross functional partners, such as data scientists, analysts, product teams, and business stakeholders, to ensure data solutions meet organizational needs and strategic goals.


Equal Opportunity Employer: 
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91099737
  • Position Id: 9143758
  • Posted 4 hours ago
Contact the job poster
NI

Nandini Iyer

Recruiter @ QUANTUM TECHNOLOGIES LLC

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.