Lead Data Engineer Data Platforms (Azure)

Overview

On Site
$55 - $60
Contract - W2
Contract - 12 Month(s)
Able to Provide Sponsorship

Skills

Conflict Resolution
Analytical Skill
Data Processing
Databricks
Debugging
ELT
Extract
Transform
Load
Apache HTTP Server
Apache Spark
Cloud Computing
Communication
Data Governance
FOCUS
GC
Microsoft Azure
Problem Solving
Regulatory Compliance
Storage
Workflow

Job Details

Job Title: Lead Data Engineer Data Platforms (Azure)
Location: Onsite Cincinnati or charlotte
Employment Type: 6-8 months, might hire the resources on their full time role

< data-start="289" data-end="315">Job Description:</>

We are looking for a Lead Data Engineer with strong expertise in Azure Data Platforms to design and build scalable, high-performance data solutions. The ideal candidate should have hands-on experience with Azure Databricks, Apache Spark, and Delta Lake, with a focus on optimizing data pipelines and ensuring data governance and compliance.

< data-start="683" data-end="714">Key Responsibilities:</>

  • Design and implement scalable data pipelines and data architectures on Azure Databricks

  • Develop and optimize ETL/ELT workflows for efficient data processing, storage, and retrieval

  • Utilize Apache Spark, Delta Lake, and Azure-native services to build robust data solutions

  • Ensure adherence to best practices in data governance, security, and compliance within Azure environments

  • Troubleshoot and fine-tune Spark jobs to maximize performance and minimize costs

  • Collaborate with data analysts, scientists, and business stakeholders to deliver actionable insights

< data-start="1349" data-end="1375">Required Skills:</>

  • Strong hands-on experience with Azure Databricks and Apache Spark

  • In-depth knowledge of Delta Lake and other Azure-native services (Data Factory, Synapse, etc.)

  • Expertise in ETL/ELT design and optimization

  • Solid understanding of data governance, security, and compliance best practices on cloud platforms

  • Proven ability to debug, optimize, and tune Spark jobs for enterprise-scale workloads

  • Strong analytical, problem-solving, and communication skills

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Sierra Software Solutions