Senior Data Engineering Lead

Overview

On Site
$140,000 - $180,000
Full Time

Skills

Python
PySpark
and SQL.
Azure Expertise
Data Warehousing
Data Modeling
Databricks
Synapse
Fabric
Snowflake
etc
Azure DevOps

Job Details

Senior Data Engineering Lead

We are seeking a highly experienced Senior Data Engineering Lead with minimum 5+ years experience in modern data engineering, data warehousing and data lake technologies on Azure cloud platform. The successful candidate will possess a strong technical background and proven leadership skills to manage stakeholders, design, and lead development efforts.

Key Qualifications:

The candidate must have experience and expert skills in the following areas:

  • Programming Skills: Stellar hands-on expertise in Python, PySpark, and SQL.
  • Azure Expertise: Proficient in Microsoft Azure Cloud Services.
  • Data Warehousing: Expertise in data warehouse best practices, development standards and methodologies. Minimum of 5 years of experience in modern data engineering, data warehousing (Azure Synapse, Azure SQL, Amazon Redshift, Snowflake or Google Big Query), and data lake technologies on the Azure cloud.
  • Data Modeling Expertise: Minimum of 12 years of proven experience with SQL, schema design, and dimensional data modeling.
  • Big Data Tools: any Spark platform such as (but not limited to) Databricks, Synapse, Fabric, Snowflake, etc.
  • Cloud Data Engineering concepts: Experience with common ETL/ELT tools (ADF, Informatica, Talend) and implementing Medallion Architecture for data management.
  • Data Management and Storage: Proficiency with Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Blob Storage, etc.
  • Analytical Skills: Strong analytical and problem-solving skills.
  • Leadership: Lead development teams, drive project timelines, and ensure high-quality deliverables.

Additional Preferred Qualifications:

  • Azure DevOps and CI/CD deployments
  • Cloud migration methodologies and processes
  • 2+ yrs of experience with Power BI or

5+ yrs of experience with any reporting/visualization tool like Tableau/OBIEE etc

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Purple Drive Technologies LLC