Senior Python Data Engineer (Azure ML & DAG Pipelines)

Overview

On Site

Contract - W2

Contract - 2+ month(s)

Skills

python

Azure

DAG

Job Details

BuzzClan is an elite business consulting firm collaborating to provide software, advisory & implementation services. BuzzClan is a certified partner for most of the tier 1 cloud, hardware & software providers. Being a vertically integrated solutions company, BuzzClan is known for their capability in the IT Services space.

Job Title: Senior Python Data Engineer (Azure ML & DAG Pipelines)
Job Location : DFW Area - Hybrid

We're seeking a Senior Python Data Engineer with deep expertise in Azure Machine Learning and DAG-based workflow orchestration to design and optimize our data pipelines. You'll architect scalable solutions that power our analytics and ML systems.

Core Responsibilities:

Design and implement DAG-based data pipelines using Airflow/Luigi/Prefect
Develop Azure ML pipelines for model training and deployment
Optimize ETL/ELT processes for performance and reliability
Implement IaC (Terraform/Bicep) for cloud resource provisioning
Build monitoring and alerting systems for data workflows
Collaborate with data scientists to productionize ML models

Must-Have Skills:

Expert-level Python (decorators, generators, async/await)
10+ years with Azure ML and DAG orchestration tools
Strong experience with Airflow, Luigi, or Prefect
Proficiency in PySpark/Databricks for big data processing
Deep understanding of data modeling and warehousing concepts
Experience with CI/CD pipelines for data systems

Nice-to-Have:

Knowledge of Kubernetes for workflow scaling
Experience with real-time streaming (Kafka, Event Hubs)
Familiarity with MLOps practices

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Job Details

Share