Senior Data Engineer - Azure Data Bricks

Dallas, TX, US • Posted 2 hours ago • Updated 2 hours ago
Contract Independent
Contract W2
24 Months
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • ELT
  • Microsoft Azure
  • Data Quality
  • Google Cloud Platform
  • DevOps
  • Snow Flake Schema
  • Databricks
  • Python
  • Performance Tuning
  • Apache Spark

Summary

Senior Data Engineer – Azure / Databricks

Job Title

Senior Data Engineer – Azure / Databricks

Location: Dallas, TX / Remote
Duration: 12+ Months Contract
Experience: 6+ Years

Job Description:

We are seeking a Senior Data Engineer with strong experience in designing, developing, and optimizing scalable cloud-based data platforms and ETL/ELT pipelines.

Responsibilities:

  • Design and develop scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, PySpark and SQL.
  • Develop data ingestion and transformation workflows for structured and semi-structured data.
  • Build and optimize PySpark and Spark SQL jobs for large-scale distributed data processing.
  • Develop data models, data marts, and analytical datasets for enterprise reporting and analytics.
  • Work with Azure Data Lake Storage, Azure Synapse, Databricks and Snowflake.
  • Implement batch and real-time data processing using Kafka or similar streaming technologies.
  • Optimize SQL queries, Spark jobs, partitions, joins and transformations for performance.
  • Implement data quality, validation, reconciliation and monitoring processes.
  • Collaborate with data scientists, analysts, application developers and business stakeholders.
  • Deploy data pipelines through CI/CD using Azure DevOps, Git and Terraform.
  • Troubleshoot production pipeline failures and improve reliability and performance.

Required Skills:

  • 6+ years of Data Engineering experience
  • Strong SQL and Python/PySpark
  • Azure Data Factory
  • Azure Databricks
  • Azure Data Lake / ADLS
  • Apache Spark
  • Data Warehousing
  • ETL/ELT
  • Azure Synapse or Snowflake
  • Git / CI/CD
  • Strong data modeling and performance tuning experience

Preferred:

  • Kafka
  • Terraform
  • Kubernetes
  • Airflow
  • Power BI
  • AWS/Google Cloud Platform exposure
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: PTP5OVXrq43zb24
  • Position Id: 9085273
  • Posted 2 hours ago
Contact the job poster
MG

Manoj G

Recruiter @ PHX Agile LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Plano, Texas

Today

Easy Apply

Contract

Depends on Experience

Dallas, Texas

Today

Easy Apply

Full-time

$DOE

Plano, Texas

Today

Easy Apply

Full-time

USD150000 per annum

Dallas, Texas

Today

Full-time

Search all similar jobs