Azure Databricks Engineer 9+

Dallas, TX, US • Posted 5 days ago • Updated 5 days ago

Contract W2

On-site

$45 - $47/hr

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

Azure Databricks
Apache
PySpark

Summary

Job Description: Senior Azure Databricks Engineer

Location Options (Onsite Required): Dallas, TX, San Jose, CA, Pleasanton, CA

About the Role

We are seeking a highly experienced Senior Azure Databricks Engineer to support digital transformation initiatives for our client. The ideal candidate has strong expertise in Azure cloud services, Databricks, Spark, large-scale data engineering, and end-to-end pipeline development. This is an onsite role requiring candidates to work from any of the client locations listed above.

Responsibilities

Design, build, and optimize end-to-end data pipelines using Azure Databricks and Apache Spark.
Develop scalable ETL/ELT processes for structured and unstructured data.
Integrate Databricks with various Azure services (ADLS, ADF, Azure SQL, Synapse, Key Vault, etc.).
Implement Delta Lake features time travel, ACID transactions, schema evolution, and optimization.
Perform advanced data transformation, cleansing, aggregation, and feature engineering.
Optimize Spark jobs for performance, reliability, and cost efficiency.
Analyze and troubleshoot complex data issues in production environments.
Collaborate with data architects, analysts, and business teams to define requirements & deliver solutions.
Follow CI/CD best practices for data engineering using Git, Azure DevOps, or similar tools.
Document solutions, create technical specifications, and support code reviews.

Required Skills

10 years of professional Data Engineering experience.
Strong hands-on expertise with Azure Databricks and Apache Spark (PySpark / Scala).
Strong experience with Azure cloud services:
Azure Data Lake (ADLS)
Azure Data Factory (ADF)
Azure SQL / Synapse
Azure Key Vault
Strong SQL development skills (complex queries, window functions, tuning).
Experience with Delta Lake features and Databricks workspace management.
Experience building and running pipelines on CI/CD frameworks (Azure DevOps preferred).
Strong understanding of data modeling, partitioning, performance tuning, and job orchestration.
Experience working with large datasets in distributed environments.
Excellent communication and problem-solving skills.

Education: Bachelor s or Master s degree in Computer Science, Data Engineering, or related field

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91159647
Position Id: 8857458
Posted 5 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Azure Databricks Engineer 9+

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs