Apply Now

Azure Databricks Engineer

Newtown Square, PA, US • Posted 10 hours ago • Updated 10 hours ago

Contract W2

Travel Required

On-site

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

🔢 Crunching numbers...

Job Details

Skills

Real-time
Performance Tuning
Workflow
Access Control
Collaboration
Data Engineering
Apache Spark
PySpark
Python
SQL
Data Lake
Storage
ADF
Git
DevOps
Continuous Integration
Continuous Delivery
Data Warehouse
Extract
Transform
Load
ELT
Data Processing
Microsoft Azure
Unity
Databricks
Apache Kafka
Streaming
Terraform
Data Modeling
Dimensional Modeling
Data Quality
Microsoft Power BI
Analytics

Summary

Azure Databricks Engineer

Location: Newtown Sqaure, PA

W2 POSITION

Job Summary

We are looking for an experienced Azure Databricks Engineer to design, develop, and maintain scalable data engineering solutions on Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Databricks, Apache Spark, Python/SQL, and modern data lake architectures.

Key Responsibilities:

Design and develop scalable data pipelines using Azure Databricks, Apache Spark, Python, and SQL.
Build and optimize ETL/ELT pipelines for batch and real-time data processing.
Develop data solutions using Azure Data Lake Storage (ADLS Gen2) and Delta Lake.
Implement Delta Lake tables, partitioning, schema evolution, and performance optimization.
Develop notebooks, workflows, jobs, and reusable frameworks in Azure Databricks.
Integrate Databricks with Azure services such as Azure Data Factory, Azure Key Vault, Azure Synapse Analytics, and Azure Event Hubs.
Perform data transformation, cleansing, validation, and quality checks.
Optimize Spark jobs and Databricks workloads for performance and cost.
Implement CI/CD pipelines using Azure DevOps and Git.
Monitor production pipelines, troubleshoot failures, and resolve data-quality issues.
Implement security, access control, and governance following enterprise standards.
Collaborate with data architects, analysts, developers, and business stakeholders.

Required Skills:

10 15+ years of experience in data engineering or a related field.
Strong hands-on experience with Azure Databricks.
Strong knowledge of Apache Spark / PySpark.
Proficiency in Python and SQL.
Experience with Azure Data Lake Storage Gen2.
Strong understanding of Delta Lake and lakehouse architecture.
Experience with Azure Data Factory (ADF).
Experience with Git and Azure DevOps CI/CD.
Good understanding of data warehousing and ETL/ELT concepts.
Experience troubleshooting and optimizing distributed data-processing workloads.

Preferred Skills:

Experience with Azure Synapse Analytics.
Knowledge of Unity Catalog and Databricks governance.
Experience with streaming technologies such as Event Hubs, Kafka, or Structured Streaming.
Experience with Terraform or infrastructure-as-code.
Knowledge of data modeling and dimensional modeling.
Experience implementing data quality and observability frameworks.
Familiarity with Power BI and downstream analytics platforms.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91091620
Position Id: 2026-2316
Posted 10 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Remote

•

8d ago

Job Title: Data Engineer (Databricks, Azure, Kafka) Location: Remote Job Type: W2 / C2C / 1099 Job Summary: We are looking for an experienced Data Engineer with 9+ years of experience to design, build, and maintain data pipelines using Databricks, Spark, and Azure cloud services. The ideal candidate has hands-on experience with modern data engineering tools, cloud automation, and event-driven architectures. Job Responsibilities: Design, develop, and optimize scalable data pipelines using Databri

Full-time

Required Sr Databricks Engineer - REMOTE

Remote

•

Yesterday

Title: Databricks Data Engineer - REMOTE Job Title: Data Engineer Experience: 12+ years Position Summary Seeking an experienced Databricks Engineer to support the modernization of our enterprise data platform as part of our cloud transformation journey. The ideal candidate will design, develop, and optimize scalable data solutions on the Databricks Lakehouse Platform while enabling advanced analytics, AI/ML initiatives, and enterprise-wide data products. This role will work closely with Data A

Easy Apply

Contract

Databricks Architect

Remote

•

28d ago

About the job: Job Title: Databricks Architect Location: Remote across Canada Position Type: Full Time We are seeking an experienced Databricks Architect with strong hands-on expertise in Unity Catalog, Apache Spark, PySpark, SQL, and Delta Lake. The ideal candidate will design, develop, and optimize scalable data engineering solutions on the Databricks Lakehouse platform while ensuring strong data governance, security, and access controls through Unity Catalog. Key Responsibilities Design and d

Easy Apply

Full-time

130,000 - 150,000

Healthcare Data Engineer

Remote

•

Today

Data Engineer - Healthcare Analytics Remote This is a Remote role. Compensation: $65 - $85 per hour Contract Length: Up to 12 months Hours: 8am-5pm MST, M-F Start Date: ASAP, 10/5/2026 ABOUT THE ROLE Join a mission-driven healthcare analytics team supporting a nonprofit health insurance provider serving over 1 million members across the Mountain West region. As a Data Engineer, you will play a key role in building the data foundation for value-based care initiatives, including risk adjustment,

Contract

$65.00 - $85.00

Search all similar jobs

More jobs at iQuest Solutions Corp in Newtown Square, PA

Azure Databricks Engineer

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs