Azure Databricks Developer (Louisville, KY, Pittsburgh, PA) (Locals only)

Overview

On Site
$30 - $40
Accepts corp to corp applications
Contract - W2
Contract - 12 Month(s)
100% Travel
Able to Provide Sponsorship

Skills

Debugging
Data Engineering
Data Governance
Data Integration
Data Lake
Databricks
ADF
Analytics
Big Data
Collaboration
Communication
Conflict Resolution
Regulatory Compliance
Reporting
SQL
Unstructured Data
Workflow
Extract
Transform
Load
Health Care
Microsoft Azure
Problem Solving
PySpark

Job Details

Responsibilities:

  • Design, develop, and maintain data pipelines and ETL processes using Azure Databricks and Azure Data Factory (ADF).

  • Implement scalable data solutions to support analytics and reporting requirements.

  • Work with structured and unstructured data to build clean, reliable, and optimized datasets.

  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

  • Monitor, debug, and optimize existing data workflows for performance and cost efficiency.

  • Ensure best practices in data governance, security, and compliance (especially relevant in the Healthcare domain).

  • Solve complex data engineering challenges with innovative solutions.

Requirements:

  • Mandatory: Expertise in Azure Databricks and Azure Data Factory (ADF).

  • Strong experience in PySpark, SQL, and big data processing.

  • Hands-on experience with ETL workflows, data integration, and data lake architectures.

  • Strong problem-solving skills and ability to troubleshoot performance issues.

  • Healthcare industry experience is highly preferred.

  • Excellent communication skills and ability to work in a collaborative environment.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Padmas Technology LLC