Overview
On Site
Hybrid
BASED ON EXPERIENCE
Full Time
Contract - W2
Contract - Independent
Skills
DATABRICKS
AZURE DATABRICKS
SPARK
PYTHON
DATA ENGINEER
Job Details
Job Title: Azure Data Engineer
Long term contract
100% remote
Long term contract
100% remote
Job Description
Azure Cloud/Engineers - strong Databricks experience
- 5+ years of experience in Databricks and ETL development to design, build, and optimize robust data pipelines and ETL automation.
- Collaborate effectively with data architects, DBAs, product owners, and other stakeholders to ensure alignment on project goals, requirements, and solutions.
- Design, develop, and maintain scalable data pipelines in Azure using Python and Databricks, focusing on efficient ETL processes for large datasets.
- Build and optimize data lakes and backend architectures, ensuring smooth data extraction, transformation, and loading (ETL) across systems.
- Work with healthcare data (claims, pharma, PHI/PII), ensuring compliance with data privacy regulations and implementing security measures like tokenization.
- Leverage Azure cloud technologies, particularly Databricks, to implement large-scale data processing and analytics solutions.
- Integrate middleware solutions like MuleSoft for data processing between SAP and Databricks.
- Drive data transformation and automation tasks, focusing on scalable and efficient solutions within the engineering team.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.