Azure Data Engineer

  • Remote, FL
  • Posted 15 hours ago | Updated 11 hours ago

Overview

On Site
Hybrid
BASED ON EXPERIENCE
Full Time
Contract - W2
Contract - Independent

Skills

DATABRICKS
AZURE DATABRICKS
SPARK
PYTHON
DATA ENGINEER

Job Details

Job Title: Azure Data Engineer
Long term contract

100% remote

Job Description
Azure Cloud/Engineers - strong Databricks experience

  • 5+ years of experience in Databricks and ETL development to design, build, and optimize robust data pipelines and ETL automation.
  • Collaborate effectively with data architects, DBAs, product owners, and other stakeholders to ensure alignment on project goals, requirements, and solutions.
  • Design, develop, and maintain scalable data pipelines in Azure using Python and Databricks, focusing on efficient ETL processes for large datasets.
  • Build and optimize data lakes and backend architectures, ensuring smooth data extraction, transformation, and loading (ETL) across systems.
  • Work with healthcare data (claims, pharma, PHI/PII), ensuring compliance with data privacy regulations and implementing security measures like tokenization.
  • Leverage Azure cloud technologies, particularly Databricks, to implement large-scale data processing and analytics solutions.
  • Integrate middleware solutions like MuleSoft for data processing between SAP and Databricks.
  • Drive data transformation and automation tasks, focusing on scalable and efficient solutions within the engineering team.
Familiarity with healthcare or pharma-related data, with expertise in handling sensitive data (PHI/PII) and implementing security measures such as tokenization
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Apolis