AWS Databricks Data Engineer with Healthcare Exp. : Remote

Remote • Posted 3 hours ago • Updated 3 hours ago
Contract W2
Contract Corp To Corp
Contract Independent
12 Months
No Travel Required
Remote
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Access Control
  • Amazon S3
  • Amazon Web Services
  • Analytics
  • Apache Spark
  • Cloud Computing
  • Collaboration
  • Continuous Delivery
  • Continuous Integration
  • Data Engineering
  • Data Governance
  • Data Quality
  • Data Storage
  • Databricks
  • GitHub
  • GitLab
  • Health Care
  • MMIS
  • Machine Learning (ML)
  • Management
  • PySpark
  • Python
  • SQL
  • Streaming
  • Testing
  • Unity
  • Workflow

Summary

AWS Databricks Data Engineer
Remote

We are seeking an experienced AWS Databricks Data Engineer to design, build, and maintain scalable data pipelines and cloudnative data infrastructure. The ideal candidate will have strong expertise in Apache Spark, PySpark, Python, SQL, Delta Lake, and AWS services, with proven experience in production Databricks environments.

<>Key Responsibilities
  • Design and implement batch and streaming data pipelines using PySpark, Delta Lake, and Delta Live Tables (DLT).
  • Develop scalable ingestion and transformation solutions within Databricks.
  • Build integrations with AWS services such as S3, IAM, and Lambda.
  • Configure and manage data governance, security, and access controls via Databricks Unity Catalog.
  • Monitor and optimize pipeline performance, reliability, and data quality.
  • Automate testing and deployment using CI/CD tools (GitHub/GitLab).
  • Collaborate with data scientists and stakeholders to prepare datasets for analytics and machine learning.
  • Support healthcare payer datasets including claims, provider, member enrollment, and MMIS data.
<>Required Skills & Experience
  • 3 5 years of handson data engineering experience.
  • Strong productionlevel experience with Databricks.
  • Advanced programming skills in Python and PySpark.
  • Advanced SQL expertise.
  • Deep understanding of Apache Spark, Delta Lake, and Data Lakehouse architecture.
  • Experience with Delta Live Tables, Unity Catalog, and Databricks Workflows.
  • Familiarity with AWS cloud services for data storage and management.
<>Work Hours
  • Must be available to work in the CST time zone.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10339744
  • Position Id: 9065100
  • Posted 3 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Full-time

USD 113,000.00 - 188,000.00 per year

Remote

6d ago

Easy Apply

Full-time

Depends on Experience

Remote

Today

Easy Apply

Third Party, Contract

60 - 70

Remote or Reston, Virginia

Today

Full-time

USD 89,649.00 - 152,404.00 per year

Search all similar jobs