Databricks Platform Engineer on AWS

Remote • Posted 13 hours ago • Updated 9 hours ago
Contract Independent
Contract W2
Remote
$55 - $60/hr
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Databricks
  • AWS
  • CI/CD
  • GitHub
  • AWS Secrets Manager
  • PySpark
  • SQL
  • Delta Lake
  • Unity Catalog

Summary

# of Openings: 2

Note: W2 Independent Contractors -EAD only.

Title: Databricks Platform Engineer on AWS

Locations: Remote, East Coast Preferred but not mandatory

Start Date: 04/08/2026
End Date: 01/07/2027

Role Summary
We are seeking a Databricks Platform Engineer to implement and operationalize core platform capabilities on Databricks running on AWS. This role focuses on frameworks, automation, observability, and reliable delivery aligned to established platform standards.
Key Responsibilities Platform Engineering

  • Implement metadata-driven ingestion frameworks and standard ingestion patterns
  • Build batch, incremental, and CDC ingestion pipelines
  • Ensure pipelines follow platform standards for configuration, schema evolution, tagging, and error handling

Observability & Operations

  • Implement pipeline monitoring, metrics, and alerting
  • Support operational validation, failure simulation, and recovery testing

Data Quality & Governance

  • Embed data quality rules and quarantine patterns
  • Apply Unity Catalog tags (domain, owner, sensitivity, freshness) at ingestion time
  • Ensure governance metadata is written to governed schemas

CI/CD & Automation

  • Build CI/CD pipelines using GitHub Actions
  • Support configuration validation, environment promotion, and rollback
  • Ensure secret management via AWS Secrets Manager

Required Qualifications

  • 5 8 years data or platform engineering experience
  • 3+ years hands-on Databricks experience
  • Strong PySpark and SQL
  • Experience with Delta Lake, Unity Catalog, Git-based development

Preferred Qualifications

  • Ingestion framework experience
  • Monitoring and alerting implementation
  • Production platform support experience

Success Measures

  • Stable, reusable ingestion frameworks
  • Reduced custom pipeline development
  • Reliable CI/CD and proactive operational monitoring
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91094056
  • Position Id: 8938971
  • Posted 13 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Easy Apply

Contract

Depends on Experience

Remote

Today

Easy Apply

Contract

Depends on Experience

Remote

Yesterday

Easy Apply

Contract

Depends on Experience

Remote

4d ago

Easy Apply

Contract

65 - 68

Search all similar jobs