Data Engineer Databricks SME

Remote • Posted 1 hour ago • Updated 1 hour ago
Contract W2
Remote
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Azure Databricks
  • PySpark
  • Azure Data Factory
  • ETL
  • metadata
  • Azure Purview
  • Apache Atlas
  • Python
  • SQL
  • Kafka
  • NiFi
  • Spark Streaming
  • Git
  • DevOps

Summary

We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure Cloud to support large-scale data migration and modernization initiatives. The ideal candidate will have hands-on experience with data ingestion, ETL/ELT pipelines, data deduplication, metadata tagging, and Spark-based technologies.

Required Skills:
Strong experience with Azure Databricks, PySpark, and Azure Data Factory
Experience building scalable data ingestion and ETL pipelines
Expertise in data deduplication, entity resolution, and fuzzy matching
Hands-on experience with metadata management and data governance tools such as Azure Purview or Apache Atlas
Experience working with structured, semi-structured, and unstructured data
Strong scripting skills in Python and SQL
Experience with Kafka, NiFi, Spark Streaming, Git, and DevOps tools is a plus

Candidates must be eligible for a Public Trust clearance.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: zolva001
  • Position Id: 8963932
  • Posted 1 hour ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

30+d ago

Easy Apply

Contract

65 - 68

Remote

3d ago

Easy Apply

Third Party, Contract

60 - 70

Remote

7d ago

Easy Apply

Contract

Depends on Experience

Remote

Today

Easy Apply

Contract

Depends on Experience

Search all similar jobs