Job Title: Azure Data Engineer
Location: Remote
Employment Type: 12 months Contract
Experience: 6+ years
Position Summary:
A public sector client is building a shared, self-serve data platform on Azure. You will capture transactional data from agency systems with change data capture (CDC) and event streaming, publish it as governed data products, and onboard the first pilot domain, built to scale as more agencies join.
Responsibilities:
• Design the data mesh: domain boundaries, data product standards and the self-serve layer on ADLS Gen2 with Databricks or Fabric
• Build CDC and streaming ingestion from SQL Server, Oracle and other OLTP sources using Debezium, Event Hubs/Kafka, Data Factory or Fabric mirroring
• Engineer pipelines that handle ordering, idempotency, late-arriving data, slowly changing dimensions and reconciliation
• Build reusable data product templates (PySpark/SQL on Delta Lake, data contracts, quality checks) and onboard the pilot domain
• Set up CI/CD and infrastructure as code (Bicep or Terraform), write the onboarding playbook and run knowledge transfer
Must Have:
• Skills field: Azure, Databricks, Microsoft Fabric, ADLS Gen2, Change Data Capture, Debezium, Azure Event Hubs, Kafka, Azure Data Factory, PySpark, Delta Lake, SQL, Data Mesh, Data Contracts, Terraform, Bicep, CI/CD
• 6+ years in data engineering, with deep OLTP and CDC experience
• 3+ years on Azure or Databricks, with a current Databricks Data Engineer Professional or Microsoft DP-700 certification
• Streaming pipelines with Kafka, Event Hubs, Debezium or similar
• Hands-on data mesh, data fabric or data product architecture
• Strong SQL, PySpark and Delta Lake, with relational and dimensional modeling
Nice to have:
• Data contracts, schema evolution and automated data quality
• Microsoft Purview and governance automation
• Public sector or multi-agency data, including PII
• CIMP Data Quality or Lean Six Sigma certification
