Data Engineering (DE) Lead

Remote • Posted 2 hours ago • Updated 2 hours ago
Full Time
No Travel Required
Remote
120000 - 140000/yr
Fitment

Dice Job Match Score™

🫥 Flibbertigibetting...

Job Details

Skills

  • Epic
  • Health Care
  • Google Cloud Platform
  • Mobile Device Management
  • Master Data Management
  • Oracle

Summary

Role Description

Own data-engineering delivery on Google Cloud Platform/DataFlow, including ingestion, transformation, standardisation, reconciliation, publication and operational engineering standards.

Key Responsibilities

 Define reusable DataFlow/Google Cloud Platform ingestion and transformation patterns.

  • Implement source ingestion from Epic, ELMS, Oracle, terminology and other approved sources.
  • Build raw/source-preserving, standardised/cleansed and curated/mastered processing layers.
  • Implement standardisation, validation, transformation and reference-data enrichment.
  • Build reconciliation controls between source, MDM/RDM and downstream publication.
  • Build publication pipelines to Google Cloud Platform data products, APIs, events and tables/files.
  • Implement replay, restart, idempotency, audit and monitoring; optimise performance and cost.
  • Establish CI/CD, code quality and production support procedures.

 Primary Deliverables

 

  • Data engineering architecture / design
  • Ingestion and transformation pipelines
  • Reconciliation framework
  • Publication pipelines
  • Operational monitoring and runbooks
  • CI/CD and engineering standards

 Required Experience & Skills

 

  • 8+ years in data engineering, hands-on with Google Cloud Platform and DataFlow (or equivalent).
  • Large-scale batch, incremental and event-driven pipeline experience.
  • Experience feeding and reconciling MDM/RDM data.
  • Strong on operationalisation: monitoring, replay, CI/CD.

 Good to Have

 

  • BigQuery, Pub/Sub and Dataflow depth.
  • Healthcare data engineering.
  • Integration with Informatica MDM loads.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10469220
  • Position Id: TechM232970
  • Posted 2 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or Hybrid in Minnesota City, Minnesota

Today

Easy Apply

Full-time

Depends on Experience

Remote

Today

Easy Apply

Full-time

$140,000 - $160,000

Remote

Today

Easy Apply

Contract

Depends on Experience

Remote

10d ago

Easy Apply

Contract, Third Party

Depends on Experience

Search all similar jobs