Data Engineer

Job Summary

Location: United States

Experience: 5+ years in Data Engineering

Job Type: Permanent

Thinking Minds' client is looking for an experienced Senior Data Engineer to help shape the data platform that supports much of their business. This role is crucial for building and operating systems that ingest, validate, transform, and serve data across various domains. The engineer will own data systems end to end, making critical architecture decisions and ensuring the integrity and availability of data.

Ideal Candidate Should Have

Experience with data ingestion and transformation

Proficiency in data modeling

Ability to design data systems end to end

Experience with handling incomplete and malformed data

Strong skills in evolving schemas and pipelines

Role Overview

The Senior Data Engineer will be responsible for owning production data systems and domains from ingestion through delivery. They will design ingestion patterns that handle incomplete, duplicated, delayed, malformed, and changing partner data. The role involves defining contracts between source systems, ingestion, transformation, and downstream consumers. The engineer will also design data models with clear grain, keys, history, and definitions to ensure consistency in data answers.

Key Responsibilities

Own production data systems and domains

Design ingestion patterns for complex data

Define contracts between data systems

Design and evolve data models

Ensure data integrity and availability

Support other engineers in data infrastructure decisions

Top Skills and Modules

Data Engineering

Data ingestion

Data modeling

Schema evolution

Pipeline management

Data integrity

Architecture decisions