Job Title: SDET Engineer / Data Quality
Location: Atlanta, GA / Frisco, TX / Bellevue, WA
Duration: / Term: Contract
Experience Desired: 8+ Years
Job Description:
We are seeking a Senior SDET Engineer to own quality engineering for our Customer Data Platform (CDP) — the authoritative source of truth for customer data across the entire US adult population.
An authoritative source of truth is only authoritative if the data is correct. This role ensures exactly that: building comprehensive quality frameworks that validate data accuracy, completeness, and consistency at every stage — from ingestion through identity resolution to consumption. You will go beyond traditional testing to embed quality into the DNA of every pipeline, API, and AI-driven system in CDP.
You will work closely with data engineers, AI/ML engineers, platform teams, and product stakeholders to ensure that CDP earns and maintains the trust of every consumer across the organization.
Job Responsibilities
- Design and implement scalable test automation frameworks for data pipelines, APIs, and distributed systems — with quality standards calibrated to CDP''s role as the authoritative source of truth
- Build data validation frameworks to ensure completeness, accuracy, and consistency of customer profiles across systems (e.g., ADLS, Databricks, Snowflake)
- Develop manual and automated tests for batch and streaming data pipelines, including reconciliation, anomaly detection, and data freshness validation
- Validate identity resolution outputs — ensuring deduplication, matching, and golden profile creation meet accuracy thresholds before data reaches downstream consumers
- Validate API integrations and microservices, including contract testing and performance validation for systems serving real-time customer experiences
- Drive test strategy for cloud-native and data platforms, including CI/CD integration and shift-left practices that catch quality issues before production
- Partner with engineering teams to ensure testability, observability, and quality gates are built into every solution — not bolted on after the fact
- Lead quality initiatives for GenAI/ML-based applications, including prompt validation, output consistency, and evaluation frameworks for LLM-driven features
- Design and maintain data quality scorecards and dashboards that give stakeholders visibility into CDP''s trustworthiness
- Analyze production issues, identify root causes, and improve test coverage to prevent recurrence — protecting the platform''s reputation as the source of truth
- Mentor junior engineers and promote quality engineering best practices across the team
- Collaborate across teams to support continuous delivery and high availability systems
Education and Work Experience
- Bachelor''s or Master''s degree in Computer Science, Engineering, or related field
- 6+ years of experience in software quality engineering / SDET roles, preferably in data platforms or cloud environments
- Strong experience testing data engineering pipelines and large-scale datasets
- Hands-on experience with cloud platforms (Azure preferred) and modern data stack technologies
- Experience working in Agile/Scrum environments
Technical Skills
- Strong programming skills in Python, Java, or Scala
- Experience with data platforms and storage systems: ADLS, Databricks, Snowflake, SQL Server, Cosmos DB
- Experience validating ETL/ELT pipelines, including batch and streaming (Kafka/Event Hub)
- Hands-on experience with API testing tools (Postman, Rest Assured, PyTest, etc.)
- Experience building test automation frameworks from scratch for data-intensive applications
- Knowledge of CI/CD pipelines and integration with testing frameworks
- Experience with data quality tools, reconciliation techniques, and query-based validation at scale
- Exposure to GenAI/LLM validation, Azure AI Foundry, or similar platforms is a strong plus
- Familiarity with performance testing and scalability validation for distributed systems processing billions of records
Knowledge, Skills, and Abilities
- Strong understanding of data architecture, distributed systems, and the unique quality challenges of population-scale customer data
- Ability to think in terms of data correctness, lineage, and system reliability — understanding that data quality is the foundation of CDP''s authority
- Excellent problem-solving and debugging skills in complex, multi-system environments
- Strong collaboration skills across engineering, AI/ML, product, and operations teams
- Ability to drive quality as a culture, not just a phase — embedding trust into every layer of the platform
Key Skills:
Data Quality, Azure, Databricks, PySpark, AI/ML
Never miss an opportunity! Create an alert based on the job you applied for.
