Senior Quality Engineer – Data Pipelines (AWS)

Hybrid in New York, NY, US • Posted 2 hours ago • Updated 2 hours ago
Contract Corp To Corp
Contract W2
No Travel Required
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

  • Senior Quality Engineer – Data Pipelines (AWS) Location:Hybrid – Manhattan must be local to NJ must have 15 years of exp Employment Type:Contract Role Summary We are seeking a Senior Quality Engineer to own test planning and validation of data pipelines within an AWS-based data lakehouse environment. This role will work closely with developers
  • DevOps
  • and data teams to ensure data integrity and reliability across CI/CD pipelines and cloud workflows. The position involves designing and maintaining test automation
  • independently analyzing logs to troubleshoot failures
  • and contributing to stable and reliable data processing using AWS services. Ideal Candidate Profile 14+ years overall experience in software quality
  • testing
  • and data pipeline validation 5+ years in testing AWS-based data pipelines and cloud workflows Experience working in Agile environments (Scrum or Kanban) Familiarity with cloud-based and DevOps-driven development environments Working knowledge of SQL and relational databases Experience with software testing tools (e.g.
  • Jira
  • qTest
  • ALM
  • Selenium) Basic proficiency with Git version control (clone
  • commit
  • push
  • pull
  • branching) Basic command-line proficiency (Linux
  • PowerShell
  • CMD) Hands-on experience with AWS services: S3
  • Glue
  • Athena
  • CodeCommit
  • CodeBuild
  • CodePipeline Experience with Terraform/Terrahub in CI/CD pipelines Log analysis and troubleshooting in build/deployment pipelines Key Responsibilities Own end-to-end test planning and execution for AWS-based data lakehouse pipelines and integrations Design
  • develop
  • and maintain automated test scripts to validate data pipelines and support CI/CD workflows Validate data workflows using AWS services including S3
  • and Athena Independently support and troubleshoot CI/CD pipelines using CodeCommit
  • and CodePipeline Review build and deployment logs to identify failures and perform root cause analysis Work with Terraform/Terrahub components within build pipelines (CodeBuild) Perform functional
  • regression
  • and data validation testing across releases Track
  • document
  • and drive defects through resolution in collaboration with development teams Define test strategies
  • scope
  • and estimates for releases and test cycles Collaborate with cross-functional teams to support UAT and production readiness Communicate testing progress
  • risks
  • and results to stakeholders Education: Bachelor’s degree in Computer Science
  • Engineering
  • Information Systems
  • or equivalent experience.

Summary

Senior Quality Engineer – Data Pipelines (AWS)

Introduction:

We are seeking a Senior Quality Engineer to own test planning and validation of data pipelines within an AWS-based data lakehouse environment. This role will work closely with developers, DevOps, and data teams to ensure data integrity and reliability across CI/CD pipelines and cloud workflows. The position involves designing and maintaining test automation, independently analyzing logs to troubleshoot failures, and contributing to stable and reliable data processing using AWS services.

Responsibilities:

  • Own end-to-end test planning and execution for AWS-based data lakehouse pipelines and integrations
  • Design, develop, and maintain automated test scripts to validate data pipelines and support CI/CD workflows
  • Validate data workflows using AWS services including S3, Glue, and Athena
  • Independently support and troubleshoot CI/CD pipelines using CodeCommit, CodeBuild, and CodePipeline
  • Review build and deployment logs to identify failures and perform root cause analysis
  • Work with Terraform/Terrahub components within build pipelines (CodeBuild)
  • Perform functional, regression, and data validation testing across releases
  • Track, document, and drive defects through resolution in collaboration with development teams
  • Define test strategies, scope, and estimates for releases and test cycles
  • Collaborate with cross-functional teams to support UAT and production readiness
  • Communicate testing progress, risks, and results to stakeholders

Requirements:

Required Skills:

  • 14+ years overall experience in software quality, testing, and data pipeline validation
  • 5+ years in testing AWS-based data pipelines and cloud workflows
  • Experience working in Agile environments (Scrum or Kanban)
  • Familiarity with cloud-based and DevOps-driven development environments
  • Working knowledge of SQL and relational databases
  • Experience with software testing tools (e.g., Jira, qTest, ALM, Selenium)
  • Basic proficiency with Git version control (clone, commit, push, pull, branching)
  • Basic command-line proficiency (Linux, PowerShell, CMD)
  • Hands-on experience with AWS services: S3, Glue, Athena, CodeCommit, CodeBuild, CodePipeline
  • Experience with Terraform/Terrahub in CI/CD pipelines
  • Log analysis and troubleshooting in build/deployment pipelines

Preferred Skills:

  • Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10122100
  • Position Id: 8932114
  • Posted 2 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in New York, New York

Today

Easy Apply

Contract, Third Party

$60

Jersey City, New Jersey

Today

Easy Apply

Contract

$60 - $65 per hour

New York, New York

2d ago

Easy Apply

Contract, Third Party

$80 - $85

New York, New York

10d ago

Easy Apply

Contract

$80 - $100

Search all similar jobs