SDET / Data Test Automation Engineer

Hybrid in Charlotte, NC, US • Posted 6 hours ago • Updated 6 hours ago
Contract W2
12 Months
No Travel Required
Able to Sponsor
Hybrid
$45 - $50/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • SDET
  • Automation
  • ETL
  • PySpark
  • Python
  • SQL
  • PyTest
  • Hive
  • Hadoop
  • Databricks
  • AWS
  • Azure DevOps
  • Agile
  • Scrum

Summary

Title: SDET / Data Test Automation Engineer

Location: Charlotte, NC (Hybrid)

Duration: Long-term Contract

 

Job Description:

 

  • SDET and Test Automation Engineer, focused on data engineering and data warehouse testing in enterprise and financial-services environments.
  • Strong hands-on experience validating ETL and ELT pipelines end-to-end. This covers source-to-target mapping checks, data completeness, accuracy, and transformation rules, duplicate and null checks, schema validation, and reconciliation between source systems, staging, and target layers.
  • Builds PySpark-based test automation frameworks that validate large datasets in distributed environments, using DataFrame comparisons, row-count and checksum reconciliation, and rule-based data quality checks at scale.
  • Skilled in Python and SQL for writing test scripts, complex validation queries, and reusable utilities. Uses PyTest for test organization, fixtures, parameterization, and reporting.
  • Has tested data pipelines built on Spark, Hive, Hadoop/HDFS, Databricks, and Snowflake.
  • Familiar with ELT patterns on cloud data platforms (AWS S3/Glue/EMR, Azure Data Factory/ADLS).
  • Applies data quality frameworks such as Great Expectations or custom PySpark rule engines, covering threshold checks, referential integrity, SCD Type 1/2 validation, and incremental/CDC load testing.
  • Integrates automated data tests into CI/CD pipelines (Jenkins, GitHub Actions, Azure DevOps) so data releases get shift-left validation and regression coverage.
  • Experienced with API testing (REST Assured, Postman, Python requests) for data ingestion services. Does performance and volume testing of batch jobs.
  • Works in Agile/Scrum teams with data engineers, BAs, and product owners. Writes test strategies and test plans and maintains RTMs. Tracks defects in JIRA, and test cases in Zephyr/qTest/ALM.
  • Strong analytical and communication skills. Can find the root cause of data issues across pipeline layers and explain the impact to both technical and business stakeholders.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91174554
  • Position Id: 9145014
  • Posted 6 hours ago

Company Info

About Code Beacons Inc

Pioneering the Future of AI Innovation

At Code Beacons, we're dedicated to making artificial intelligence accessible and impactful for businesses worldwide.

Empowering Innovation Through AI Excellence

Code Beacons has been at the forefront of AI innovation, helping businesses leverage artificial intelligence to solve complex challenges and drive growth. Our mission is to make advanced AI technology accessible to organizations of all sizes.

 
Industry-leading AI expertise
 
Global reach with local impact
 
Commitment to ethical AI development
Contact the job poster
AK

Ashish Kumar Sharma

Recruiter @ Code Beacons Inc

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.