Senior SDET ETL & Databricks Testing

Job Title - Senior SDET – ETL & Databricks Testing

Location: Shelton, CT

Work Arrangement: Hybrid – 4 days onsite per week

Duration: 6–12 months contract

Mode of Interview - Video followed by Inperson 

Note - This is a W-2 position, and we welcome candidates requiring H-1B transfer sponsorship to apply. No third-party vendors.

Job Summary

We are seeking a Senior SDET / Testing & Automation Engineer with strong expertise in ETL, Data Warehouse Testing, and Databricks. The ideal candidate will serve as the SME for ETL and Databricks testing as the organization transitions its data platform from Matillion to Databricks.

The candidate should have 8–10+ years of overall QA/SDET experience, including 4–6+ years of hands-on ETL/Data Warehouse testing.

Key Responsibilities

• Serve as the ETL/Databricks Testing SME for the migration from Matillion to Databricks.
• Design and execute comprehensive ETL and Data Warehouse testing strategies.
• Validate data pipelines, transformations, mappings, data loads, and business rules.
• Perform source-to-target data validation and reconciliation across systems.
• Develop and execute automated testing frameworks for ETL and data pipelines.
• Test Databricks data pipelines, notebooks, workflows, Delta Lake, and SQL-based transformations.
• Validate data quality, completeness, accuracy, integrity, and performance.
• Perform backend/database testing using complex SQL queries.
• Identify, troubleshoot, and resolve data discrepancies and pipeline failures.
• Collaborate with Data Engineers, Developers, Business Analysts, and other QA team members.
• Develop test plans, test cases, automation scripts, and testing documentation.
• Support regression, integration, system, and end-to-end testing.
• Provide technical guidance and best practices for ETL and Databricks testing.

Required Skills

• 8–10+ years of experience in Software Quality Assurance/SDET.
• 4–6+ years of hands-on ETL/Data Warehouse Testing.
• Strong experience with Databricks and testing Databricks-based data pipelines.
• Strong understanding of ETL/ELT concepts and Data Warehousing.
• Experience testing Matillion or similar ETL tools is highly preferred.
• Strong SQL skills for data validation and reconciliation.
• Experience with data pipeline and backend testing.
• Strong experience with test automation and SDET practices.
• Experience with data quality, data integrity, transformation, and reconciliation testing.
• Strong analytical and troubleshooting skills.
• Excellent communication and collaboration skill