Quality Engineering & Automation specialist

We are seeking a Data-focused Quality Engineer to join our team in Cincinnati. This is not a traditional UI/Web testing role. You will be responsible for building automated test frameworks for massive data pipelines, ensuring the reliability of Databricks notebooks, Delta tables, and complex ETL processes.

What You Will Do

• Automate Data Testing: Develop and execute automated frameworks for Databricks environments using PySpark and SQL.
• Validate Pipelines: Perform end-to-end testing of data ingestion and transformation layers (ETL/ELT).
• Ensure Data Quality: Implement automated checks for data accuracy, completeness, and consistency using Delta Live Tables and Databricks Workflows.
• CI/CD Integration: Integrate data quality tests into the automated CI/CD pipeline.
• Performance Tuning: Troubleshoot and optimize Spark jobs to ensure scalability across large datasets.

Required Skills

• Platform: 2+ years of hands-on experience with Databricks and Delta Lake.
• Languages: Strong proficiency in PySpark and complex SQL.
• Testing: Experience building automated "test harnesses" for data pipelines or APIs.
• Engineering: Solid understanding of data warehousing, schema validation, and Spark optimization.
• DevOps: Familiarity with CI/CD tools (Azure DevOps, GitHub Actions, or Jenkins).

Preferred Qualifications

• Databricks Certified Data Engineer or Associate.
• Experience with data quality tools like Great Expectations or Deequ.
• Local to Cincinnati or willing to relocate (Expenses covered for initial meet-and-greet).