Overview
Skills
Job Details
Position Overview: We are seeking a highly skilled and experienced Senior QA Engineer to lead and enhance our QA practice for modern data platforms. This individual will play a critical role in improving QA execution, coverage, and reliability, ensuring high-quality delivery for our data engineering initiatives. The ideal candidate has a strong background in data engineering, testing at scale, and a deep understanding of modern data platform architectures.
Key Responsibilities:
Testing Strategy Development:
Establish and implement best practices for testing data applications at scale.
Design and maintain reusable and scalable testing frameworks and processes.
Technical Testing Expertise:
Develop and execute comprehensive test plans, test cases, and test scripts based on business and functional requirements.
Leverage tools such as Great Expectations, pytest, or similar Python-based testing harnesses to ensure data accuracy and quality.
Validate data pipelines, transformations, and storage in Data Lake and Delta Lake architectures.
Collaboration and Mentorship:
Effectively communicate testing strategies and processes to junior QA analysts.
Provide guidance and mentorship to elevate team capabilities.
User Acceptance Testing (UAT):
Lead UAT processes, including preparing artifacts, coordinating meetings, and delivering status updates.
Technical Proficiency:
Write and optimize SQL queries for data validation and testing purposes.
Develop automated test scripts using Python to ensure data quality and integrity.
Required Qualifications:
Experience: 6 10 years in a Data Engineer/Developer role on modern data platforms.
Proven ability to establish testing best practices for data applications.
Strong technical skills in SQL and Python.
Hands-on experience with QA tools like Great Expectations or similar.
Familiarity with Data Lake/Delta architecture and large-scale data systems.
Ability to translate complex business and functional requirements into test cases.
Experience running UAT, including creating artifacts, status reports, and managing meetings.
Preferred Qualifications:
Background as an ETL Developer or similar.
Experience with SOX compliance or similar regulatory frameworks.
What We re Not Looking For:
Candidates with a non-developer background.
Professionals lacking data engineering or data warehousing expertise.
QA resources focused solely on UI testing.