Senior QA Engineer for Azure Data Platforms

Overview

Remote
Depends on Experience
Contract - Independent
Contract - 12 Month(s)

Skills

SQL
Python
Great Expectations
pytest
data validation
testing frameworks
data quality
data accuracy
Data Lake architecture
Delta Lake architecture
ETL development
SOX compliance
data engineering
data pipelines
data transformations
UAT processes
test case development
test script development
testing strategies
automated testing
mentorship
collaboration
large-scale data systems.

Job Details

Position Overview: We are seeking a highly skilled and experienced Senior QA Engineer to lead and enhance our QA practice for modern data platforms. This individual will play a critical role in improving QA execution, coverage, and reliability, ensuring high-quality delivery for our data engineering initiatives. The ideal candidate has a strong background in data engineering, testing at scale, and a deep understanding of modern data platform architectures.

Key Responsibilities:

  1. Testing Strategy Development:

    • Establish and implement best practices for testing data applications at scale.

    • Design and maintain reusable and scalable testing frameworks and processes.

  2. Technical Testing Expertise:

    • Develop and execute comprehensive test plans, test cases, and test scripts based on business and functional requirements.

    • Leverage tools such as Great Expectations, pytest, or similar Python-based testing harnesses to ensure data accuracy and quality.

    • Validate data pipelines, transformations, and storage in Data Lake and Delta Lake architectures.

  3. Collaboration and Mentorship:

    • Effectively communicate testing strategies and processes to junior QA analysts.

    • Provide guidance and mentorship to elevate team capabilities.

  4. User Acceptance Testing (UAT):

    • Lead UAT processes, including preparing artifacts, coordinating meetings, and delivering status updates.

  5. Technical Proficiency:

    • Write and optimize SQL queries for data validation and testing purposes.

    • Develop automated test scripts using Python to ensure data quality and integrity.

Required Qualifications:

  • Experience: 6 10 years in a Data Engineer/Developer role on modern data platforms.

  • Proven ability to establish testing best practices for data applications.

  • Strong technical skills in SQL and Python.

  • Hands-on experience with QA tools like Great Expectations or similar.

  • Familiarity with Data Lake/Delta architecture and large-scale data systems.

  • Ability to translate complex business and functional requirements into test cases.

  • Experience running UAT, including creating artifacts, status reports, and managing meetings.

Preferred Qualifications:

  • Background as an ETL Developer or similar.

  • Experience with SOX compliance or similar regulatory frameworks.

What We re Not Looking For:

  • Candidates with a non-developer background.

  • Professionals lacking data engineering or data warehousing expertise.

  • QA resources focused solely on UI testing.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.