Automation Engineer(SQL, Python with Google Cloud Platform and BigQuery)
Location: Malvern, PA(Remote)
Mandatory Skill: Automation QA with Python, Google Cloud Platform/Big query experience, Strong SQL
Job Duties & Responsibilities below:
Test Strategy & Planning: Create, maintain, and execute comprehensive test plans, test scenarios, and source-to-target test cases covering data extraction, business transformation logic, and load phases into warehouse and reporting layers.
ETL & Data Pipeline Validation: Validate complex data flows, CDC mechanisms, and historical/incremental syncs using advanced SQL queries; perform end-to-end reconciliation between source and target systems to ensure complete data integrity.
Automation Engineering: Design, build, and maintain scalable test automation scripts and frameworks using Python to automate repetitive data checks, regression suites, and backend API/database validations. Cross-Functional
Collaboration: Act as the quality liaison across SDLC stages, partnering with Data Engineers, Developers, Architects, and Product teams to review requirements, clarify data mapping logic, and ensure quality standards are met early.
AI & Modern Cloud Practices: Leverage foundational AI concepts and modern Google Cloud Platform cloud data tools (such as BigQuery, Spanner, and Airflow) to enhance test coverage, streamline test data generation, and detect data anomalies efficiently.
Defect Lifecycle & Triage: Identify, log, and triage data anomalies, pipeline failures, and schema discrepancies; conduct thorough root-cause analysis and track defects through closure.
Continuous Integration: Integrate automated validation scripts into continuous delivery/deployment workflows to enable shift-left testing and automated regression feedback.
Role Overview: Looking for a QA Engineer specializing in ETL Testing and Automation to design, execute, and automate robust test suites for our data pipelines, data warehouses, and reporting layers. In this role, you will ensure end-to-end data integrity, completeness, and transformation accuracy across complex data architectures, while leveraging modern automation frameworks and AI-assisted testing practices.
Mandatory Skills:
End-to-end testing: Perform ETL/data validation testing to ensure data accuracy across source and target systems.
Advanced SQL: Write complex SQL queries (joins, aggregations, window functions, and data reconciliation) for data verification and backend validation.
ETL / Data Warehouse testing concepts: Source-to-Target mapping, CDC, schema validation, data completeness, and boundary testing.
Python: Practical scripting and development for test automation and data validation.
Test Automation frameworks: Building or maintaining automated testing frameworks for backend data systems and APIs.
Defect lifecycle management and standard QA methodologies (STLC, test strategy, test planning, and execution).
Collaboration: Collaborate with developers, data engineers, and product teams to ensure quality throughout SDLC and integrate automation.
Desired Skills:
Foundational Google Cloud Platform (Google Cloud Platform) and AI concepts.
Experience with cloud data platforms, databases, and orchestrators (e.g., BigQuery, Cloud Spanner, Snowflake, Netezza, or Airflow).
Healthcare or domain-specific data compliance awareness.