Overview
Remote
Contract - W2
Contract - Independent
Skills
Data quality
Automated testing
Version control
Data modeling
Extract
transform
load
Data warehouse
Test cases
Regression testing
Apache Spark
PySpark
Databricks
Microsoft Azure
Analytics
SQL
Python
Continuous integration
Continuous delivery
Software deployment
Data
Scripting
Job Details
Job Description
Technical Skills:
- Azure Databricks, Synapse Analytics, SQL Hyperscale.
- Python, and PySpark for test automation for test frameworks in Azure environments
- Familiarity with version control systems and CI/CD pipelines for automated testing and deployment.
- Familiarity with data modeling, ETL processes, and data warehousing concepts.
- 6-10 years of experience in QA automation, with 5+ using Spark/PySpark.
Key Responsibilities
- Develop comprehensive test strategies with a clear understanding on Data Pipelines
- Build and maintain test frameworks for validating data quality, completeness, and accuracy across all stages of the data lifecycle.
- Develop automation test scripts using Python and PySpark to execute test cases against data pipelines and processes.
- Conduct regression testing to ensure the stability and reliability of data pipelines after code changes or updates.
Remote for now but hybrid after 12 months. Mandatory background checks and drug testing
Note: Looking for Candidates who can work on our W2 only. As per our client's requirements.