Role / Skills - Data Business Analyst
Location Toronto, Canada
Location Options On-site Day 1
7+ years in Data Quality and Testing
Key Responsibilities:
Develop and implement test strategies, test cases, and automation scripts to validate data pipelines in Azure and Databricks environments.
Perform data validation, reconciliation, and comparative analysis between source and target systems.
Validate ETL/ELT pipelines built using ADF and Databricks.
Collaborate with Data Engineers and Product Owners to understand STM (Source-to-Target Mapping) and ensure transformation logic is correctly implemented.
Monitor and validate data quality across Delta tables, and Data Warehouses.
Identify data anomalies, document defects, and drive them to resolution with the engineering team.
Support CI/CD pipelines by integrating data testing into DevOps workflows.
Contribute to test data management, metadata validation, and regression testing.
Provide regular reporting on test execution results, defect metrics, and QA health.
Required Skills:
Proven experience in data QA/validation in cloud-based data platforms.
Strong knowledge of Azure Data Factory, Databricks.
Proficiency in SQL and scripting languages such as Python.
Hands-on experience with data profiling, data reconciliation, and schema validation.
Understanding of SCD Type 2 and data transformation logic.
Familiarity with DevOps tools like Azure DevOps or GitHub Actions for CI/CD integration.
Experience working with large datasets, performance testing, and data lineage tools.
Never miss an opportunity! Create an alert based on the job you applied for.
