Senior ETL Software Developer

Overview

On Site
$CAD $80 / hr
Contract - W2
Contract - 9 month(s)

Skills

ETL Software Developer

Job Details

Job Description:

Responsibilities:

  • We are seeking a highly skilled Software Developer with ETL implementation experience to join our data engineering team.
  • This role is critical in ensuring the accuracy, reliability, and performance of our data pipelines and analytics infrastructure built on the Microsoft Azure platform and Databricks.
  • Under the supervision of the IT QA Lead, you will collaboXX closely with data engineers and DevOps teams to design and implement robust data quality frameworks, automated testing pipelines, and CI/CD processes.
  • XXgn and implement comprehensive test plans for data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
  • Conduct data quality assessments, validation, and profiling using tools like Great Expectations.
  • Develop and maintain automated testing frameworks integXXd into CI/CD pipelines.
  • CollaboXX with data engineers to ensure adherence to Medallion Architecture best practices.
  • Monitor and assess pipeline performance, scalability, and data integrity.
  • Implement and manage DevOps practices using Azure DevOps, Git, and related tools.
  • Document test cases, validation rules, and QA processes clearly and consistently.
  • Perform functional testing on Power BI Reports and dashboards.
  • Participate in Agile ceremonies and contribute to sprint planning and retrospectives.
Experience and Skill Set Requirements:
Public Sector Experience - 5 points:
  • 5+ years of experience working in the federal/provincial/broader public-sector as a software developer / data specialist / quality assurance tester.
  • 5+ years of experience in data engineering.
  • Must have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
  • Microsoft Azure Data Services (ADF, ADLS Gen 2, Synapse, Azure SQL).
  • Azure Databricks.
  • PySpark and SQL.
  • Power BI (data preparation, modelling, and visualization).
  • Must have demonstrated experience in developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.
  • Demonstrated experience in collaborating with data engineers to ensure adherence to Medallion Architecture best practices (Staging, Bronze, Silver, Gold layers).
Certifications:
  • Microsoft Certified: Azure Data Engineer Associate.
  • Databricks Certified Data Engineer Associate/Professional.
  • Microsoft Certified: Fabric Analytics Engineer Associate.
  • Microsoft Certified: Power BI Data Analyst Associate.
  • Microsoft Certified: DevOps Engineer.
Quality Assurance Skill and Experience - 20 points:
  • 5+ years of experience in quality assurance and automated testing.
  • Must have experience conducting software quality functional assessments, systems testing, performance evaluation, automated testing.
  • JIRA or Azure DevOps for defect tracking.
  • Selenium for automated testing of web-based apps, including Power BI reports and dashboards.
  • JMeter for performance evaluation.
  • Conducting data quality assessments, validation, and profiling using tools like Great Expectations.
  • Developing and maintaining automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.
  • Certified Software Tester (CSTE).
  • Certified Tester Test Automation Engineer.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.