Description
Design, build, and maintain Azure-based data pipelines using Synapse Analytics to support MSIS and related education systems.
Develop and optimize ETL/ELT processes to ingest, transform, and validate K-12 education data from multiple source systems.
Implement and manage data models, views, and performance tuning in Azure SQL and Synapse environments.
Monitor, troubleshoot, and resolve data pipeline and performance issues.
Document data flows, transformations, and technical standards.
Collaborate with analysts, reporting teams, and vendors to deliver timely, accurate data for federal and state reporting.
Required Skills
A minimum of 5 years of experience in the following:
Advanced development and orchestration of data pipelines using Azure Data Factory/Synapse or similar cloud based platforms. (pipelines, triggers, integration runtimes, parameterization).
Data warehousing and analytics engineering using Azure Synapse Analytics or similar cloud based platforms (dedicated and serverless SQL pools).
Strong T-SQL skills, including query optimization, indexing strategies, stored procedures, and performance tuning.
Implementation of ETL/ELT frameworks, including incremental loads, CDC patterns, and error handling.
Integration of structured and semi-structured data (CSV, JSON, XML) from APIs, SFTP, and vendor systems.
Source control and deployment practices using Azure DevOps, Git, and CI/CD pipelines.
Preferred Skills:
Experience with student information management systems and K-12 data and reporting
Experience with Common Education Data Standards (CEDS)
Azure Data Engineer Associate certification