Overview
Skills
Job Details
Project is Remote now but may become onsite/hybrid once all staff return to work in office at Durham NC.
NCFAST 758028: The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. The primary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
- Synapse
- Design, Develop and maintain data models in Synapse to support reporting and analytics
- Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
- Analyze the source system and design the ETL data load.
- Ability to create and configure Azure Synapse Analytics workspace.
- Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like SalesForce.
- Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
- Power BI Tools
- Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.
- Required / Desired Skills
Skill | Required / Desired | Amount | of Experience |
Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows | Required | 5 | Years |
Programming Languages: Strong proficiency in Python or Scala for data processing. | Required | 3 | Years |
SQL Mastery: Advanced query writing, performance tuning, and optimization. | Required | 7 | Years |
Experience with Data Modeling and Warehousing (star schema, snowflake schema) | Required | 4 | Years |
Experience with ETL/ELT processes | Required | 5 | Years |
Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) | Highly desired | 4 | Years |
Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions | Desired | 4 | Years |
Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) | Desired | 1 | Years |
Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage | Desired | 5 | Years |
Experience with Power BI | Nice to have | 1 | Years |