Overview
Skills
Job Details
Job Description:
***Crop to Crop resumes are accepted
The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. The primary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
Synapse
- Design, Develop and maintain data models in Synapse to support reporting and analytics
- Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
- Analyze the source system and design the ETL data load.
- Ability to create and configure Azure Synapse Analytics workspace.
- Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like SalesForce.
- Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
Power BI Tools
- Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.
Required Skills:
Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows |
Programming Languages: Strong proficiency in Python or Scala for data processing. |
SQL Mastery: Advanced query writing, performance tuning, and optimization. |
Experience with Data Modeling and Warehousing (star schema, snowflake schema) |
Experience with ETL/ELT processes |
Desired Skills:
Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) |
Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions |
Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) |
Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage |
Experience with Power BI |