Overview
Skills
Job Details
The Child and Family Services Agency are seeking a Senior Data Engineering for managing and optimizing data services across Azure/Dynamics 365 and legacy Oracle Database environments. This role oversees Microsoft Dataverse, Azure Data Factory, Synapse Analytics, Power BI workspaces, and Oracle databases to ensure secure, compliant, and high-performance data operations. This position requires deep expertise in advanced SQL, database management, and database replication, including Health and human services data model experience. The candidate is responsible for design, build, and maintenance of scalable data pipelines, enforces privacy standards, and supports analytics teams with reliable, integrated data sets. The position involves cross-functional collaboration, architectural knowledge, and supporting program staff through data requests.
Responsibilities:
Provide Dataverse data management support to include schema integrity, TDS Endpoint configuration, Data extraction, query development, and data backup/restore operations
Design, monitor, and troubleshoot scalable data pipelines in Azure Data Factory, with focus on secure ingestion, transformation, and orchestration, including monitoring and troubleshooting pipeline health and performance
Manage Synapse workspaces (including Dataverse Link) and dedicated SQL pools/Managed SQL /Serverless SQLs, implementing advanced query optimization to support high-volume analytics and reporting workloads
Setup and maintain Power BI workspaces, datasets, and gateways, enforcing data security permissions including row-level security
Develop Power BI Dashboards leveraging database datasets, including log files, to determine system usage
Develop and refine complex SQL queries to support operational and performance reporting, including audit system log analysis
Build and maintain reusable Python scripts for parsing datasets, data cleansing, enrichment, and automation, involving structured and un-structured data
Develop and maintain data security for datasets across Azure data services platform
Provide data model and schema/table relationship diagram to support integrations and data exchange
Develop and maintain data replication tools to sync Dynamics data to Synapse Analytics, including managed SQL/Dedicated SQL pool, Serverless pool destination, and API-enabled data endpoints
Manage Legacy Oracle database, including data integrity, backup, and availability management
Collaborate with business stakeholders to understand data requirements, mapping, and transformation needs, ensuring alignment with the child welfare information system's objectives.
Lead and coordinate Data Analysts and Reports Engineering Team activities, working closely with the system to ensure timely and accurate execution of data-dependent tasks, including Daily, Monthly, Weekly, Fiscal Year and Compliance reporting
Perform data profiling and analysis to identify data quality issues, data gaps, and potential risks for mitigation
Define and enforce data migration standards, best practices, and governance policies to maintain data integrity and consistency.
Create and maintain technical artifacts for data services implementation, including replication plans, data, data architecture, rules, and error reports.
Conduct training sessions and provide guidance to business staff and Functional Quality Assurance staff on data services and provide data extraction support
Stay current with industry trends and advancements in data management methodologies and tools, recommending improvements to enhance the overall data governance.
Work Arrangement: Hybrid - Contractor is expected to report onsite 4 days a week.