Azure Data Engineer

Job ID: MNSITE-3832 & MNSITE-3833

Department: DCYF

Duration: 10 Months

Work Location: Remote / Hybrid

Description of Project

The Minnesota Department of Information Technology Services ("MNIT") partnering with the Department of Children, Youth, and Families ("DCYF") (collectively "State") is seeking one full-time Database Engineer. The State has an initiative to modernize the child welfare information system environment through the implementation of a Comprehensive Child Welfare Information System ("CCWIS").  For additional background, the State plans to hire a DDI vendor to implement a solution. In preparation for the DDI solution, the State is planning to consolidate the data from the 87 county databases into a centralized data lake that the new solution will utilize. 

As an Azure Database Engineer, this position will participate in the analysis, design, development, implementation, and potentially ongoing support of Azure Databases and Data Lakes, with a primary focus on the Data Lakehouse and its integrated data reserves. The responsibilities will include administering, maintaining, and securing data to ensure efficient and reliable data storage solutions. The position will collaborate with cross-functional teams to optimize data workflows, support data-driven decision-making, and implement best practices for data security and integrity in Azure environments.  This position also will provide mentorship to other Database Engineers.

Job Duties

·         Develop and implement relational and non-relational databases in Azure.

·         Develop and implement data transformations.

·         Ensure data access patterns are optimized.

·         Maintain necessary documentation.

·         Coordinate with necessary teams to meet security standards.

·         Implement disaster recovery solution.

·         Provide knowledge transfer.

Desired Qualifications

·         Experience with designing, developing, and implementing data lakes and relational and non-relational databases in Azure.

·         Experience with Databricks.

·         Experience with Oracle databases.

·         Strong experience developing and implementing data transformation solutions and cloud infrastructure integration.

·         Strong experience coding and testing programs and scripts to load data using Azure data load utilities.

·         Strong experience with CI/CD pipelines.

·         Experience with cloud computing concepts.

·         Experience with tools such as Azure Monitor, Azure Data Factory, SQL Analytics, Query Performance Insight, Azure Resource Manager, and Azure CLI/PowerShell for infrastructure management.

·         Experience in mentoring others in the needed technologies.

·         Experience developing and implementing backup and recovery strategies using tools such as Azure Backup or Geo-replication.

·         Experience with role-based access control, encryption, and network security.

·         Strong organizational and time management skills.

·         Desired 7 years’ experience designing, developing, and implementing data lakes and relational and non-relational databases in Azure.

·         Knowledge of data concepts, data modeling, schema design, and indexing strategies.

·         Knowledge of Azure SQL instances, managed instances, and elastic pools.

·         Knowledge of Data Warehouse Administration and Teradata Data Warehouse.