Title: Azure Data Engineer
Location: NYC, NY (4 days Onsite/week)
Position Type: 6 Months Contract
About the Project
ICMS (Integrated Capital Management System) is an enterprise platform providing capital planning, data, and reporting solutions to multiple departments within the Agency. The system leverages Cognos TM1, IBM Cognos BI, and Microsoft SQL Server technologies in Azure. This engagement focuses on the strategic migration of existing on-premises SQL Server ETL workloads to the Azure cloud platform and any new Datawarehouse development work as needed.
Key Responsibilities:
Analyze and document existing SQL Server ETL jobs and SSIS packages for cloud migration readiness
Design and develop scalable data pipelines using Azure Data Factory and Azure Databricks
Migrate on-premises SQL Server ETL processes to Azure cloud, ensuring data integrity and performance parity
Modernize SQL Server databases to the latest version as part of the migration effort
Implement CI/CD workflows for data pipelines using Azure DevOps
Develop and maintain Azure Logic Apps for workflow automation and integration
Collaborate with data consumers across departments to support Cognos TM1 and Cognos BI reporting requirements
Conduct unit testing, performance tuning, and optimization of migrated workloads
Produce technical documentation including architecture diagrams, migration runbooks, and operational guides
Work closely with enterprise architecture and projects lead teams to aligning deliverables with ICMS roadmap
Required Qualifications:
8+ years of hands-on experience in data engineering, ETL development, and SQL Server administration
Strong proficiency in SSIS (SQL Server Integration Services) and T-SQL development
Strong experience with Azure Data Factory for pipeline orchestration and data movement
Familiarity with Azure Databricks for large-scale data transformation
Experience with Azure DevOps for version control, pipeline management, and automated deployments
Working knowledge of Azure Logic Apps for business process automation and system integration
Solid understanding of Microsoft SQL Server (latest versions) – schema design, query optimization, and maintenance
Familiarity with enterprise reporting platforms such as Cognos TM1 and IBM Cognos BI is a strong asset
Preferred Qualifications:
Experience in supporting capital planning or financial management systems is preferred.
Microsoft Azure certification (Data Engineer Associate) is an advantage
Knowledge of Azure Synapse Analytics, Databricks or Azure SQL Managed Instance
Familiarity with data governance, lineage tracking, and metadata management practices
Excellent communication skills with the ability to explain technical concepts to non-technical stakeholders
Technology Stack:
Azure Data Factory · Azure Databricks · Azure DevOps · Azure Logic Apps · SQL Server (latest) · SSIS · T-SQL · Cognos TM1 · IBM Cognos BI · ETL / ELT · CI/CD Pipelines
Never miss an opportunity! Create an alert based on the job you applied for.
