Overview
Remote
Depends on Experience
Full Time
Accepts corp to corp applications
Skills
Azure ADF
Snowflake
Cloud
Job Details
We are seeking a skilled and experienced Senior Cloud Data Engineer to join our team for a Cloud Data Modernization project. The successful candidate will be responsible for migrating our on-premises Enterprise Data Warehouse (SQLServer) to a modern cloud-based data platform utilizing Azure Cloud data tools and Snowflake.
Key Responsibilities:
- Design, develop, and implement data platform solutions using Azure Data Factory (ADF), Self-hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, and Snowflake.
- Review and analyse existing on-premises ETL processes developed in SSIS and T-SQL.
- Perform data validation testing/QA to ensure data consistency between on-premises SQLServer and cloud-based Azure and Snowflake environments.
- Implement DevOps practices and CI/CD pipelines using GitActions.
- Collaborate with cross-functional teams to ensure seamless integration and data flow.
- Optimize and troubleshoot data pipelines and workflows.
- Ensure data security and compliance with industry standards.
Preferred Qualifications:
- Experience with data modelling and database design.
- Knowledge of data governance and data quality best practices.
- Experience with development in Databricks for data engineering and analytics workloads.
- Familiarity with other cloud platforms (e.g., AWS, Google Cloud).
- Certification in Azure or Snowflake.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.