We are seeking a highly experienced Senior / Lead Snowflake Data Engineer with strong expertise in cloud data warehousing, Snowflake architecture, Azure and AWS integrations, and modern data transformation frameworks (DBT).
The ideal candidate will have a proven track record in cloud migration, scalable data pipeline design, Snowflake administration, security, replication, and CI/CD enablement, along with leadership experience managing cross functional teams in agile environments.
Key Responsibilities
Snowflake & Cloud Data Warehouse Engineering
Design, develop, and maintain enterprise scale Snowflake data warehouse solutions supporting analytical, reporting, and data science use cases.
Implement Snowflake features including Snowpipe, Streams, Tasks, Virtual Warehouses, Data Sharing, Secure Views, Cloning, and Time Travel.
Build and maintain real time and batch ingestion pipelines using Snowpipe, COPY commands, and cloud storage stages.
Create and manage Snowflake databases, schemas, tables, and consumption layer views following best practices.
Cloud Integration & Migration
Lead and execute cloud migration initiatives from legacy platforms (Teradata, Oracle, SAP, RDBMS) to Snowflake on Azure and AWS.
Integrate Snowflake with Azure services (Azure Blob Storage, Azure Containers, Azure Cosmos DB, Azure Events, Azure DevOps).
Integrate Snowflake with AWS services including S3, IAM, EC2, RDS, SQS, SNS, and Lambda.
Configure and manage cloud storage stages, secure access (IAM/RBAC), and automated ingestion workflows.
Data Transformation & Modeling
Design and implement scalable DBT models, macros, and tests to transform data from staging through ODS to curated data marts.
Implement incremental models and best practices for performance and cost optimization.
Support data science and AI/ML use cases, including Snowflake Cortex enablement, Feature Store access, and analytics ready datasets.
Snowflake Administration, Security & Governance
Design and manage RBAC frameworks, functional roles, custom and firefighter roles, and least privilege access models.
Implement Security Integrations, Network Policies, Network Rules, SSO (Azure AD), and platform level governance controls.
Create and manage inbound and outbound data shares, marketplace listings, and secure client specific datasets.
Maintain comprehensive security and audit documentation to support compliance and governance standards.
Replication, DR & High Availability
Implement Snowflake replication for databases and account level objects.
Design and manage Failover Groups to support disaster recovery and regional migrations.
Lead greenfield migrations and regional cutovers, coordinating with Snowflake Support and application teams.
Performance Optimization & Cost Management
Monitor warehouse performance, long running queries, and credit consumption using resource monitors.
Perform query tuning, optimization, and cost control analysis.
Provide recommendations to application teams for efficient warehouse sizing and workload management.
CI/CD, DevOps & Operations
Support and enhance CI/CD pipelines using Azure DevOps/Git for Snowflake and DBT deployments.
Handle production support, incident management, problem/change management, and release coordination.
Work with scheduling tools such as Control M, Airflow, and TWS for batch execution and monitoring.
External Skills And Expertise
Technical Skills
Snowflake: Advanced expertise in architecture, Snowpipe, Data Sharing, Secure Views, Cloning, Time Travel, Streams, Tasks, Cortex
Cloud Platforms: Azure & AWS (S3, IAM, EC2, RDS, SQS, SNS, Lambda, Azure Blob, Azure Cosmos DB)
Data Transformation: DBT, Matillion