Lead Snowflake Developer

Job description:

• We are seeking a highly experienced Senior / Lead Snowflake Data Engineer with strong expertise in cloud data warehousing, Snowflake architecture, Azure and AWS integrations, and modern data transformation frameworks (DBT). The ideal candidate will have a proven track record in cloud migration, scalable data pipeline design, Snowflake administration, security, replication, and CI/CD enablement, along with leadership experience managing cross functional teams in agile environments.

Mandatory Skills:

• Snowflake: Advanced expertise in architecture, Snowpipe, Data Sharing, Secure Views, Cloning, Time Travel, Streams, Tasks, Cortex
• Cloud Platforms: Azure & AWS (S3, IAM, EC2, RDS, SQS, SNS, Lambda, Azure Blob, Azure Cosmos DB)
• Data Transformation: DBT, Matillion
• Databases: Teradata, Oracle
• Languages: SQL (advanced), SnowSQL, PL/SQL, Python (basic to intermediate), Unix/Linux shell scripting
• CI/CD & Version Control: Git, Azure DevOps, TFS, ClearCase, SVN, CVS

Tools & Platforms

• Scheduling: Control M, Airflow, Tivoli Work Schedule (TWS)
• Agile/Tracking: Jira, ServiceNow
• Operating Systems: Linux, Windows

• SnowPro Certified Snowflake

Key Responsibilities

Snowflake & Cloud Data Warehouse Engineering

• Design, develop, and maintain enterprise scale Snowflake data warehouse solutions supporting analytical, reporting, and data science use cases.
• Implement Snowflake features including Snowpipe, Streams, Tasks, Virtual Warehouses, Data Sharing, Secure Views, Cloning, and Time Travel.
• Build and maintain real time and batch ingestion pipelines using Snowpipe, COPY commands, and cloud storage stages.
• Create and manage Snowflake databases, schemas, tables, and consumption layer views following best practices.

Cloud Integration & Migration

• Lead and execute cloud migration initiatives from legacy platforms (Teradata, Oracle, SAP, RDBMS) to Snowflake on Azure and AWS.
• Integrate Snowflake with Azure services (Azure Blob Storage, Azure Containers, Azure Cosmos DB, Azure Events, Azure DevOps).
• Integrate Snowflake with AWS services including S3, IAM, EC2, RDS, SQS, SNS, and Lambda.
• Configure and manage cloud storage stages, secure access (IAM/RBAC), and automated ingestion workflows.

Data Transformation & Modeling

• Design and implement scalable DBT models, macros, and tests to transform data from staging through ODS to curated data marts.
• Implement incremental models and best practices for performance and cost optimization.
• Support data science and AI/ML use cases, including Snowflake Cortex enablement, Feature Store access, and analytics ready datasets.

Snowflake Administration, Security & Governance

• Design and manage RBAC frameworks, functional roles, custom and firefighter roles, and least privilege access models.
• Implement Security Integrations, Network Policies, Network Rules, SSO (Azure AD), and platform level governance controls.
• Create and manage inbound and outbound data shares, marketplace listings, and secure client specific datasets.
• Maintain comprehensive security and audit documentation to support compliance and governance standards.

• Replication, DR & High Availability

• Implement Snowflake replication for databases and account level objects.
• Design and manage Failover Groups to support disaster recovery and regional migrations.
• Lead greenfield migrations and regional cutovers, coordinating with Snowflake Support and application teams.

Performance Optimization & Cost Management

• Monitor warehouse performance, long running queries, and credit consumption using resource monitors.
• Perform query tuning, optimization, and cost control analysis.
• Provide recommendations to application teams for efficient warehouse sizing and workload management.
• CI/CD, DevOps & Operations
• Support and enhance CI/CD pipelines using Azure DevOps/Git for Snowflake and DBT deployments.

• Handle production support, incident management, problem/change management, and release coordination.
• Work with scheduling tools such as Control M, Airflow, and TWS for batch execution and monitoring.

Leadership & Collaboration

• Act as Tech Lead / Lead Engineer, mentoring team members and ensuring adherence to development standards.
• Collaborate with business analysts, data scientists, platform teams, and stakeholders to deliver high impact solutions.
• Participate actively in agile ceremonies, backlog grooming, sprint planning, and status reporting.