Position Title: Lead Data Engineer (Snowflake)
6 Months with possibility of extension
Role Summary
The Senior Snowflake Optimization Engineer will lead the assessment, Rearchitecture, and optimization of PGE’s Snowflake data platform.
This role will act as the technical lead and primary onsite interface for Snowflake optimization initiatives, working closely with PGE stakeholders, data engineering teams, and Matillion pipelines.
Experience Level
- 8–12+ years in data engineering / cloud data platforms
- 3–5+ years of focused Snowflake optimization experience
- Prior experience in onsite consulting or lead roles preferred
Key Responsibilities
Snowflake Cost & Performance Optimization
- Assess current Snowflake warehouse usage, sizing, autoscaling, and autosuspend configurations.
- Identify cost drivers across Matillion jobs, adhoc analytics, and background workloads.
- Optimize warehouse strategies (multicluster usage, workload isolation, resource monitors).
- Analyze query history and execution plans to reduce compute inefficiencies.
Architecture & Reengineering
- Review existing Snowflake schemas, tables, tasks, and pipelines for architectural improvements.
- Recommend and implement Snowflakenative optimizations (dynamic tables, tasks, result caching where appropriate).
- Evaluate opportunities for hybrid compute (external tables, Iceberg, Spark/EMR) where costeffective.
- Advise on data lifecycle, retention, and archival strategies to reduce storage footprint.
Matillion & Pipeline Optimization
- Review Matillion ELT jobs for Snowflake best practices (pushdown transforms, avoiding rowbyrow logic).
- Improve pipeline execution efficiency and runtime SLAs.
- Define reusable optimization patterns and templates.
Governance & Cost Control
- Help establish cost governance, monitoring, and guardrails.
- Support chargeback / showback models if required by PGE.
- Provide recommendations to ensure savings are sustainable postengagement.
Stakeholder & Delivery Leadership
- Act as the onsite technical lead, coordinating with PGE architects, developers, and business users.
- Lead technical workshops, optimization reviews, and recommendations walkthroughs.
- Provide documentation, implementation guidelines, and knowledge transfer to PGE teams.
- Support stabilization and postimplementation tuning.
Required Skills & Experience
Technical Skills
- Strong handson experience with Snowflake architecture, performance tuning, and cost optimization
- Deep understanding of:
- Snowflake warehouses, clustering, caching, tasks, dynamic tables
- Query profiling and execution plans
- Experience with Matillion ELT on Snowflake
- Solid knowledge of AWS (S3, security, cost considerations)
- SQL performance tuning and data modeling experience
Good to Have
- Experience with Iceberg / external tables / Spark or EMR
- Exposure to Snowflake Cortex or advanced Snowflake features
- CI/CD for data platforms (GitHub/GitLab/Jenkins)
- Data governance and cost management frameworks.
Never miss an opportunity! Create an alert based on the job you applied for.
