Data Engineer (Snowflake + Talend)

JOB DESCRIPTION | Data Movement Engineer (Snowflake + Talend)

Job Title: Data Movement Engineer (Snowflake + Talend)

Location: Remote (New Haven, CT, US, 06511)

Type: C2H

Core Responsibilities

·        Manage the full lifecycle of Snowflake data operations, including monitoring, troubleshooting, and optimizing data pipelines.

·        Proactively identify and resolve issues related to data integrity, latency, and pipeline failures to maintain smooth operations.

·        Translate stakeholder requirements into Snowflake-specific solutions for data movement.

·        Develop and optimize SQL queries, warehouse configurations, and data models for performance, reliability, and scalability.

·        Design, develop, and optimize Snowflake data pipelines and models.

·        Recommend and implement best practices for data ingestion, transformation, storage, security and data modeling.

·        Support advanced features like Change Data Capture (CDC) and Slowly Changing Dimensions (SCD Type 2).

·        Support frameworks like Data Vault and dimensional modeling in Snowflake.

·        Monitor and troubleshoot data pipeline failures and performance issues in ETL and Snowflake environments.

·        Thoroughly test all production solutions prior to implementation.

·        Perform root cause analysis of data discrepancies, latency, and integrity issues.

·        Provide production support for IBM DB2, Snowflake, and orchestration tools (Airflow, ESP).

·        Collaborate with other teams to implement fixes and preventive measures.

·        Perform data quality analysis, report issues, and propose solutions.

·        Ensure data accuracy, completeness, and consistency across systems.

·        Implement validation and reconciliation checks within pipelines.

·        Support data governance initiatives including metadata management and lineage tracking.

·        Lead the design, development, and maintenance of Snowflake processes.

·        Provide technical leadership, code reviews, and mentorship to junior developers.

·        Coordinate with business stakeholders, data architects, and application teams to gather requirements and deliver solutions.

·        Communicate issue status, impact, and resolution timelines effectively.

·        Maintain comprehensive documentation for all Snowflake-related issues, fixes, and scripts, ensuring they are version-controlled and aligned with data architecture and security standards.

·        Develop and maintain production support playbooks and detailed ticket resolution procedures to enable consistent and efficient incident handling.

·        Prepare effort estimations and contribute to architectural decisions.

·        Provide regular updates and reports on issue trends and improvement initiatives.

·        On-call and/or after-hours work required.

Skills Qualifications

·        Minimum of 5 years of relevant experience in data warehousing, business intelligence tools, and data analysis.

·        Minimum of 3 years of SQL query development across multiple database platforms (Snowflake, Oracle, SQL Server, DB2).

·        Strong expertise in Snowflake (development, data modeling, security). Snowflake certification preferred.

·        Strong proficiency in SQL and scripting languages (e.g., Python, Shell).

·        Experience with cloud database technologies.

·        Familiarity with orchestration tools (ESP, Airflow) and version control systems (Git).

·        Experience with incident management tools (e.g., ServiceNow, Jira) and CI/CD practices.

·        Expertise in CDC and SCD Type 2 implementations using SQL.

·        Solid understanding of data architecture, dimensional modeling, and frameworks like Data Vault.

·        Ability to solve problems using analytical thinking skills.

·        Must work well independently and be inquisitive.

·        Strong organizational and time management skills.

Education

·        Bachelors degree in computer science, Information Systems, or related field.

·        5+ years of experience in Snowflake development and data warehousing.