Data Infrastructure Engineer

Role overview:

We are looking for hands-on Data Infrastructure Engineers to support file movement, ETL operations, and Snowflake data-loading processes. The engineers will be responsible for building, maintaining, monitoring, and troubleshooting the infrastructure and operational workflows required for reliable data ingestion.

Mandatory skills:

• Strong data infrastructure and production-support experience.
• Hands-on experience with file-transfer technologies such as SFTP, MFT or similar platforms.
• Experience supporting ETL/ELT pipelines and batch-processing environments.
• Working knowledge of Snowflake data-loading patterns and related operational processes.
• Experience with Linux/Unix, shell scripting or Python.
• Understanding of cloud storage, networking, authentication, encryption, certificates, and access management.
• Hands-on observability experience covering logs, metrics, dashboards, monitoring and alerting.
• Ability to work during EST hours and participate in production incident calls.

Preferred skills:

• SQL and database troubleshooting skills.
• Experience with Snowpipe, stages, COPY commands, task scheduling, and Snowflake monitoring.
• Experience with tools such as Informatica, Talend, Matillion, Airflow, Control-M or equivalent.
• Knowledge of AWS, Azure or Google Cloud.
• Experience with Splunk, Datadog, Dynatrace, Grafana, New Relic, CloudWatch or similar tools.
• Familiarity with ITIL incident, change and problem-management practices.

• Build and support secure file-transfer and data-movement processes across source systems, integration platforms, cloud storage, and Snowflake.
• Support batch and scheduled ETL/ELT workflows used for Snowflake data ingestion.
• Configure and manage SFTP, managed file transfer, file shares, storage locations, encryption, certificates, connectivity, and access controls.
• Monitor file arrivals, transfer completion, job execution, data-load status, failures, latency, and SLA adherence.
• Troubleshoot failed file transfers, connectivity problems, permissions, scheduling issues, ETL failures, and Snowflake load errors.
• Implement restart, reprocessing, reconciliation, exception-handling, and recovery procedures.
• Develop scripts and automation for file validation, movement, archival, retry, and operational support.
• Build dashboards, logs, monitoring rules, and alerts for the complete data-movement and loading pipeline.
• Work with data engineering, Snowflake, security, network, infrastructure, and application teams.
• Create technical documentation, operational procedures, troubleshooting guides, and support runbooks.
• Participate in production support, incident resolution, root-cause analysis, and preventive actions.