Overview
Skills
Job Details
Sr. Data Engineer Location: Remote ( CST or EST ) w / quarterly travel for PI planning
Duration: 6 - month contract-to-hire
Visa : / USC
We are looking for a hands - on Senior Data Engineer with expertise in developing data ingestion pipelines. This role should be crucial in designing, building, & maintaining our data infrastructure, focusing on creating scalable pipelines, ensuring data integrity, & optimizing performance.
Key skills must include strong Snowflake expertise, advanced SQL proficiency, data extraction from APIs using Python & AWS Lambda, & experience with ETL / ELT processes. Workflow automation using AWS Airflow is essential, & experience with Fivetran & DBT is a plus.
RESPONSIBILITIES
Design, build, test, & implement scalable data pipelines using Python & SQL.
Maintain & optimize our Snowflake data warehouse s performance, including data ingestion & query optimization.
Extract the data from APIs using Python & AWS Lambda & automate workflows with AWS Airflow.
Perform analysis & critical thinking to troubleshoot data-related issues & implement checks/scripts to enhance data quality.
Need Collaborate with other data engineers & architects to develop new pipelines and/or optimize existing ones.
Maintain code via CI / CD processes as defined in our Azure DevOps platform.
QUALIFICATIONS
8 + years of experience in Data Engineering roles, with a focus on building & implementing scalable data pipelines for data ingestion.
Expert in Snowflake, including data ingestion & performance optimization.
Must be Strong SQL skills for writing efficient queries & optimizing existing ones.
Expert in Python for data extraction from APIs using AWS Lambda, Glue, etc.
Expert with AWS services such as Lambda, Airflow, Glue, S3, SNS, etc.
Highly self - motivated & detail - oriented with strong communication skills.
Familiarity with ETL / ELT processes.
Experience in Fivetran & DBT is a plus.