Sr Snowflake Data Engineer

Overview

Remote
Depends on Experience
Contract - W2

Skills

Snowflake
Fivetran
Lambda
Airflow
Glue
S3
SNS
AWS
DBT

Job Details

Sr Snowflake Data Engineer / Remote / Contract-to-Hire

About DataEdge:

For over two decades, DataEdge Consulting has been helping customers steer clear of the complexities of technology, allowing them to fully concentrate on their core competencies and excel at what they do best.

At DataEdge our vision is to Deliver the Value of Technology to Business and nothing less! Our focus is always on the customer, and every process, model and tenet is engineered to serve this customer-centric philosophy. If you have experience in related tools & technologies described below, please forward your profile.

About our Customer:

Our DIRECT customer, a global leader in Food services industry is seeking an experienced Sr Data Engineer to work remotely.

This is a very long term Contract position.

About Sr. Data Engineer:

Senior Data Engineer is a hand-on role with expertise in developing data ingestion pipelines. This role is crucial in designing, building, and maintaining our data infrastructure, focusing on creating scalable pipelines, ensuring data integrity, and optimizing performance. Key skills include strong Snowflake expertise, advanced SQL proficiency, data extraction from APIs using Python and AWS Lambda, and experience with ETL/ELT processes. Workflow automation using AWS Airflow is essential, and experience with Fivetran and DBT is a plus.
Responsibilities:

  • Design, build, test, and implement scalable data pipelines using Python and SQL.
  • Maintain and optimize our Snowflake data warehouse s performance, including data ingestion and query optimization.
  • Extract data from APIs using Python and AWS Lambda and automate workflows with AWS Airflow.
  • Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality.
  • Collaborate with other data engineers and architect to develop new pipelines and/or optimize existing ones.
  • Maintain code via CI/CD processes as defined in our Azure DevOps platform.

Qualifications:

  • 7+ years of experience in Data Engineering roles, with a focus on building and implementing scalable data pipelines for data ingestion.
  • Expertise in Snowflake, including data ingestion and performance optimization.
  • Strong SQL skills for writing efficient queries and optimizing existing ones.
  • Proficiency in Python for data extraction from APIs using AWS Lambda, Glue, etc.
  • Experience with AWS services such as Lambda, Airflow, Glue, S3, SNS, etc.
  • Highly self-motivated and detail-oriented with strong communication skills.
  • Familiarity with ETL/ELT processes.
  • Familiarity with cloud development / deployment (AWS preferred)
  • Experience with Fivetran and DBT is a plus.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.