Data Engineer - Snowflake and Python (12 + years of Experience need with LinkedIn Account)

  • Posted 22 days ago | Updated 8 days ago

Overview

Remote
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 6 Month(s)

Skills

Amazon Web Services
Data Engineering
Data Modeling
Extract
Transform
Load
Performance Tuning
Python
Snow Flake Schema
SQL
Data Quality
Snowflake
AWS
API

Job Details

Senior Data Engineer

Work Environment: Nimble, fast-paced, and highly impactful culture where outcomes are immediately visible. Emphasis on individual initiative and ownership of projects in a relatively unstructured setup.

 

Interview Process:

A CoderPad session to assess your skills in Python (API development and core services) and SQL (query optimization and advanced problem-solving). The process aims to evaluate your technical expertise, ability to work independently, and problem-solving approach.

 

Job Description:

We are seeking a Senior Data Engineer to join our team and take ownership of critical data projects from inception to completion. In this role, you will be responsible for building, maintaining, and optimizing complex ETL pipelines, ensuring high-quality data delivery for actionable insights, and enabling real-time performance analytics.

This is a hands-on technical role that demands strong ownership, excellent problem-solving skills, and collaborative cross-functional engagement. You will play a pivotal part in transitioning the organization’s data systems and integrations from traditional data warehouse models to a modern, real-time processing framework.

Key Responsibilities:

  • Design and implement end-to-end ETL pipelines for seamless data ingestion, transformation, and delivery.
  • Work extensively with AWS and Snowflake, leveraging their capabilities for maximum scalability and performance.
  • Optimize data performance through advanced SQL query tuning, ensuring high efficiency for large-scale data operations.
  • Own the integration of third-party data, including APIs (REST APIs), and drive improvements in data quality and toolset customization.
  • Enhance real-time data processing capabilities, reducing processing latency to under 30 seconds for key marketing and reporting results.
  • Support web interaction data uploads and analyze marketing funnel performance using real-time and overnight processing pipelines.
  • Collaborate with cross-functional teams, including DevOps, Data Scientists, and Marketing stakeholders, to drive high-impact solutions.
  • Build and maintain real-time APIs as core services to enable on-the-fly analysis and reporting.
  • Provide technical leadership, mentoring junior developers, and sharing best practices for maintaining clean, scalable codebases.
  • Act as a key contributor in improving current quality tooling processes and customizing open-source solutions to fit organizational needs.

Qualifications & Skills:

 

Must-Have:

  • 10+ years of experience in building and optimizing scalable ETL pipelines and end-to-end data engineering solutions.
  • Expertise in AWS services, particularly in data-oriented tools and frameworks (e.g., eks, S3, etc.).
  • Deep proficiency in Snowflake, including advanced modeling and optimization techniques.
  • Advanced SQL skills, with experience in navigating and improving large SQL codebases and optimizing performance.
  • Professional Python experience, particularly in the design, implementation, and maintenance of APIs and backend services. (Have you build API services, real time API)
  • Experience with data quality processes and tooling, with a strong commitment to improving accuracy, reliability, and consistency.
  • Solid grasp of REST APIs and integrating with third-party systems.

Preferred:

  • Experience working with open-source technologies, customizing tools, and tailoring them to organizational needs.
  • Familiarity with machine learning pipelines and integration into ETL workflows.
  • Knowledge of real-time data frameworks and tools for streamlining events and processing data on an ultra-low-latency scale.
  • Effective written and verbal communication skills, with the ability to coordinate between various technical and non-technical teams.
  • Proven ability to work independently in an unstructured environment while driving collaboration and teamwork.

Environment Highlights:

  • This is not a "plug-and-play" environment — you’ll need to roll up your sleeves and dig into custom-built pipelines and open-source development.
  • High ownership role with the freedom to shape projects and make impactful contributions in close collaboration with business stakeholders, DevOps teams, and marketing departments.
  • Immediate visibility of your impact across data systems that directly enhance decision-making and performance evaluations for marketing processes.
  • A culture that promotes innovation, continuous improvement, and proactive problem-solving.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.