Sr. Data Engineer (Python, SQL, AWS)

Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines on AWS using services such as Lambda, S3 and ECS/Fargate
• Build, optimize, and manage datasets within Snowflake, including schema design, data modeling and performance tuning.
• Implement CI/CD pipelines using Jenkins, ensuring reliable deployment of data workflows, transformation code and infrastructure.
• Write and maintain automated testing scripts (unit tests, data validation tests, regression tests) to ensure data quality and pipeline resiliency.
• Partner with analytics, engineering, and product teams to translate business needs into high-quality technical data solutions.
• Monitor and improve pipeline performance, optimizing for scalability, cost efficiency and stability.
• Establish and maintain best practices for data governance, lineage, security and documentation.

Requirements:

• 5 years of solid programming skills in Python (preferred) or similar languages for ETL, automation and testing.
• 5 years of strong experience in AWS cloud services and hands-on experience building production data pipelines.
  
• Deep proficiency in Snowflake, including SQL, Snowpipe, Streams/Tasks and performance tuning.
  
• Experience with Jenkins and CI/CD workflows for deploying and managing data applications.
  
• Strong knowledge of data modeling, transformation frameworks, and managing both structured and semi-structured data.
  
• Experience writing and maintaining automated tests for data pipelines and transformations.
  
• Ability to work collaboratively with cross-functional teams and communicate effectively with both technical and non-technical partners.
• Experience with streaming technologies (Kafka, Kinesis) is preferred.
  
• Understanding of ML pipeline support or feature store design is preferred.

Education:

• Bachelor's degree in Computer Science/Engineering or related field