Senior Data Engineer

Senior Data Engineer
Manhattan, NY (2 days in a week from office)
Contract 
Role Overview

• We are seeking a Senior Data Engineer to design, build, and support scalable data pipelines and analytics datasets that power enterprise reporting across Finance, Technology, and Operations.

• This role focuses on ingesting data from corporate systems, organizing it in a cloud-based data lake, and enabling reliable reporting through Amazon QuickSight.

• The ideal candidate is a hands-on engineer comfortable with modern AWS data services, collaborating with business stakeholders, and supporting production reporting workloads. You will help establish practical standards for data ingestion, transformation, and reporting in a growing analytics environment.

• Context: You will build and maintain Python-based ETL pipelines within AWS Glue, own transformation logic, manage orchestration and metadata cataloging, and ensure data is securely processed and accessible for downstream analytics and AI tools.

• This role requires strong ownership of pipeline reliability, data quality, and performance tuning.

• Experience with dbt and Snowflake will become increasingly important as the platform evolves.

Key Responsibilities

• Design, build, and maintain scalable data ingestion frameworks using AWS native services (Glue,Lambda, S3, Step Functions) and SnapLogic

• Architect and manage the enterprise data lake on S3 using Apache Iceberg, including partitioning strategies, schema evolution, metadata optimization, and lifecycle management

• Develop robust ETL/ELT pipelines to standardize, cleanse, and enrich source system data for   analytics and operational use cases

• Build and maintain reporting-ready datasets and queries using Amazon Athena and AWS Glue metadata Implement and monitor data quality frameworks, including validation rules, reconciliation checks, and anomaly detection

• Collaborate with Finance, Technology, and Operations stakeholders to translate business requirements into scalable data solutions

• Establish and enforce data governance best practices: documentation, lineage tracking, access controls, and change management

• Monitor pipeline health and performance, troubleshoot data issues, and support recurring reporting cycles

Performance Standards

• Deliver projects accurately and on schedule

• Maintain professionalism and accountability

• Demonstrate effective teamwork and cross-functional collaboration

• Align with Technology & Operations strategic goals

• Communicate clearly with internal and external stakeholders

 Ideal Candidate Profile

• 14+ years of overall software development experience, with significant exposure to data-centric systems

• 7+ years of hands-on experience in data engineering, analytics engineering, or related roles

• Strong Snap logic and SQL skills with proven experience designing and building analytical datasets

• Hands-on experience with AWS data platforms: S3, Glue, Athena, and AWS Unified Data Catalog

• Experience integrating data from SaaS and enterprise systems using ETL/ELT tools such as SnapLogic

• Experience supporting BI tools like Amazon QuickSight, Tableau, or Power BI

• Ability to work independently and collaborate effectively with both technical and non-technical stakeholders

 Essential Functions & Responsibilities

• Work with architects, development teams, information security, infrastructure, and operations to develop requirements and maintain detailed functional and technical specifications

• Ensure common services operate as a product with regular updates and a focus on the customer

• Support ongoing operation of components and services

• Ensure adherence to change management and risk policies

• Drive modern enterprise application development with a cloud-first approach

• Success Factors / Job Competencies
  Detail-oriented while understanding the broader enterprise environment
  Strong team player, effective across technical teams, business partners, and leadership
  Ability to balance hands-on execution with collaboration and operational responsibility
• Education:
  Bachelor s degree in Computer Science, Engineering, Information Systems, or equivalent
  experience.
  
  Qualifications desired:

• Experience with payment systems, financial networks, and protocols (ISO 20022, SWIFT, NACHA)

• Experience in regulated environments (banking, fintech, healthcare)

• Knowledge of advanced data security principles: encryption, tokenization, data masking, RBAC,   and secure data governance

• Exposure to dbt and Snowflake as part of modern data platform evolution