Overview
Skills
Job Details
Lead Data Engineer / Data Architect
Location: New York City, NY (Onsite 5 days/week)
Overview:
We are looking for an experienced Lead Data Engineer / Data Architect to drive the design and implementation of a next-generation enterprise data platform for a leading global investment firm. This role is critical in defining the data architecture strategy, leading high-performance engineering teams, and ensuring data platforms meet business scalability, reliability, and compliance standards.
Key Responsibilities:
Architect & Lead: Define and implement scalable data architecture and data engineering strategies aligned with business goals.
Modeling & Design: Build conceptual, logical, and physical data models supporting analytical and operational systems.
Pipeline Development: Design and optimize end-to-end ELT/ETL data pipelines using Python, AWS Glue, and Snowflake.
Performance Optimization: Tune SQL queries and Snowflake workloads for speed, cost-efficiency, and reliability.
Data Quality & Governance: Establish validation, lineage, and compliance frameworks ensuring high-quality, secure data.
Collaboration: Partner with business stakeholders, analysts, and technology teams to deliver reliable, business-aligned data solutions.
Leadership: Mentor onshore/offshore engineers, enforce coding standards, and promote best practices in modern cloud data architectures.
Documentation & Support: Maintain architecture diagrams, data flow documentation, and troubleshoot performance or job issues.
Required Skills & Experience:
12+ years in Data Engineering and Data Architecture with focus on modelling, ELT processes, and scalable pipeline design.
Expert in SQL, Python, and Snowflake (data sharing, secure views, performance tuning).
Strong hands-on with AWS Glue, EMR, and general AWS data stack.
Deep understanding of data engineering design patterns and best practices.
Proven experience building enterprise data solutions in Financial Services / Asset Management.
Excellent problem-solving and stakeholder communication skills.
Preferred Qualifications:
Certifications in Snowflake or AWS data engineering.
Experience in Alternative Investments / Financial Services domain.
Familiarity with Apache Airflow, Azure, or Google Cloud Platform for orchestration.
Knowledge of visualization tools like Tableau or Power BI.