Data Engineer

New York, NY, US • Posted 3 hours ago • Updated 3 hours ago

Contract Independent

No Travel Required

On-site

Depends on Experience

Teknikoz

Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Job Details

Skills

Amazon Web Services
Analytical Skill
Analytics
Apache Hadoop
Apache Kafka
Apache Spark
Big Data
Cloud Computing
Collaboration
Computer Science
Conflict Resolution
Data Engineering
Data Governance
Data Processing
Data Quality
Data Warehouse
Docker
Extract, Transform, Load
ELT
Finance
GC
Good Clinical Practice
Google Cloud Platform
Information Systems
Investments
Java
Kubernetes
Lifecycle Management
Management
Meta-data Management
Microsoft Azure
Orchestration
Problem Solving
Python
Quantitative Research
Real-time
SQL
Scala
Scalability
Storage
Streaming
Unstructured Data
Workflow

Summary

We are seeking 16+years a highly experienced Data Engineer to join the Data Engineering team at Two Sigma Investments, supporting large-scale data infrastructure and analytics needs. The ideal candidate will design, build, and maintain robust, scalable data pipelines that process and transform 30+ TB of data daily. This role involves close collaboration with data scientists, analytics experts, and platform engineers to ensure efficient, reliable, and high-performance data workflows.

Key Responsibilities

Design, develop, and maintain scalable, high-performance data pipelines for ingestion, processing, and transformation.
Build and optimize ETL/ELT workflows handling 30+ TB of data each day.
Architect scalable and distributed solutions for data processing and storage.
Work closely with data scientists, analytics, and platform teams to deliver clean, reliable, and well-structured datasets.
Implement data quality validation, monitoring, and error-handling processes.
Optimize query and pipeline performance for large datasets.
Manage both structured and unstructured data from multiple sources.
Contribute to architectural discussions and recommendations to improve scalability and reliability.
Adhere to best practices in data governance, security, and lifecycle management.

Required Qualifications

Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
Minimum 5+ years of experience in Data Engineering or related roles (16+ years overall experience preferred).
Proven expertise in building large-scale data pipelines and distributed data processing systems.
Strong programming skills in Python, Scala, or Java for data engineering applications.
Proficiency in SQL and experience with big data ecosystems (Spark, Hadoop, etc.).
Hands-on experience with data lakes, data warehouses, and ETL/ELT frameworks.
Familiarity with workflow orchestration tools like Airflow or similar frameworks.
Strong analytical and problem-solving skills, with attention to performance and data reliability.

Preferred Qualifications

Experience with cloud data platforms (AWS, Google Cloud Platform, or Azure).
Exposure to real-time/streaming platforms such as Apache Kafka.
Knowledge of containerization tools like Docker and Kubernetes.
Experience in financial analytics or supporting quantitative research environments.
Understanding of data governance, metadata management, and data cataloging tools.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91166541
Position Id: 8910100
Posted 3 hours ago

Company Info

About Teknikoz

A team of techies who believe in humanity & are passionate about technology.

TEKNIKOZ is a platform for like minded techies who want to deliver their best. The idea behind TEKNIKOZ originated from our two decades of first-hand experience in the world of IT services serving companies globally by providing Technology Recruiting solutions. With collective knowledge of our professionals, TEKNIKOZ has built strong partnerships and delivered right talent at the right time to help succeed. With this platform, we intend to retrieve those talented gems that are lost in the ocean of IT Outsourcing factory.

What we do is essentially staffing but with a difference - a huge difference. Our objective is to enable people to find their true potential and we do everything we can to make it happen. We’ve built a culture of trust and transparency & we only employ people who share this same passion. We aim to bring a more genuine approach to recruitment, and build long-term relationships with the businesses and candidates we support.

We love what we do and take pride in it. We will always strive to make people who connect with us (customers or consultants) happy. That’s the reward we truly strive for.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Cyber Data Product / Technical Lead

Juno Beach, Florida

•

Today

Role Overview We are seeking 10+years an experiencedCyber Data Product / Technical Leadto drive the strategy, design, and development of nextgeneration cyber data products. This role combines deep technical expertise incybersecurity data engineeringwith strong product leadership to ensure delivery of secure, scalable, and highquality solutions supporting enterprise-level security initiatives. Key Responsibilities Lead the endtoend architecture, design, and engineering of cyber data products and

Easy Apply

Contract

Depends on Experience

Search all similar jobs