Hadoop Big Data Spark Engineer Jobs in New York, NY

Refine Results
21 - 40 of 372 Jobs

Infrastructure Engineer (Hadoop)

Discover Financial Services

•

Remote or Riverwoods, Illinois, USA

Full-time

Discover. A brighter future. With us, you'll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it - we want you to grow and make a difference at one of the world's leading digital banking and payments companies. We value what makes you unique so that you have an opportunity to shine. Come build your future, while being the reason millions of people find a brighter financial future
Posted 5 days ago | Updated 1 hour ago

Sr Data Modeler

Cystems Logic

•

Jersey City, New Jersey, USA

Full-time, Contract, Third Party

Sr Data Modeler Location: Jersy City, New Jersey 3 Data Modelers needed: Contract only, Onsite Mon-Wed in Jersey City. Team is tasked with cataloging data models, assessing risk, and determining what data can be purged. 6+ years of experience with Erwin Hands on Data Modeling and Data Mapping experience. Domain experience with Risk / Controls for large enterprise Excellent verbal communication skills, needs to explain data concepts clearly to the business. Understanding of Risk, Data Author
Easy Apply
Posted 46 days ago | Updated 4 hours ago

Data Engineer

Collabera LLC

•

Summit, New Jersey, USA

Contract

Client: Banking/Finance? Location: Summit, New Jersey (Hybrid) Position: Data Engineer Duration: 24 months on W2 (Contract - Hire) Job Description: Will be a primarily heads down engineer. Will participate in a daily stand up call, Jiras will be assigned. Needs to be capable of speaking up in the calls and providing risk updates. Big Data Hadoop and Spark ETL development experience Data Modelling and database design SQL Performance Tuning, Unix Shell scripting and Autosys Agile, JIRA Top Sk
Easy Apply
Posted 1 hour ago

Senior Data Engineer (Machine Learning)

W3Global

•

Remote or Jersey City, New Jersey, USA

Full-time

Senior Data Engineer (ML/ ETL) Full Time Remote Responsibilities: bold">Collaborate with machine learning practitioners to understand algorithm feature and data requirements bold">Work with Engineering teams to collect required data from internal and external systems bold">Develop and maintain production-grade batch and streaming pipelines bold">Setup orchestration and automation of ETL jobs using tools such as Airflow and Jenkins bold">Improve and extend existing data infrastructure servi
Posted 18 days ago | Updated 1 hour ago

Platform Engineer

Apple, Inc.

•

New York, New York, USA

Full-time

Summary At Apple, we believe in the power of technology to enrich people's lives. Everything we build is designed to empower people, including our advertising platform. We deliver ads in a way that benefits both customers and advertisers - helping people discover content, supporting creators, and protecting and respecting everyone's privacy.Our technology makes advertising possible on the App Store, Apple News, Stocks, and Apple TV. Our technology and services power advertising in Apple News an
Posted 47 days ago | Updated 6 hours ago

Senior Data Engineer

Tiger Analytics

•

Jersey City, New Jersey, USA

Full-time

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in t
Posted 24 days ago

Sr. Data Engineer

Capital One

•

New York, New York, USA

Full-time

Plano 3 (31063), United States of America, Plano, Texas Sr. Data Engineer We are looking for driven individuals to join our team of passionate data engineers in creating Capital One's next generation of data products and capabilities. - You will build data pipeline frameworks to automate high-volume and real-time data delivery for our Hadoop and streaming data hub - You will build data APIs and data delivery services that support critical operational and analytical applications for our interna
Posted 9 hours ago

Software Development Engineer - Data Capture

Amazon.com

•

Newark, New Jersey, USA

Full-time

At Audible, we believe stories have the power to transform lives. It's why we work with some of the world's leading creators to produce and share audio storytelling with our millions of global listeners. We are dreamers and inventors who come from a wide range of backgrounds and experiences to empower and inspire each other. Imagine your future with us. ABOUT THIS ROLE As a Software Development Engineer, it's up to you to define, design and refine the tech that keeps us one step ahead of listen
Posted 10 hours ago

Big Data

OJUS LLC

•

Jersey City, New Jersey, USA

Contract

Big Data Developer Strong Experience in Spark Scala Programing. Very extensive experience on Hive, Impala, Kafka & Hbase. Should have good knowledge on Spark Streaming. Clear understanding of Hadoop Ecosystem & Spark Architecture. Must have experience in Unix Shell Scripting, PL/SQL & Autosys Scheduler. Should have used udeploy, TeamCity, SharePoint. Should be expert in debugging & tracing errors/exceptions. occurred in Spark job execution. Must have experience working in different SDLC phases
Easy Apply
Posted 49 days ago | Updated 12 days ago

Senior Data Engineer

Capital One

•

New York, New York, USA

Full-time

11 West 19th Street (22008), United States of America, New York, New York Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data wit
Posted 9 hours ago | Updated 9 hours ago

Lead Software Engineer (Data)-8570

Comcast Corporation

•

New York, New York, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary Job Description DUTIES: Provide technical leadership to a team responsible for creating
Posted 10 hours ago

19028976 Data Engineer, MTA

TransUnion

•

New York, New York, USA

Full-time

As the real-time provider of cloud-based information services and data analytics, we enable marketing and IT security professionals to promote and protect their businesses. With a commitment to privacy and neutrality, TransUnion operates complex data registries and uses its expertise to deliver actionable, data-driven insights that help clients make high-value business decisions in real time, one customer interaction at a time. Our vision is to be the single most trusted source of commercial ins
Posted 10 days ago

Senior Data Engineer

Capital One

•

New York, New York, USA

Full-time

Locations: TX - Plano, United States of America, Plano, Texas Senior Data Engineer Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying
Posted 9 hours ago

Senior Data Engineer - Principal Associate

Capital One

•

New York, New York, USA

Full-time

Center 2 (19050), United States of America, McLean, Virginia Senior Data Engineer - Principal Associate Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying d
Posted 9 hours ago

Senior Big Data Engineer

VeridianTech

•

Woodbridge Township, New Jersey, USA

Third Party, Contract

Job title: Senior Big Data Engineer Location: New Jersey (Hybrid) Duration: 6 + months Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines and infrastructure for our big data projects. Your expertise in Java, Python, Spark cluster management, data science, big data, REST API development, and knowledge of Databricks and D
Easy Apply
Posted 60+ days ago | Updated 4 hours ago

Senior Data Engineer- Asset & Wealth Management- New York- Vice President

Goldman Sachs & Co.

•

New York, New York, USA

Full-time

At Goldman Sachs, our Engineers don't just make things - we make things possible. We change the world by connecting people and capital with ideas and solve the most challenging and pressing engineering problems for our clients. Our engineering teams build scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Engineering, which is c
Posted 60+ days ago | Updated 6 hours ago

Sr. Software Engineer

GalaxE.Solutions

•

Morris Plains, New Jersey, USA

Full-time

What You Will DoDesign and implement highly efficient Spark applications in Java, focusing on performance optimization, including tuning Spark jobs, optimizing transformation, and leveraging advanced Spark features for batch and real-time processing.Responsible for developing data pipelines using Apache Spark (Big Data Processing) Responsible for analyzing performance concerns and issues. Identifying the bottlenecks that require changes to improve performance.Utilize in-depth knowledge of functi
Posted 3 days ago

Senior Data Engineer - Principal Associate

Capital One

•

New York, New York, USA

Full-time

802 Delaware Avenue (18052), United States of America, Wilmington, Delaware Senior Data Engineer - Principal Associate Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate a
Posted 9 hours ago

Senior Data Engineer (Python, Kafka, Databricks, AWS)

Capital One

•

New York, New York, USA

Full-time

Plano 1 (31061), United States of America, Plano, Texas Senior Data Engineer (Python, Kafka, Databricks, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about mar
Posted 9 hours ago

Senior Manager, Data Engineer

Capital One

•

New York, New York, USA

Full-time

802 Delaware Avenue (18052), United States of America, Wilmington, Delaware Senior Manager, Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marryin
Posted 9 hours ago