apache spark Jobs in new york

Refine Results
101 - 120 of 438 Jobs

Cloud Data & Analytics Engineer - Senior Manager

PricewaterhouseCoopers LLP

New York, New York, USA

Full-time

Industry/Sector EUR X-Sector Specialism Data, Analytics & AI Management Level Senior Manager Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building da

Lead Data Engineer

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

Job Description Bring your Data Engineering skills to the next level and join the AIML Data Platforms Fusion Data Management Team. In this role as a Lead Analytics Data Engineer you will bring your experience with Python / Java / Spark knowledge to help the Securities Services business identify opportunities to improve efficiency, increase revenue, optimize the operating model and risk framework and create value added data driven Products for our Clients. As a Lead Data Engineer at JPMorgan Cha

Senior Data Scientist/ AI Engineer - Contract

Oscar Technology

Remote

Contract

A leading US mortgage provider is searching for a Data Scientist/ AI Engineer with expertise in Generative AI to build and develop their AI and advanced analytics processes. This role is 40 hours a week in the Reston/ DC Metro area. Senior Data Scientist / AI Engineer Reston, VA or DC Metro Area - Remote $70-$80 h/r Required Experience; Experience with R/Python, Linux, and Spark in AWS cloud environments Experience developing AI agents and machine learning Proficient in Natural language proces

Sr. Machine Learning Engineer, Earner Growth

Uber Corporate

New York, New York, USA

Full-time

About the Role Have you ever ordered a car service on Uber, and when the ride arrives, wondered how it got to you so fast? Ever ordered food on UberEats and wondered where the driver was before receiving your order and how long it took to get to the restaurant or if your order was ready when the courier arrived? Ever wondered why your grocery delivery from Uber always has the best apple picked? If so, Uber is for you. In our Sciences division, we strive to make magic within Uber's marketplace.

Senior Lead Software Engineer for AI/ML

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

Job Description As a Senior Lead Software Engineer at JPMorgan Chase within the Commercial and Investment Banking Technology in Payments Team, you will play a crucial role in our growing technology team, concentrating on providing prompt AI/ML solutions to cater to escalating business needs. Collaborating closely with diverse teams, you will design, develop, and deploy machine learning models and AI-powered applications that improve our payment technology services. Job Responsibilities Collabo

ClickHouse SRE, Data Platform -USDS

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A33433 Apply to this job Share this listing: Responsibilities Site Reliability Engineering (SRE) combines software and systems engineering to build and run large-scale, massively distributed services and infrastructures. As a site reliability engineer in the data platform area, you will have the opportunity to manage the services and infrastructures in one of the largest data plaforms in the world that directly supports the TikTok a

BigData Architect

Avance Consulting

Remote

Full-time

Sr. Spark Architect New Port,New Jersey Full Time Job Description:- At least 11 years of Information Technology experience Must have deep experience in architecting Big Data solutions using Hadoop, Spark, Hive, Kafka, Scala Must have in depth knowledge of hadoop ecosystem Should have data background. Must have knowledge on data warehouse, ETL, reporting. Good experience in end-to-end implementation of data warehouse and data marts Experience and detailed knowledge with Master Data Management, ET

Data Engineer

Hexaware Technologies, Inc

Remote

Full-time

Lead Data Engineer/ Senior Data Engineer Cleveland Ohio and Atlanta FTE Hybrid Must Have :Azure Databricks, Python and Pyspark Good to know : Mongo Db and Docker, Generative AI and co-pilots with git Experience Level: 10+ years The Need : A highly skilled and experienced Senior Data Engineer to lead and manage R&C s data landscape. Someone with a strong background in Data Architecture, Data Science, and hands-on expertise in Python. The individual will be responsible for developing and impleme

Data Scientist, Financial Crimes - USDS

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A66783 Apply to this job Share this listing: Responsibilities Team Intro USDS Financial Crime Compliance is responsible for overseeing and operationalizing all aspects related to Anti-Money Laundering (AML) and Sanctions Compliance activities related to TikTok USDS's operations. Collaborating cross-functionally with stakeholders across the U.S. and global, we address complex and cutting-edge challenges, which include the identificat

Data Engineer

S&P Global

New York, New York, USA

Full-time

About the Role: Grade Level (for internal use): 09In this role, you'll be at the heart of our data and product innovation, partnering closely with Product, Data Science, and cross-functional teams to build robust, production-ready data pipelines. You'll take machine learning algorithms from raw data ingestion through transformation and seamless integration with our production databases. You'll also collaborate with our broader Data organization to bring valuable external data into our Data Lake

Big Data Engineer

Synechron Inc.

Weehawken Township, New Jersey, USA

Full-time

We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development in

Senior Engineering Manager (Provider CX & Group Practices Product)

Headway

Remote or New York, New York, USA

Full-time

Headway's mission is a big one - to build a new mental health care system everyone can access. We've built technology that helps people find great therapists with the first software-enabled national network of providers accepting insurance. 1 in 4 people in the US have a treatable mental health condition, but the majority of providers don't accept insurance, making therapy too expensive for most people. Headway is building a new mental healthcare system that everyone can access by making it easy

Data Engineer - (Databricks, Python, SQL)

Apidel Technologies

Remote

Contract

Shift : 09 to 05 EST - 100% Remote Any time zone fine Team Info: Working for Xfinity Mobil product Must have skills: Looking for 5 to 7 years of Data Engineering experience. Expertise in Databricks Strong Python & SQL Do the spark configuration & technologies Know the clustering & different techniques Can do the data format Understand the Data Modeling Nice to Have: Large Data sets Interview Process: 1 round (Behavioral + Technical) with HM

Data Engineering Manager

Accenture LLP

New York, New York, USA

Full-time

Data Engineering Manager (Accenture LLP; New York, NY): Accenture LLP has multiple openings for the position of Data Engineering Manager in New York, NY, and the job duties are as follows: Direct, manage, and oversee a team of data warehousing professional employees in the U.S., including Associate Managers, Systems Analysts, and Senior ETL Developers.Assign work and work schedules, and monitor the completion of teams' core duties, responsibilities, assignments, and projects.Exercise exclusive

Data Engineer, Video Platform - USDS

TikTok

New York, New York, USA

Full-time

Location : New York Employment Type : Regular Job Code : A78153 Apply to this job Share this listing: Responsibilities In order to enhance collaboration and cross-functional partnerships, among other things, at this time, our organization follows a hybrid work schedule that requires employees to work in the office 3 days a week, or as directed by their manager/department. We regularly review our hybrid work model, and the specific requirements may change at any time. About the team TikTok

Data Engineer

S&P Consultants

New York, New York, USA

Full-time

About the Role: Grade Level (for internal use): 09 In this role, you'll be at the heart of our data and product innovation, partnering closely with Product, Data Science, and cross-functional teams to build robust, production-ready data pipelines. You'll take machine learning algorithms from raw data ingestion through transformation and seamless integration with our production databases. You'll also collaborate with our broader Data organization to bring valuable external data into our Data La

Artificial Intelligence/Machine Learning Platform Owner

Corning

New York, New York, USA

Full-time

Requisition Number: 66356 The company built on breakthroughs. Join us. Corning is one of the world's leading innovators in glass, ceramic, and materials science. From the depths of the ocean to the farthest reaches of space, our technologies push the boundaries of what's possible. How do we do this? With our people. They break through limitations and expectations - not once in a career, but every day. They help move our company, and the world, forward. At Corning, there are endless possibiliti

Member of Technical Staff - Data Infrastructure Engineer (DevOps|SRE|Platform Engineering|MLOps

Microsoft Corporation

New York, New York, USA

Full-time

As Microsoft continues to lead the frontier of artificial intelligence, we are seeking passionate and driven engineers to solve some of the most challenging and impactful AI problems of our time. Our vision is bold: to build intelligent systems across agents, applications, services, and infrastructure - and to make this intelligence universally accessible for consumers, businesses, and developers alike. Microsoft AI (MAI) is looking for an experienced Data Infrastructure Engineer to join the te

Data Platform Engineering Lead

London Stock Exchange Group

New York, New York, USA

Full-time

LSEG (London Stock Exchange Group) is one of the world's leading providers of financial markets infrastructure and delivers financial data, analytics, news and index products to more than 40,000 customers in over 170 countries. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. We help organizations fund innovation, manage risk and create jobs by partnering with customers at every point in the trade lifecycle: from info

Sr Data Scientist- NLP, LLM and GenAI

S&P Consultants

Remote or New York, New York, USA

Full-time

About the Role: Grade Level (for internal use): 10 The Role: Sr Data Scientist- NLP, LLM and GenAI S&P is a leader in risk management solutions leveraging automation and AI/ML. This role is a unique opportunity for hands-on ML scientists and NLP/Gen AI/ LLM scientists to grow into the next step in their career journey and apply her or his technical expertise in NLP, deep learning, GenAI, and LLMs to drive business value for multiple stakeholders while conducting cutting-edge applied research a