hadoop big data spark engineer Jobs in new york, ny

Refine Results
201 - 220 of 292 Jobs

Data Engineer - 4115

Comcast Corp

Remote or Philadelphia, Pennsylvania, USA

Full-time

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou

Machine Learning Engineer 5 - Ads Platform Engineering

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. We launched a new ad-supported tier in November 2022 to offer our members more choice in how they consume their content. Our new tier allows us to attract new members at a l

Product Ownerwith Healthcare

Pegasys Information Technologies

Remote

Contract

Hi, Job Title: Product Owner with Healthcare Location: Remote Duration: Long term Job Description : Mandatory experience in Big Data Handling on Cloud(Python, Spark, SQL) Collaborate with stakeholders to gather requirements and define product features. Lead Agile ceremonies and ensure timely delivery of product increments. Ensure solutions align with healthcare regulations (e.g., HIPAA, HL7, FHIR). Work with development, QA, and UX teams to deliver high-quality features. Monitor product perfo

Software Engineering Senior Advisors

Cigna

Remote or Tampa, Florida, USA

Full-time

The job profile for this position is Software Engineering Senior Advisor which is a Band 4 Career Track Role with Cigna-Evernorth Services, Inc. Provide thought leadership and technical expertise across multiple disciplines, including full life cycle project ownership from analysis to application development to delivery of IT solutions. Design and build data layers used for reporting, analytics, data exploration, and data processing pipelines/solutions. Develop stable and scalable systems align

Data Engineer (L5) - Security

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Netflix is enjoyed by more than 200 million members globally, entertaining new audiences every day. Securing our members data and accounts appropriately is key to maintainin

Data Scientist Manager

Ameriprise Financial

Remote or Minneapolis, Minnesota, USA

Full-time

Ameriprise Financial has an opportunity for a Data Scientist Manager to join the team! The individual in this role will play an integral role in supporting modeling and data analysis, campaign execution, and database needs for Marketing and Digital analytics. They will also manage the creation and/or usage of large data sets, providing information-based decision logic and predictive modeling solutions, and translates modeling/analytic output into understandable/actionable business knowledge, ins

Data Engineer (L4) - Security

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Securing our members' data appropriately is key to maintaining a high level of trust with our customers. In addition, securing our technology infrastructure and understandin

Senior Data Engineer

Mass General Brigham

Remote or Boston, Massachusetts, USA

Full-time

Site: The General Hospital Corporation Mass General Brigham relies on a wide range of professionals, including doctors, nurses, business people, tech experts, researchers, and systems analysts to advance our mission. As a not-for-profit, we support patient care, research, teaching, and community service, striving to provide exceptional care. We believe that high-performing teams drive groundbreaking medical discoveries and invite all applicants to join us and experience what it means to be part

Data Engineer (L5)

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. At Netflix, our mission is to entertain the world. With 278 million paid members in over 190 countries on millions of devices; enjoying TV series, documentaries, and feature

Cloud Software Engineer 2

Nightwing

Remote or Annapolis, Maryland, USA

Full-time

Nightwing provides technically advanced full-spectrum cyber, data operations, systems integration and intelligence mission support services to meet our customers' most demanding challenges. Our capabilities include cyber space operations, cyber defense and resiliency, vulnerability research, ubiquitous technical surveillance, data intelligence, lifecycle mission enablement, and software modernization. Nightwing brings disruptive technologies, agility, and competitive offerings to customers in th

data engineer with ML

Impetus IT

Remote or Seattle, Washington, USA

Full-time

We are partnering with one of our staffing partners who is searching for a Data engineer with Machine learning experience to design, develop, and optimize scalable data pipelines and infrastructure for ML-driven applications. The ideal candidate will have experience in big data technologies, ETL processes, and model deployment to support advanced analytics and AI initiatives.Salary $50k-70k slight flexibility for a good candidate.Due to low rates only direct applicants no c2c candidates please.

Machine Learning Engineer (L5 - Senior) , Ads Inventory Management & Forecasting

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. We launched a new ad-supported tier in November 2022 to offer our members more choice in how they consume their content. Our new tier allows us to attract new members at a l

Consultants

Trans Union LLC

Remote

Full-time

We'd Love to See: Job Description Consultants for various and unanticipated worksites throughout the U.S. (HQ: Chicago, IL). Independently plan and deliver database data warehouse and storage architecture. Maintain and manage design services, provide sizing and configuration assistance and perform needs assessments. Analyze current business practices, processes and procedures. Identify future business opportunities for leveraging data storage and retrieval system capabilities. Manage relations

AWS Data Engineer with ETL & Snowflake - Only W2 - Remote

XFORIA Inc

Remote

Contract

Role: Data Engineer Location: Remote Duration: Long term contract Worked as Data Engineer on Cloud Platforms (AWS preferred) in building highly scalable Big Data and ETL solutions - Experience working on at-least one programming language Scala or Python - Strong SQL and shell scripting skills - Experience working in Snowflake and Data bricks is preferred - Experience with Distributed data/computing tools (Kafka or Spark)

Software Engineering Senior Advisors-Hybrid

Cigna

Remote or Franklin, Tennessee, USA

Full-time

The job profile for this position is Software Engineering Senior Advisor, which is a Band 4 Contributor Career Track Role with eviCore healthcare MSI, Inc. Responsiblities- Build Extract, Transform, and Load (ETL) processes to allow data to flow seamlessly from source to target.Load and enhance dimensional data models, perform code reviews, and participate in sprint ceremonies.Leverage code to apply business rules to ensure data is clean and is interpreted correctly by all business stakeholders.

(USA) Senior, Data Scientist

Walmart Inc.

Remote or Sunnyvale, California, USA

Full-time

Position Summary What you'll do The Senior Data Scientist / Applied Machine Learning Scientist Computational Advertising is a critical data science/applied machine learning role that uses cutting-edge machine learning, deep learning, big data mining and optimization techniques to solve the challenging problems from ads relevance, ranking to campaign optimization. You will have a chance to work with the worlds best machine learning scientists, engineers and product managers to solve some of the

AWS Data Engineer with Snowflake

XFORIA Inc

Remote

Contract

Job Details: AWS Data Engineer with Snowflake Remote Contract (W2) 11+ Years Job Description: - Worked as Data Engineer on Cloud Platforms (AWS preferred) in building highly scalable Big Data and ETL solutions - Experience working on at-least one programming language Scala or Python - Strong SQL and shell scripting skills - Experience working in Snowflake and Data bricks is preferred - Experience with Distributed data/computing tools (Kafka or Spark)

Software Engineering Senior Advisor-Hybrid

Cigna

Remote or Austin, Texas, USA

Full-time

The job profile for this position is Software Engineering Senior Advisor, which is a Band 4 Senior Contributor Career Track Role with Cigna-Evernorth Services Inc. Requirements- Participate in the delivery of the definitive enterprise information environment that enables strategic decision-making capabilities across the enterprise via analytics and reporting; Provide counsel and advice to top management on significant engineering matters, often requiring coordination between organizations; Serv

Senior Solution Architect, Data Engineering

Snowflake Inc.

California, USA

Full-time

Build the future of the AI Data Cloud. Join the Snowflake team. Enterprises are modernizing data platforms and processes at a growing rate in order to meet the demands of their customers. A majority of this journey requires not just technical expertise but also the ability to drive predictability, and manage complexity. Snowflake's Solution Innovation Team offers our customers a market-leading set of technical capabilities as well as best practices for modernization and implementation based on

Lead Data Engineer - Business & Competitive Intelligence

Allstate Insurance Company

Remote

Full-time

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Job Description This role is responsible for the design, development and m