big data engineer(scala & spark) Jobs

Refine Results
81 - 100 of 199 Jobs

Azure Data Engineer

Acadia Technologies, Inc.

Detroit, Michigan, USA

Full-time

Technical Skills:Azure Data Services: A strong grasp of Azure services like: Azure Data Factory: For orchestrating and automating data movement and transformation pipelines. Azure Synapse Analytics: For big data warehousing and analytics. Azure Databricks: For large-scale ETL and machine learning workflows. Azure Data Lake Storage: For storing vast amounts of structured and unstructured data. Azure SQL Database/SQL Server: For managing and querying relational data. Azure Cosmos DB: For managing

Data Engineer 5 - Playback

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. We are revolutionizing how shows and movies are produced, pushing technological boundaries to efficiently deliver streaming video at a massive scale over the internet, and c

Lead Data Engineer

Capital One

Plano, Texas, USA

Full-time

Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the

Software Engineer L5, Machine Learning Platform (Model Development and Management)

Netflix, Inc.

Los Gatos, California, USA

Full-time

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. We are seeking an ambitious Software Engineer to join the Model Development and Management team, that is building the self-serve user interface layer for Netflix's MLP in or

Senior Software Engineer - Fixed Income and Derivatives

Bloomberg L.P.

New York, New York, USA

Full-time

Description & Requirements Bloomberg is the global leader in financial data and analytics. The Fixed Income and Derivatives Engineering team produces applications and tools that enable our clients to generate trade ideas, structure deals, connect to electronic trading platforms, capture market movements, and assess and hedge portfolio risk for a variety of financial instruments across fixed income and derivatives asset classes. While building innovative technology is at the core of what we do,

Lead Data Engineer (Python, AWS)

Capital One

McLean, Virginia, USA

Full-time

Lead Data Engineer (Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, y

Lead Data Engineer

Capital One

McLean, Virginia, USA

Full-time

Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the

Data Engineer - USDS

TikTok

Washington, District of Columbia, USA

Full-time

Location : Washington D.C. Employment Type : Regular Job Code : A153413 Apply to this job Share this listing: Responsibilities We are seeking a versatile and results-driven Data Engineer to join the USDS Cyber Defense & Engineering team at TikTok. In this role, you'll collaborate with cross-functional teams across regions to develop innovative solutions that strengthen the security and privacy of our users, helping make TikTok the most trusted platform. The ideal candidate is a strong pro

Senior Data Engineer

Mastercard

San Francisco, California, USA

Full-time

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest po

Senior Software Engineer - Fixed Income and Derivatives

Bloomberg

New York, New York, USA

Full-time

Senior Software Engineer - Fixed Income and Derivatives Location New York Business Area Engineering and CTO Ref # 10041182 Description & Requirements Bloomberg is the global leader in financial data and analytics. The Fixed Income and Derivatives Engineering team produces applications and tools that enable our clients to generate trade ideas, structure deals, connect to electronic trading platforms, capture market movements, and assess and hedge portfolio risk for a variety of financial instrume

Lead Data Engineer

Capital One

McLean, Virginia, USA

Full-time

Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the

Senior Lead Data Engineer

Capital One

McLean, Virginia, USA

Full-time

Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, y

Data Analytics Engineer

Cisco Systems, Inc.

Fulton, Maryland, USA

Full-time

The application window is expected to close on July 3, 2025 Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received. Meet the Team We are seeking an experienced Big Data Technical Leader to lead the design, implementation, and optimization of our data lake using Databricks, Apache Spark, and AWS cloud services. In this senior role, you will architect scalable solutions, mentor junior engineers, and drive technical decision-making to tra

Senior Data Engineer- AdTech/ Real Time Bidding/ Programmatic Advertising

Invicta Systems

San Francisco, California, USA

Full-time

We are seeking Sr. Data Engineer to join our engineering team. This role is ideal for a skilled developer with a strong background in big data processing, data pipeline development, and distributed systems. As a Data Engineer, you will play a crucial role in designing, building, and maintaining the data infrastructure that powers AI-driven advertising platform. You will collaborate closely with data scientists, software engineers, and product managers to ensure efficient and scalable data soluti

Part-Time Student - Data Engineer - Moline, IL or Champaign, IL

John Deere & Company

Moline, Illinois, USA

Part-time

There are over 7 billion people on this planet. And by 2050, there will be 2 billion more many moving into urban centers at an unprecedented rate. Making sure there is enough food, fiber and infrastructure for our rapidly growing world is what we're all about at John Deere. And it's why we're investing in our people and our technology like never before! Here the world's brightest minds are tackling the world's biggest challenges. If you believe one person can make the world a better place, we'll

Senior Staff IT Data Engineer

PaloAlto Networks

Santa Clara, California, USA

Full-time

Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Who We Are We take our mission of

Machine Learning Engineer 5 - Ads Platform Engineering

Netflix, Inc.

Remote

Full-time

Netflix is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. We launched a new ad-supported tier in November 2022 to offer our members more choice in how they consume their content. Our new tier allows us to attract new members at a l

Application Software Engineer, Data - Top Secret Clearance

SpaceX

Hawthorne, California, USA

Full-time

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars. APPLICATION SOFTWARE ENGINEER, DATA - TOP SECRET CLEARANCE The application software team is the central nervous system of SpaceX - we create mission critical applications that are used throughout SpaceX to accelerate

Machine Learning Engineer, Global Payment Decision Science - USDS

TikTok

Seattle, Washington, USA

Full-time

Location : Seattle Employment Type : Regular Job Code : A80793 Apply to this job Share this listing: Responsibilities Team Intro The Global Payment team of U.S. Data Security department of TikTok provides payment solutions - including payment acquisitions, disbursements, transaction monitoring, payment method management, foreign exchange conversion, accounting, reconciliations, and so on - to ensure that users have a smooth and secure payment experience on TikTok platform. The team is als

Machine Learning Engineer - Trust and Safety (Account Trust)

Apple, Inc.

No location provided

Full-time

The Trust and Safety group at Apple is responsible for ensuring that users of Apple's services and products have genuine and safe experiences. Within Trust and Safety, our team ensures the protection of several systems, including Apple's account creation flows and iMessage spam. The solutions we deploy help us keep Apple ecosystem safe, while mitigating constant attack by external actors. We are seeking a machine learning engineer who will strive to turn huge amounts of data into actionable insi