Apache spark jobs in chicago, il

Remote

•

Today

Overview The Data Engineer plays a pivotal role within our expanding Data and AI team. This person helps build and scale our next-generation data platform, starting with our modernization initiative; transitioning from legacy ingestion processes embedded in C# .NET code to a scalable, cloud-native architecture on AWS and expanding into our Databricks analytical data platform for advanced processing and analytics. This is a highly impactful, hands-on role responsible for designing and implementi

Full-time

USD 97,000.00 - 122,000.00 per year

Lead SWE, AI Dev/IT Operations - Remote or Hybrid in DC or MN

Remote or Minnetonka, Minnesota

•

Today

Optum Tech is a global leader in health care innovation. Our teams develop cutting-edge solutions that help people live healthier lives and help make the health system work better for everyone. From advanced data analytics and AI to cybersecurity, we use innovative approaches to solve some of health care's most complex challenges. Your contributions here have the potential to change lives. Ready to build the next breakthrough? Join us to start Caring. Connecting. Growing together. We're seeking

Full-time

USD 112,700.00 - 193,200.00 per year

Senior Data Scientist - Generative AI

Remote

•

11d ago

Become a part of our caring community We are looking for a Senior Data Scientist to design and deliver Generative AI applications as part of the Growth Analytics & AI team. You will focus on building innovative, scalable, and reliable LLM-based solutions that produce insights from conversational and long-form unstructured data to inform business strategy, increase operational efficiency, and improve customer experience. The ideal candidate combines strong applied GenAI and machine learning exper

Full-time

USD 117,600.00 - 161,700.00 per year

Staff Engineer

Remote

•

Today

Impact As a Staff Engineer on the Core Services team at Shipt, you will act as a pivotal technical leader and architect, defining the future of the high-scale systems that power our entire retailer management ecosystem. You won't just execute a roadmap; you will be instrumental in defining and driving our long-term technical strategy. Working at the critical intersection of product goals and engineering excellence, you will collaborate with Principal Engineers to ensure our architecture is not

Full-time

USD 95,800.00 - 180,000.00 per year

Junior Solutions Architect

Remote

•

Today

About the Organization Now is a great time to join Redhorse Corporation. We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.S. national interests. We're looking for thoughtful, skilled professionals who thrive as trusted partners building technology-agnostic solutions and want to apply their talents supporting customers with difficult and important mission sets. Redhorse transforms the way government utilizes data and tech

Full-time

Senior Principal Machine Learning Engineer

Remote

•

Today

Overview We are looking for a Senior Principal Machine Learning Engineer to lead the design and delivery of end-to-end ML/AI systems that turn vast volumes of claims, clinical, and member data into measurable performance and reduced waste. You will define technical strategy, drive cross-functional alignment, and own systems that directly shape payment accuracy, risk adjustment, and quality outcomes for the payers we serve. This role sits at the intersection of applied research and production en

Full-time

USD 250,000.00 - 280,000.00 per year

Senior Security Engineer (Product)

Remote or New York, New York

•

Today

1 in 4 people in the US have a treatable mental health condition, but most providers don't accept insurance, making therapy too expensive for most people. Headway's mission is to fix this by building a new mental healthcare system everyone can access. We started by solving the biggest barrier to care: insurance. The admin work - credentialing, claims, payment reconciliation - is a nightmare. We've automated that. But we're going further. Over 75,000 providers across all 50 states run their prac

Full-time

USD 222,500.00 - 278,500.00 per year

Big Data Engineer Remote Location

Remote

•

Today

Job Summary We are looking for a Data Engineer with strong expertise in Azure data platforms and big data technologies. The candidate will be responsible for designing, developing, and optimizing scalable data pipelines, ETLELT processes, and analytics solutions using Azure Synapse, SparkPySpark, and related technologies. Key Responsibilities Design and develop scalable data ingestion and transformation pipelines.Build and optimize ETLELT solutions using Azure Synapse, SparkPySpark, and SQL.De

Third Party, Contract

$49 - $50

Senior Privacy Engineer

Remote

•

Today

About Upstart At Upstart, we're united by a mission that matters: to radically reduce the cost and complexity of borrowing for all Americans. Every day, we bring creativity, experimentation, and advanced AI to reshape access to credit, helping millions move forward financially with clarity and confidence. As the leading AI lending marketplace, we partner with banks and credit unions to expand access to affordable credit through technology that's both radically intelligent and deeply human. Our

Full-time

USD 164,800.00 - 228,400.00 per year

Lead Data Science Engineer Specialist - Data Scientist

Remote or Johnstown, Pennsylvania

•

Today

LEAD DATA SCIENCE ENGINEER/SPECIALIST - DATA SCIENTIST Concurrent Technologies Corporation Minimum Clearance Required: N/A Clearance Level Must Be Able to Obtain: N/A Employee Background Check Required As a Lead Data Science Engineer/Specialist, you will serve as a senior technical expert and strategic leader, driving the development and application of advanced data science and mathematical solutions to address mission-critical challenges for Department of Defense (DoD) clients. You will lea

Full-time

Data & ML Engineer

Remote

•

Today

About Us Red Cell Partners is an incubation firm building and investing in rapidly scalable technology-led companies that are bringing revolutionary advancements to market in three distinct practice areas: healthcare, cyber, and national security. United by a shared sense of duty and deep belief in the power of innovation, Red Cell is developing powerful tools and solutions to address our Nation's most pressing problems. ABOUT DEFCON AI RESILIENCE IN THE FACE OF DISRUPTION. DEFCON AI is an in

Full-time

USD 150,000.00 - 200,000.00 per year

Manager, Data Science (Personalization & Recommendation Systems) (Remote)

Remote or Menomonee Falls, Wisconsin

•

Today

Role Specific Information Job Description About the Role As Manager, Data Science, you will manage a data science team and work with cross-functional partners to solve business challenges and promote data-driven decision-making with advanced data analysis and machine learning. What You'll Do Attract, retain, develop, manage, coach and assess data scientists in a balanced teamWork with product, engineering and design leads and leverage data-driven insights to make decisions, set goals, priori

Full-time

Palantir Data Pipeline & Metadata Lead

Remote or McLean, Virginia

•

Today

Job Family: Data Science & Analysis Travel Required: Up to 10% Clearance Required: Ability to Obtain Public Trust What You Will Do: This role serves as a senior technical leader responsible for establishing and scaling the data pipeline and metadata foundation that enables enterprise analytics, AI-driven capabilities, and system integration. The ideal candidate combines deep, demonstrable Palantir (including AIP) expertise, strong data architecture and governance experience, and the ability

Full-time

USD 113,000.00 - 188,000.00 per year

Architect ML - AI Researcher

Remote

•

Today

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi! About Quantiphi: Quantiphi is an award-winning, AI-First digital engineering and con

Full-time

Applied AI Engineer, Federal - Top Secret Clearance

Remote or New York, New York

•

Today

About Snorkel At Snorkel, we believe meaningful AI doesn't start with the model, it starts with the data. We're on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high perform

Full-time

USD 170,000.00 - 300,000.00 per year

Data Engineer

Remote

•

Today

Must possess a Master's degree from a top 20 national university. Rope test Core Skills AzureDatabricksPythonSQLSparkBackend API DevelopmentRequirements 5-7+ years of professional experienceMinimum 2-3 years of industry experience outside of graduate studies

Easy Apply

Contract, Third Party

Depends on Experience

Lead Data Engineer

Remote

•

Today

Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own. We have a flexible work environment, and fluid career paths. We not only encourage but celebrate internal mobility. We also recognize the importance of purpose, well-being, and work-life balance. Within Empower and our communities, we work hard to create a welcoming and inclusive environment, and our associates dedicate thousands of hours to volunteerin

Full-time

USD 125,400.00 - 181,875.00 per year

AIML Engineer

Remote or Hybrid in Texas City, Texas

•

Today

Senior AI/ML EngineerExperience: 12+ YearsJob DescriptionWe are looking for an experienced AI/ML Engineer with 12+ years of experience in software engineering, machine learning, artificial intelligence, and data-driven application development. The ideal candidate should have strong hands-on experience with Python, machine learning algorithms, deep learning, NLP, generative AI, and cloud-based ML solutions. The candidate will be responsible for developing, deploying, and maintaining machine learn

Easy Apply

Contract

60 - 65

Principal Data Engineer - AI

Remote or Pennsylvania

•

Today

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market. What unites Anaplanners across teams and geographies is our collective commitment to our customers' success and to our Winning Culture. Our customers rank among the who's who in the Fortune 50. Coca-Cola, LinkedIn, Adobe, LVMH and Bayer are just a few of the 2,400+ global comp

Full-time

Lead Software Engineer - Remote

Remote or Eden Prairie, Minnesota

•

Today

Optum Insight is improving the flow of health data and information to create a more connected system. We remove friction and drive alignment between care providers and payers, and ultimately consumers. Our deep expertise in the industry and innovative technology empower us to help organizations reduce costs while improving risk management, quality and revenue growth. Ready to help us deliver results that improve lives? Join us to start Caring. Connecting. Growing together. We are seeking a Lead

Full-time

USD 112,700.00 - 193,200.00 per year

Apache spark jobs in Chicago, IL, USA