Apache Spark jobs in Chicago, IL

Remote

•

Yesterday

Position: System Development EngineerLocation: RemoteThe common nature of the work:Every one is a System Development Engineer (Contractor) position, Seattle-based, L5L6 equivalent, 1 opening each, sitting on the Region Flexibility Migration (RFM) team inside the clients Intelligent Cloud Hosting (ICON) organization. They all serve a single 2026 initiative: DRAM (memory) footprint reduction across the clients production service fleet essentially cost/efficiency and performance engineering, not n

Easy Apply

Contract

Depends on Experience

Solution Engineer

Remote

•

Today

Sigma's vision is to create an insight-driven world where people, organizations, and, ultimately, humanity are transformed for the better by data. At Sigma, we are building a cloud-native business intelligence platform that allows users to tap into their biggest databases hosted in the cloud and easily conduct ad hoc analysis to gain business insights in seconds. All without any SQL programming. We are growing the Solution Engineering team and are looking for a Solution Engineer who will help re

Full-time

Engineer II, Data

Remote

•

Today

Bellese is a mission-driven Digital Services Company committed to pioneering innovative technology solutions in civic healthcare. Our dedication lies in making a meaningful impact on public health outcomes. Driven by service design, we strive to know the "Why" to understand the healthcare journey for patients, caregivers, providers, payers, and policymakers. Our goal is to design and build solutions that reduce confusion, provide clarity, support decision making, and streamline the process so th

Full-time

USD 108,700.00 - 125,300.00 per year

Professional Services Engineer

Remote

•

Today

Who we are: BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and AI data management. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data. We are building a global team passionate about innovation and next-gen technology. BigID has been recognized for: BigID named one of Forbes America's B

Full-time

USD 90,000.00 - 110,000.00 per year

Senior Data Engineer II, AI Native

Remote

•

Today

About Life360 Life360's mission is to keep people close to the ones they love. Our category-leading mobile app, Tile tracking devices, and Pet GPS tracker empower members to protect the people, pets, and things they care about most with a range of services, including location sharing, safe driver reports, and crash detection with emergency dispatch. Life360 serves approximately 102.4 million monthly active users (MAU), as of June 30, 2026, across more than 180 countries. Life360 delivers peace

Full-time

USD 148,000.00 - 216,500.00 per year

Staff Software Engineer, Backend (Online Storage)

Remote

•

Today

Affirm is reinventing credit to make it more honest and friendly, giving consumers the flexibility to buy now and pay later without any hidden fees or compounding interest. The Data and Storage Services team is responsible for Affirm's data infrastructure across OLTP and OLAP systems, spanning critical online checkout databases, batch orchestration, streaming infrastructure, event-driven frameworks, BI, analytics tooling, large-scale data platforms, and agentic data tools such as semantic layer

Full-time

USD 230,000.00 - 290,000.00 per year

Sr Manager IC, Merchant & Advertiser Data Marts - Analytics Team (Remote-Eligible)

Remote or McLean, Virginia

•

Today

Sr Manager IC, Merchant & Advertiser Data Marts - Analytics Team (Remote-Eligible) The role Own the platform substrate behind Capital One Shopping's merchant and advertiser data - the marts that power Retail Media, advertiser reporting, revenue attribution, and every marketing measurement in the business. You set the standards (reference architecture, catalog, access policy, GDPR/audit guarantees) that downstream product teams build on. This is an own-and-build role, not a maintenance seat : you

Full-time

USD 209,000.00 - 238,500.00 per year

Senior AI Platform Engineer

Remote

•

Today

Who We Are: Alpaca is a US-headquartered, global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24/5 trading, and more. Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 10 million brokerage accounts. Our gl

Full-time

Manager, Data Engineer (Remote)

Remote or Raleigh, North Carolina

•

Today

With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility . Job Summary Strategic Analytics at Arch is a growing team at the forefront of the company's AI transformation. We design and deploy agentic AI systems and predictive analytics, supported by AI-ready da

Full-time

USD 100,500.00 - 174,000.00 per year

Senior Solutions Architect - AI/ML - Services Delivery

Remote or North Carolina

•

Today

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset - who ra

Full-time

USD 160,000.00 - 210,000.00 per year

Databricks developer

Remote

•

2d ago

Required Skills 10+ years of experience with Databricks. Strong experience in PySpark, Spark SQL, and Python. Hands-on experience with Delta Lake and Databricks Workflows. Strong SQL and data modeling skills. Experience with Azure Databricks or AWS Databricks. Knowledge of Azure Data Factory (ADF), ADLS Gen2, or AWS S3. Experience with Git, Azure DevOps, or Jenkins. Understanding of data warehousing concepts and ETL best practices. Preferred Skills Experience with Unity Catalog, MLflow, and Delt

Easy Apply

Contract

50+

Staff Platform Engineer

Remote or Florida

•

Today

We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health , you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger - helping to simplify health care one person, one family and one community at a time. Primary Job Responsibilities Define and drive the techn

Full-time

USD 118,450.00 - 236,900.00 per year

Lead AI/ML Engineer Remote Nationwide or Hybrid in MN/DC

Remote or Eden Prairie, Minnesota

•

Today

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health op

Full-time

USD 145,500.00 - 249,500.00 per year

Senior Staff Machine Learning Platform Engineer

Remote

•

Today

About Faire Faire is a technology wholesale platform built on the belief that the future is local. Independent retailers around the globe collectively represent a multi-hundred-billion-dollar wholesale market that has historically been fragmented and offline. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe. Picture your favorite boutique in town - we help them discover the best products from around the worl

Full-time

USD 295,000.00 - 405,500.00 per year

Senior Software Engineer, Strategy Research Analytics

Remote or Berkeley, California

•

Today

Voleon is a technology company that applies state-of-the-art AI and machine learning techniques to real-world problems in finance. For nearly two decades, we have led our industry and worked at the frontier of applying AI/ML to investment management. We have become a multibillion-dollar asset manager, and we have ambitious goals for the future. As a Senior Software Engineer in Strategy Research Analytics, you will lead the design, evolution, and long-term architecture of Voleon's analytics infr

Full-time

USD 200,000.00 - 255,000.00 per year

Software Engineer (L3) Data Substrate

Remote

•

Today

Who we are At Twilio, we're shaping the future of communications, all from the comfort of our homes. We deliver innovative solutions to hundreds of thousands of businesses and empower millions of developers worldwide to craft personalized customer experiences. Our dedication to remote-first work, and strong culture of connection and global inclusion means that no matter your location, you're part of a vibrant team with diverse experiences making a global impact each day. As we continue to revol

Full-time

USD 138,700.00 - 173,400.00 per year

Principal Machine Learning Engineer

Remote

•

11d ago

Job Summary: The Machine Learning Engineer will tackle challenging problems and create scalable machine learning systems and platforms that make an impact on millions of users. This role will work closely with business partners to provide machine intelligence driven solutions and products to simplify and enhance the customer experience and to automate core business processes. The Machine Learning Engineer will partner closely with Data Scientists, Applied Scientists, and Software Developers to e

Full-time

USD 205,000.00 - 230,000.00 per year

Senior Data Engineer (Contract)

Remote

•

Today

Senior Data Engineer Position Overview We are seeking a Senior Data Engineer for a long-term contract opportunity. This role will support a reporting and analytics team responsible for data used in digital administration, operational reporting, post-administration analysis, and leadership insights. The ideal candidate will have deep experience with complex SQL, Python, cloud data platforms, data quality engineering, and large-scale reporting datasets. This role is focused on ensuring that crit

Full-time

USD 80.00 - 90.00 per hour

Senior Data Engineer Con II

Remote or Illinois

•

Today

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Job Description Job Description Allstate's Data & Analytics Technology or

Full-time

USD 90,700.00 - 153,925.00 per year

Senior Manger, Data Engineering

Remote or Maitland, Florida

•

Today

The Senior Manager, Data Engineering leads a team of data engineers responsible for designing, building, and operating the scalable data pipelines, architectures, and platforms that power AssistRx's data-driven initiatives. This role blends hands-on technical leadership with people management, owning delivery across multiple concurrent client implementations and internal data programs. Partnering closely with product, analytics, engineering, and business stakeholders, the Senior Manager transla

Full-time

Apache Spark jobs in Chicago, IL, USA