lead data engineer python/scala, spark, aws Jobs in chicago, il

Refine Results
1 - 20 of 56 Jobs

Founding Full Stack Engineer / AI / Python / Node.js / React / Fully Onsite Chicago Loop /

Motion Recruitment Partners, LLC

•

Chicago, Illinois, USA

Full-time

We're hiring a Founding Full Stack Engineer to join a fast-moving, AI-focused startup that's solving one of the toughest problems in enterprise tech: turning fragmented, messy business data into usable, actionable insights. This is a rare chance to shape an early-stage product, codebase, and team from the ground up-right alongside the technical founders. You'll work directly with a deeply technical, product-minded founding team using Node.js, React, Python, and Scala (Spark) to build clean, scal
Easy Apply
Posted 45 days ago | Updated 8 hours ago

Lead Engineer Data Ops

United Airlines

•

Chicago, Illinois, USA

Full-time

Description Job overview and responsibilities The United Data Engineering team designs, develops and maintains massively scaling technology solutions that are brought to life with innovative architectures, data analytics and digital solutions. The Data Engineering team is building a modern data technology platform in the cloud with advanced DevOps and Machine Learning capabilities. The Data Engineering team at United Airlines is on a transformational journey to unlock the full potential of ente
Posted 19 days ago | Updated 11 hours ago

Senior Manager, Data Engineering

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data E
Posted 13 days ago | Updated 3 hours ago

Senior Manager, Data Engineer (AWS)

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineer (AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data
Posted 7 days ago | Updated 3 hours ago

Senior Manager, Data Engineering

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data E
Posted 46 days ago | Updated 3 hours ago

Principal Data Engineer II

Walgreens

•

Deerfield, Illinois, USA

Full-time

Job Description Job Summary: Implements data and analytics capabilities and platforms including the data management and integration capabilities, enterprise reference data, and analytics platforms across WBA. This position will play a key role in the design and implementation of new and existing platforms to drive and realize data strategy. Job Responsibility: Drives best practices for code quality, testing, and documentation within the data engineering team. Develops and leads the design, dev
Posted 9 days ago | Updated 11 hours ago

Data Engineer - Scala

Exl Service

•

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des
Easy Apply
Posted 25 days ago | Updated 25 days ago

Druid Engineer

Biztec Global LLC

•

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in
Easy Apply
Posted 13 days ago

Data Engineer 3- Scala - Chicago, IL or Reston, VA- ONSITE (4 days a week)

Comcast Corp

•

Chicago, Illinois, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary We are seeking a Data Engineer to design, build, and optimize scalable, high-performance
Posted 60+ days ago | Updated 11 hours ago

Senior Manager, Data Engineering

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data E
Posted 60+ days ago | Updated 3 hours ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Contract, Third Party

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 20 days ago

Data Pipeline Engineer

LowCountry Staffing & Consulting

•

Remote

Full-time

This position is 100% remote. No travel required. Design, develop and maintain manageable and scalable data pipelines and ETL processes to support data acquisition, integration and delivery for upstream applications, analytics, and other data-driven initiatives Design and implement advanced data storage solutions (databases, data warehouses, and data lakes) and efficient data transport layers (REST API s, message queues, message buses) Collaborate with executive leadership, product owners, tech
Easy Apply
Posted 18 days ago

Jr. Data Sceintist - Remote

ConsultNet, LLC

•

Remote

Full-time

Title: Jr. Data Scientist Location : 100% Remote Target Start Date : ASAP Type: contract or CTH Pay Rate: DOE We're seeking a Junior Data Scientist who excels at building production-grade models, quantifying real-world impact, and optimizing data workflows. This role combines analytics with strategic collaboration to drive measurable business outcomes. Key Responsibilities Model Development & Deployment Work on the end-to-end lifecycle of predictive models-classification, regression, anomaly
Easy Apply
Posted 24 days ago | Updated 11 hours ago

Software Engineer

Splunk Inc.

•

North Carolina, USA

Full-time

Description Join us as we pursue our exciting new vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we're committed to our work, customers, having fun, and most importantly to each other's success. Learn more about Splunk careers and how you can become a part of our journey! You will be a part of Splunk's Analytics Engine Managem
Posted 29 days ago | Updated 11 hours ago

Software Engineer

Splunk Inc.

•

Colorado, USA

Full-time

Description Join us as we pursue our exciting new vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we're committed to our work, customers, having fun, and most importantly to each other's success. Learn more about Splunk careers and how you can become a part of our journey! You will be a part of Splunk's Analytics Engine Managem
Posted 30 days ago | Updated 11 hours ago

Databricks Engineer

Showman Staffing

•

Remote

Contract

Job Title: Databricks Engineer Location: Remote - US Job Type: Contract 6 + Months Experience Level: 7+ yrs About the Role We are seeking a highly skilled Databricks Engineer to join our growing data team. You will play a key role in building and optimizing our big data pipelines, implementing scalable data solutions, and collaborating with cross-functional teams to unlock insights from large datasets using Databricks, Apache Spark, and Azure/AWS cloud technologies. Key Responsibilities Des
Easy Apply
Posted 13 days ago | Updated 1 hour ago

Applications Development Senior Programmer Analyst

Citi

•

Remote or Tampa, Florida, USA

Full-time

Citibank, N.A. seeks an Applications Development Senior Programmer Analyst for its Tampa, FL location. Duties: Onboard applications in the Olympus Platform enabling controls and monitoring of platform stability. Involved in the design, implementation, and delivery of End-of-Day (EOD) Marker controls by building new connectors in Step Framework, implementing platform guidelines for platform migration, and automating outbound reports for onboarding. Support workflow for application users to make
Posted 23 days ago | Updated 11 hours ago

Senior Data Engineer (Remote)

First American Financial Corporation

•

Remote or Santa Ana, California, USA

Full-time

Who We Are Join a team that puts its People First! Since 1889, First American (NYSE: FAF) has held an unwavering belief in its people. They are passionate about what they do, and we are equally passionate about fostering an environment where all feel welcome, supported, and empowered to be innovative and reach their full potential. Our inclusive, people-first culture has earned our company numerous accolades, including being named to the Fortune 100 Best Companies to Work For list for ten conse
Posted 55 days ago | Updated 11 hours ago

Staff Software Engineer, Batch Processing Platform

Pinterest, Inc.

•

Remote or San Francisco, California, USA

Full-time

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility
Posted 60+ days ago | Updated 11 hours ago

Senior Machine Learning Engineer - ML Ops

Walgreens

•

Deerfield, Illinois, USA

Full-time

Job Description Job Summary : As a Senior Machine Learning Engineer, you will play a pivotal role in driving the development, deployment, and scaling of machine learning models and systems. You will be involved in complex machine learning initiatives, mentor junior and intermediate engineers, and collaborate closely with engineering, product, and data science teams. With your deep expertise in ML engineering and a focus on best practices, you'll ensure that our solutions are robust, scalable, a
Posted 60+ days ago | Updated 11 hours ago