Apache Spark Jobs in Chicago, IL

Refine Results
41 - 60 of 363 Jobs

Senior Manager, Data Engineering

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data En
Posted 3 days ago | Updated 5 hours ago

Senior Manager, Data Engineering

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data En
Posted 9 days ago | Updated 8 hours ago

Senior Lead Machine Learning Engineer

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You'll participate in the detailed technical design, development, and implementation of machine learning applications using existing and emerging technology platforms. You'll focus on machine learning architectural design, develop and review model and application code, and ensure high availability
Posted 9 days ago | Updated 18 hours ago

ML Data Infrastructure Engineer

DVARN

•

Remote

Contract

Role: ML Data Infrastructure Engineer Location: Sunnyvale, CA OPEN FOR 100% REMOTE Duration: 12 Months Candidates should have strong experience in Deep Leaning ML frameworks and model serving technologies which is lacking in most of the resumes. JD: 8+ years of software engineering experience, with 3+ years in ML serving/infrastructure\ Strong expertise in container orchestration (Kubernetes) and cloud platforms Experience with model serving technologies (TensorFlow Serving, Triton, KServe) Deep
Easy Apply
Posted 29 days ago

Sr. Big Data Developer - W2 Resource Only

Nasscomm, Inc.

•

Remote

Contract

Big Data Developer - Minimum 6 yrs of experience in Cloud, Big Data, Spark & Scala - Must have skill : Experience in Spark and Scala with exposure about cloud platforms ( AWS, Azure, Google Cloud Platform) for big data processing and storage - Strong experience in Azure DLS - Strong experience in Databricks, data pipelines - Experience in Hadoop seeking someone with strong backend development expertise, particularly in Java (Spring framework) - Agile delivery experience
Easy Apply
Posted 8 days ago | Updated 6 hours ago

Senior Data Engineer with Healthcare Domain

E-Solutions, Inc.

•

California, USA

Full-time

Hi Professionals, Title: AWS Data Engineer with Healthcare Domain Location: Remote Duration: Fulltime JD: Mandatory Skills :- AWS Databricks,PySpark or Spark, Data Pipeline,ETL ,SQL,Data Warehouse "Disclaimer: E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty,
Easy Apply
Posted 1 hour ago

Lead Healthcare Data Scientist with Azure

VLink Inc

•

Remote

Contract

Job Title: Lead Healthcare Data Scientist with Azure Location: Remote (EST Only) Employment Type: Contract Duration: 6 month initial contract About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our innovative team members have been solving the most complex business, and IT challenges of our global clients. Job Description: Lead Healthcare Data Scientist Key Skills: Healthcar
Easy Apply
Posted 6 hours ago

Found Engineer / AI / LLM /

Motion Recruitment Partners, LLC

•

Chicago, Illinois, USA

Full-time

A rapidly expanding Insurtech startup is seeking a highly-skilled, passionate and hands-on Founding Engineer to join the team. We're leveraging cutting-edge technologies to transform the insurance industry by streamlining processes, enhancing risk evaluation, and delivering personalized, faster, and smarter experiences for policyholders. Key Responsibilities: Full-Stack Development (35%): Build customer-facing applications across the frontend and backend using technologies such as React, Vue,
Easy Apply
Posted 36 days ago | Updated 7 hours ago

Principal ML OPS Engineer

ProHire Solution

•

Remote

Full-time

Job Location: 100% Remote (USA) Job Summary: We are looking for a seasoned Principal ML OPS Engineer to architect, build, and optimize ML inference platform. The role demands an individual with significant expertise in Machine Learning engineering and infrastructure, with an emphasis on building Machine Learning inference systems. Proven experience in building and scaling ML inference platforms in a production environment is crucial. This remote position calls for exceptional communication skil
Easy Apply
Posted 1 hour ago

Data Engineer 3- Chicago, IL or Reston, VA- ONSITE (4 days a week)

Comcast Corp

•

Chicago, Illinois, USA

Full-time

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we're making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. Job Summary We are seeking a Data Engineer - expertise in Looker, LookML, SQL, and API-driven data di
Posted 46 days ago | Updated 11 hours ago

Lead Engineer Wealth Mgmt Client 360

Northern Trust

•

Remote or Chicago, Illinois, USA

Full-time

About Northern Trust: Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. Northern Trust is proud to provide innovative financial services and guidance to the world's most successful individuals, families, and institutions by remaining true to our enduring principles of service, expertise, and integrity. With more than 130 years of financial experience and over 22,000 partners, we serve the world'
Posted 60+ days ago | Updated 10 hours ago

Data Engineer (Middle) ID35916

Agile Engine

•

Remote

Full-time

What you will do Build and support ETL pipelines;Monitor data pipelines, identify bottlenecks, optimize data processing and storage for performance and cost-effectiveness;Collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and business stakeholders;Working with Terraform to build AWS infrastructure;Analyze sources and build Cloud Data Warehouse and Data Lake solution.Must haves 3+ years of professional experience with Python;3+ years of pr
Easy Apply
Posted 3 days ago | Updated 3 days ago

VDOT - Agentic Data Engineer

Cyber Resource Provider LLC

•

Remote or Richmond, Virginia, USA

Full-time, Part-time, Contract, Third Party

Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction bet
Easy Apply
Posted 2 days ago | Updated 3 hours ago

Data Engineer III

Kforce Technology Staffing

•

Remote or Mountain View, California, USA

Contract

RESPONSIBILITIES: Kforce has a client in Mountain View, CA that is seeking a Data Engineer . Responsibilities: * Developing/refactoring/optimizing real time data processing applications using apache Flink * Developing/refactoring/optimizing batch data processing applications using apache spark * Migration of real time data pipelines to isolated kafka infrastructure and coordinate migration efforts with consumers * Operational monitoring and on-call support for business critical applications *
Posted 8 days ago | Updated moments ago

Senior Data Platform Engieer

Motion Recruitment Partners, LLC

•

Lake Forest, Illinois, USA

Full-time

We are looking for a Senior Data Engineer to join one of the 100 Best Companies to Work For, with offices in the Chicago suburbus as well as in the city. The role will be within their Data Engineering 'Center of Excellence' and will be able to impact and improve the way Data Engineering teams across the work. As a Senior Data Engineer, you will help the organization by using Python and Spark to build tools, frameworks, and services used across the organization to build better ETL/ELT services. Y
Easy Apply
Posted 9 days ago | Updated 7 hours ago

Data Engineer

Raas Infotek LLC

•

Remote

Contract

Position: Data Engineer Type: W2 Contract We re looking for a Data Engineer to design, build, and optimize data pipelines that support enterprise analytics and digital transformation initiatives. This role is ideal for someone who thrives in a fast-paced, data-driven environment and has a strong background in modern data engineering tools and cloud platforms.Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using modern data frameworks Collaborate with data analysts, ar
Easy Apply
Posted 6 hours ago

Sr. Lead Data Engineer/Architect

iTech US, Inc.

•

Remote

Contract

Having 10+ years of experience as a Data Engineer , Experience in Financial IndustryStrong experience in one of language: Snowflake,Java, Scala, Python, C#Strong experience with: HDFS, YARN, Hive, Spark, Kafka, (AWS), Docker / Kubernetes, Snowflake.Good working Knowledge in Data mining/programming tools (e.g. SAS, SQL, R, Python)5+ years of experience in Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)Experience in Amazon Web Services : VPC, S3, CloudFront, EC2, Lambda
Easy Apply
Posted 2 days ago | Updated 1 day ago

IT Developer Analyst- Virtual

Alight Solutions LLC

•

Remote or Lincolnshire, Illinois, USA

Full-time

Developer Analyst Are you a keen problem solver? Amazing Opportunity and Great Place to Work! Our Story At Alight, we believe a company's success starts with its people. At our core, we Champion People, help our colleagues Grow with Purpose and true to our name we encourage colleagues to "Be Alight." Our Values Champion People - be empathetic and help create a place where everyone belongs. Grow with purpose - be inspired by our higher calling of improving lives. Be Alight - act with integr
Posted 4 days ago | Updated 11 hours ago

Senior AI/ML Engineer

Walgreens

•

Deerfield, Illinois, USA

Full-time

Job Description As a Senior Machine Learning Engineer, you will design, develop and deploy machine learning solutions to solve complex problems and integrate them into software systems. You will be involved in translating AI model prototypes into scalable and production ready machine learning systems. You will collaborate closely with engineering, product, data science and operations teams to deliver solutions and monitor the performance of deployed models. Job Responsibilities Develops softwa
Posted 21 days ago | Updated 11 hours ago

Senior Data Engineer, I

Abbvie

•

Remote or North Chicago, Illinois, USA

Full-time

Company Description AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas - immunology, oncology, neuroscience, and eye care - and products and services in our Allergan Aesthetics portfolio. For more information about AbbVie, please visit us at Follow @abbvie on X, Facebook, Instagram, YouTub
Posted 23 hours ago | Updated 10 hours ago