Apache Spark Jobs in Chicago, IL

Refine Results
21 - 40 of 345 Jobs

Backend Developer

TEKsystems c/o Allegis Group

•

Chicago, Illinois, USA

Full-time

KEY RESPONSIBILITIES PIM System Management: Manage, maintain, and optimize the company's PIM system through configurations, low-coding and development work to ensure high performance and reliability. Platform development: Develop and maintain backend platforms that facilitate the integration of PIM data with ERP, CRM, and other internal and external systems that consume or produce product data. Data integration: Design, implement, and manage APIs for the PIM software and data pipelines to ensure
Posted 2 days ago | Updated 10 hours ago

Staff AI/ML Software Engineer

ServiceNow, Inc.

•

Remote or Chicago, Illinois, USA

Full-time

Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today - ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500 . Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But thi
Posted 27 days ago | Updated 1 hour ago

Senior Software Engineer

Skywaves MP LLC

•

Remote

Contract

This role contributes to the Engineering of large-scale solutions that enable client's business while supporting the strategic architectural vision leveraging AWS and AI to achieve quality, scalability, performance and function. Senior Software Engineer is an active member of a dynamic team looking to build Best in Class software. The ideal candidate for this role not only is able to produce high quality work quickly but also collaborates with others around them whenever possible, holding the te
Easy Apply
Posted 2 days ago

Data Architect V

Aditi Consulting

•

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d
Easy Apply
Posted 10 days ago | Updated 8 hours ago

Senior Manager, Data Engineering

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data E
Posted 36 days ago | Updated 1 hour ago

Azure Databricks Engineer

Aptino

•

Remote

Third Party, Contract

Job Description: We are seeking a skilled Platform Engineer with strong expertise in Azure, Databricks, and Snowflake. The ideal candidate will be responsible for configuring and maintaining platform components, ensuring governance alignment, optimizing performance, and evaluating new platform features to support data engineering and analytics initiatives. Key Responsibilities: Align platform configurations with data governance and compliance standards. Evaluate and implement enhancements and ne
Easy Apply
Posted 12 days ago | Updated 3 days ago

Senior AI/ML Engineer 1

Walgreens

•

Deerfield, Illinois, USA

Full-time

Job Description Job Summary Builds & maintains machine learning and big data production pipelines to support advanced analytics, data science, and AI/ML solutions. Identifies valuable internal and external data. Collaborates closely with data and ML scientists to define data for the design, development, and deployment of new solutions that support business priorities. Job Responsibilities Develops software that processes, stores and serves data and machine learning models for use by others.De
Posted 5 days ago | Updated 1 hour ago

Microsoft Fabric

Dyota Tech Solutions

•

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities
Easy Apply
Posted 16 days ago

Staff Data Scientist -- Direct Hire -- REMOTE Position (& Citizens ONLY)

Amtex Enterprises

•

Remote

Full-time

Staff Data Scientist Location: Remote- CST time working hours Salary: DOE QUALIFICATIONS: Master's or PhD degree in a machine learning/AI related field such as engineering, statistics, computer science, or physics 5+ years of industry experience in data science, data analytics, and machine learning in advertising domain Extensive experience in Real-Time Bidding (RTB) systems. Skilled in applying advanced data science methodologies to improve the efficiency, profitability, and competitiveness o
Easy Apply
Posted 18 days ago

ML Engineering Manager

United Airlines

•

Chicago, Illinois, USA

Full-time

Description Job overview and responsibilities The ML Engineering Manager is responsible to develop and program integrated software algorithms to structure, analyze and leverage data in systems applications. Develops and communicates statistical modeling techniques to develop and evaluate algorithms to improve product/system performance, quality, data management and accuracy. Completes programming and implements efficiencies, performs testing and debugging. Completes documentation and procedures
Posted 36 days ago | Updated 1 hour ago

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

•

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut
Easy Apply
Posted 4 days ago

Big Data Hadoop Engineer

Harvey Nash Inc.

•

Remote

Contract

We are seeking a Big Data Hadoop Engineer for one of our direct client & its a 100% remote opportunity, needing to work in PST time zone. Looking for candidates who can work only on W2 Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development4-5 years of programming experience in Python, Java, Scala, and SQL is must.Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase.Strong experience with REST API
Easy Apply
Posted 32 days ago | Updated 25 days ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Third Party, Contract

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 10 days ago

Lead Engineer Data Ops

United Airlines

•

Chicago, Illinois, USA

Full-time

Description Job overview and responsibilities The United Data Engineering team designs, develops and maintains massively scaling technology solutions that are brought to life with innovative architectures, data analytics and digital solutions. The Data Engineering team is building a modern data technology platform in the cloud with advanced DevOps and Machine Learning capabilities. The Data Engineering team at United Airlines is on a transformational journey to unlock the full potential of ente
Posted 10 days ago | Updated 1 hour ago

Principal Data Engineer II

Walgreens

•

Deerfield, Illinois, USA

Full-time

Job Description Job Summary: Implements data and analytics capabilities and platforms including the data management and integration capabilities, enterprise reference data, and analytics platforms across WBA. This position will play a key role in the design and implementation of new and existing platforms to drive and realize data strategy. Job Responsibility: Drives best practices for code quality, testing, and documentation within the data engineering team. Develops and leads the design, dev
Posted 1 hour ago

Data Engineer

Vaco by Highspring

•

Remote

Contract

Vaco is on the search for a key client as they build out their data engineering team. In this role,as a Data Engineer, your primary responsibility will be to lead the design, development, and implementation of data solutions while driving strategic initiatives across the enterprise. We are looking for a strong background with Azure Data Factory, Kafka, Snowflake, SQL and ETL processes. You will assist with data warehousing architecture design and strategies for data replication, governance, obse
Easy Apply
Posted 9 days ago | Updated 2 days ago

Druid Engineer

Biztec Global LLC

•

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in
Easy Apply
Posted 3 days ago

Lead Engineer Wealth Mgmt Client 360

Northern Trust

•

Remote or Chicago, Illinois, USA

Full-time

About Northern Trust: Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. Northern Trust is proud to provide innovative financial services and guidance to the world's most successful individuals, families, and institutions by remaining true to our enduring principles of service, expertise, and integrity. With more than 130 years of financial experience and over 22,000 partners, we serve the world'
Posted 60+ days ago | Updated 1 hour ago

Databricks Engineer

Showman Staffing

•

Remote

Contract

Job Title: Databricks Engineer Location: Remote - US Job Type: Contract 6 + Months Experience Level: 7+ yrs About the Role We are seeking a highly skilled Databricks Engineer to join our growing data team. You will play a key role in building and optimizing our big data pipelines, implementing scalable data solutions, and collaborating with cross-functional teams to unlock insights from large datasets using Databricks, Apache Spark, and Azure/AWS cloud technologies. Key Responsibilities Des
Easy Apply
Posted 3 days ago

Senior AI/ML Engineer

Walgreens

•

Deerfield, Illinois, USA

Full-time

Job Description As a Senior Machine Learning Engineer, you will design, develop and deploy machine learning solutions to solve complex problems and integrate them into software systems. You will be involved in translating AI model prototypes into scalable and production ready machine learning systems. You will collaborate closely with engineering, product, data science and operations teams to deliver solutions and monitor the performance of deployed models. Job Responsibilities Develops softwa
Posted 60+ days ago | Updated 1 hour ago