apache spark Jobs in chicago, il

Refine Results
21 - 40 of 366 Jobs

Data Architect V

Aditi Consulting

•

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d
Easy Apply
Posted 7 days ago | Updated moments ago

Senior Manager, Data Engineering

Capital One

•

Chicago, Illinois, USA

Full-time

Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data E
Posted 6 days ago | Updated 1 hour ago

Cloud-Native Technical Product Manager

Trans Union LLC

•

Chicago, Illinois, USA

Full-time

TransUnion's Job Applicant Privacy Notice Personal Information We Collect Your Privacy Choices What We'll Bring: At TransUnion, we have a welcoming and energetic environment that encourages collaboration and innovation we're consistently exploring new technologies and tools to be agile. This environment gives our people the opportunity to hone current skills and build new capabilities, while discovering their genius. Come be a part of our team - you'll work with great people, pioneering produc
Posted 56 days ago | Updated 2 hours ago

Azure Databricks Engineer

Aptino

•

Remote

Third Party, Contract

Job Description: We are seeking a skilled Platform Engineer with strong expertise in Azure, Databricks, and Snowflake. The ideal candidate will be responsible for configuring and maintaining platform components, ensuring governance alignment, optimizing performance, and evaluating new platform features to support data engineering and analytics initiatives. Key Responsibilities: Align platform configurations with data governance and compliance standards. Evaluate and implement enhancements and ne
Easy Apply
Posted 9 days ago | Updated 1 day ago

Backend Developer

TEKsystems c/o Allegis Group

•

Chicago, Illinois, USA

Full-time

KEY RESPONSIBILITIES PIM System Management: Manage, maintain, and optimize the company's PIM system through configurations, low-coding and development work to ensure high performance and reliability. Platform development: Develop and maintain backend platforms that facilitate the integration of PIM data with ERP, CRM, and other internal and external systems that consume or produce product data. Data integration: Design, implement, and manage APIs for the PIM software and data pipelines to ensure
Posted 2 hours ago

Staff AI/ML Software Engineer

ServiceNow, Inc.

•

Remote or Chicago, Illinois, USA

Full-time

Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today - ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500 . Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But thi
Posted 24 days ago | Updated 5 hours ago

Microsoft Fabric

Dyota Tech Solutions

•

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities
Easy Apply
Posted 13 days ago

Staff Data Scientist -- Direct Hire -- REMOTE Position (& Citizens ONLY)

Amtex Enterprises

•

Remote

Full-time

Staff Data Scientist Location: Remote- CST time working hours Salary: DOE QUALIFICATIONS: Master's or PhD degree in a machine learning/AI related field such as engineering, statistics, computer science, or physics 5+ years of industry experience in data science, data analytics, and machine learning in advertising domain Extensive experience in Real-Time Bidding (RTB) systems. Skilled in applying advanced data science methodologies to improve the efficiency, profitability, and competitiveness o
Easy Apply
Posted 15 days ago

Sr. Data Engineer - REMOTE

SR Partners LLC

•

Remote or New York, New York, USA

Contract, Third Party

Role: Sr. Data Engineer Location: Remote Mandatory skills XML, JSON, Spark, Scala, Healthcare Domain Responsibilities: - 10+ years of experience in data engineering roles Strong hands-on experience with Python, PySpark, Spark SQL Expertise in processing EDI (837/835), HL7/CCDA, or FHIR bundles Proven ability to work with cloud-native data platforms (preferably Oracle Cloud Infrastructure (OCI)) Experience building data ingestion and transformation pipelines at scale. Experience in building meta
Easy Apply
Posted 19 hours ago

Senior AI/ML Engineer 1

Walgreens

•

Deerfield, Illinois, USA

Full-time

Job Description Job Summary Builds & maintains machine learning and big data production pipelines to support advanced analytics, data science, and AI/ML solutions. Identifies valuable internal and external data. Collaborates closely with data and ML scientists to define data for the design, development, and deployment of new solutions that support business priorities. Job Responsibilities Develops software that processes, stores and serves data and machine learning models for use by others.De
Posted 2 days ago | Updated 5 hours ago

Big Data Hadoop Engineer

Harvey Nash Inc.

•

Remote

Contract

We are seeking a Big Data Hadoop Engineer for one of our direct client & its a 100% remote opportunity, needing to work in PST time zone. Looking for candidates who can work only on W2 Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development4-5 years of programming experience in Python, Java, Scala, and SQL is must.Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase.Strong experience with REST API
Easy Apply
Posted 29 days ago | Updated 22 days ago

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

•

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut
Easy Apply
Posted 1 day ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Third Party, Contract

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 7 days ago

ML Engineering Manager

United Airlines

•

Chicago, Illinois, USA

Full-time

Description Job overview and responsibilities The ML Engineering Manager is responsible to develop and program integrated software algorithms to structure, analyze and leverage data in systems applications. Develops and communicates statistical modeling techniques to develop and evaluate algorithms to improve product/system performance, quality, data management and accuracy. Completes programming and implements efficiencies, performs testing and debugging. Completes documentation and procedures
Posted 33 days ago | Updated 5 hours ago

Data Engineer

Vaco by Highspring

•

Remote

Contract

Vaco is on the search for a key client as they build out their data engineering team. In this role,as a Data Engineer, your primary responsibility will be to lead the design, development, and implementation of data solutions while driving strategic initiatives across the enterprise. We are looking for a strong background with Azure Data Factory, Kafka, Snowflake, SQL and ETL processes. You will assist with data warehousing architecture design and strategies for data replication, governance, obse
Easy Apply
Posted 6 days ago | Updated 9 hours ago

Druid Engineer

Biztec Global LLC

•

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in
Easy Apply
Posted 20 hours ago

Lead Engineer Data Ops

United Airlines

•

Chicago, Illinois, USA

Full-time

Description Job overview and responsibilities The United Data Engineering team designs, develops and maintains massively scaling technology solutions that are brought to life with innovative architectures, data analytics and digital solutions. The Data Engineering team is building a modern data technology platform in the cloud with advanced DevOps and Machine Learning capabilities. The Data Engineering team at United Airlines is on a transformational journey to unlock the full potential of ente
Posted 7 days ago | Updated 5 hours ago

Databricks Engineer

Showman Staffing

•

Remote

Contract

Job Title: Databricks Engineer Location: Remote - US Job Type: Contract 6 + Months Experience Level: 7+ yrs About the Role We are seeking a highly skilled Databricks Engineer to join our growing data team. You will play a key role in building and optimizing our big data pipelines, implementing scalable data solutions, and collaborating with cross-functional teams to unlock insights from large datasets using Databricks, Apache Spark, and Azure/AWS cloud technologies. Key Responsibilities Des
Easy Apply
Posted 19 hours ago

Lead Engineer Wealth Mgmt Client 360

Northern Trust

•

Remote or Chicago, Illinois, USA

Full-time

About Northern Trust: Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. Northern Trust is proud to provide innovative financial services and guidance to the world's most successful individuals, families, and institutions by remaining true to our enduring principles of service, expertise, and integrity. With more than 130 years of financial experience and over 22,000 partners, we serve the world'
Posted 60+ days ago | Updated 4 hours ago

Senior AI/ML Engineer

Walgreens

•

Deerfield, Illinois, USA

Full-time

Job Description As a Senior Machine Learning Engineer, you will design, develop and deploy machine learning solutions to solve complex problems and integrate them into software systems. You will be involved in translating AI model prototypes into scalable and production ready machine learning systems. You will collaborate closely with engineering, product, data science and operations teams to deliver solutions and monitor the performance of deployed models. Job Responsibilities Develops softwa
Posted 60+ days ago | Updated 5 hours ago