python pyspark jobs in chicago, il

Data Engineer (ETL / Cloud Platforms) :: Need ,:: 65 on W2 no C2C no 1099 :: Chicago,IL and Richmond, VA

Chicago, Illinois

•

3d ago

Subject: Data Engineer (ETL / Cloud Platforms) Client: Capital one 65 hr W2 Vendor: Dexian *Must have financial background Job Title: Data Engineer (ETL / Cloud Platforms) Location: 2 days onsite in Richmond, VA LinkedIn: Must have 2 rounds video interview 12+ Months Contract Job Description: We are seeking a skilled Data Engineer with experience contributing to large-scale, federated data platforms. The ideal candidate will have hands-on expertise in building and maintaining ETL pipelines u

Easy Apply

Contract

$60 - $65

Principal Data Engineer / Financial Markets

Chicago, Illinois

•

Today

We're supporting a leading global investment bank known for private market advisory work. Over the last few years, they've invested heavily in data quality to improve their market perspectives. This company is located downtown in Chicago and is in the office Monday through Thursday. They are entertaining candidates who are currently in the Chicago area. This is the first in-house, Data Engineer who will own and modernize their internal data ecosystem. This will be a lead principal, as you are se

Easy Apply

Full-time

175k - 200k

Sr AWS Data Engineer

Remote

•

Today

AWS Data Engineer Duration: 3 months - possible of extension We are seeking an AWS Data Engineer with hands-on experience implementing Medallion Architecture (Bronze, Silver, Gold) using S3, Glue, Lake Formation, and Athena. The engineer will build scalable ETL workflows using Python, PySpark, and SQL, ensuring high-quality, governed data pipelines with schema evolution and CDC support. Responsibilities: Design, build, and maintain data pipelines across Bronze, Silver, and Gold layers. Develo

Easy Apply

Contract

Depends on Experience

AWS Data Engineer

Remote

•

Today

AWS Data Engineer Remote NJ State 6 Months contract Role Description: Responsible for implementing AWS Medallion Architecture (Bronze, Silver, Gold) using S3, Glue, Lake formation and Athena. Experience developing robust ETL transformations using Python, PySpark, and SQL with schema evolution and CDC handling.

Easy Apply

Contract, Third Party

Depends on Experience

Sr. AWS Data Engineer

Hybrid in Naperville, Illinois

•

Today

Resource 1 is in need of a Sr. AWS Data Engineer for a full-time/ permanent position with our client in Naperville, IL. This position will start off on a remote basis but will eventually transition to a hybrid schedule, working onsite in Naperville 2-3 days/week. Our client is an employee-owned company with excellent benefits, growth opportunities and profit-sharing bonus. This position is focused on building modern data pipelines, integrations and back-end data solutions. Selected individual wi

Easy Apply

Full-time

$120,000 - $130,000

ETL Data Quality Analyst

Remote

•

7d ago

Hi, Hope you are doing well. Position: SDET with Pyspark Coding Experience Location: Remote Job Description: Position Summary The SDET Software Development Engineer in Test is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as well as collaborating with data engineers and developers to identify and resolve data quality issues The ideal c

Easy Apply

Full-time

$40 - $50

Lead Data Engineer with Databricks and PySpark

Remote

•

Today

Greeting from Accionlabs; Job Title: Senior Data Engineer with Databricks and PySparkLocation: RemoteKey ResponsibilitiesDesign and implement scalable data processing pipelines using Databricksand PySpark.Develop and optimize ETL workflows for ingestion, transformation, and storage of large datasets.Collaborate with data architects and analysts to ensure data models and transformations align with business goals.Troubleshoot performance bottlenecks in data processing and improve runtime efficienc

Easy Apply

Contract, Third Party

65 - 75

Sr Lead, Software Engineering

Chicago, Illinois

•

6d ago

About Northern Trust: Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. Northern Trust is proud to provide innovative financial services and guidance to the world's most successful individuals, families, and institutions by remaining true to our enduring principles of service, expertise, and integrity. With more than 130 years of financial experience and over 22,000 partners, we serve the world's

Full-time

USD 114,500.00 - 194,700.00 per year

AWS Data Engineer - W2 role

Remote or McLean, Virginia

•

Today

We have 2 openings for this and urgently need candidates. Must be Cap One former Job Title Lead data engineer 6 month + extensions Remote Worksite Location 1680 Capital One Dr, Mclean, VA, 22102, USA or REMOTE Top Skills - Must Haves Python Sql Aws Data Etl Integration Big data Agile snowflake databricks EMR Glue Lambda cloudwatch S3 Top Skills' Details Discover's historical credit card data will be in the Capital One ecosystem in OneStream's OneLake location and these Engineering teams

Easy Apply

Third Party, Contract

Lead Databricks Engineeer

Remote

•

Today

Title: Lead data Engineer/Databricks Enginr Type: Remote role Job Description: The team is seeking a Data Engineer experienced in implementing modern data solutions in Azure, with strong hands-on skills in Databricks, Spark, Python, and cloud-based Data-Ops practices. The Data Engineer will analyze, design, and develop data products, pipelines, and information architecture deliverables, focusing on data as an enterprise asset. This role also supports cloud infrastructure automation and CI/CD us

Easy Apply

Third Party, Contract

Depends on Experience

Senior Azure Data Engineer with Power BI

Remote or Hybrid in Illinois

•

Today

Job Summary (List Format): - Role: Senior Azure Data Engineer with Power BI - Location: Chicago, IL (Hybrid/Remote) - Duration: Contract (C2C) - Total Experience Required: 10-12+ years Key Responsibilities: - Design, develop, and maintain data solutions using Azure cloud technologies (ADF, Synapse, Pyspark/Python) - Develop and implement ETL processes for data warehousing - Create and manage Power BI dashboards and reports - Understand and document design specifications and source-to-targe

Full-time, Part-time, Contract, Third Party

BI Analytics Developer (Databricks + Power BI)

Remote or Maryland

•

Today

BI Analytics Developer (Databricks + Power BI) Location: East Coast / Remote Specific Job Functions: We are seeking an experienced BI Analytics Developer with a strong background in building data products for the consumption layer. The ideal candidate will have hands-on experience with Databricks, Power BI, and Unity Catalog, and will be responsible for creating semantic models, enriching metadata, and mapping gold layer attributes to KPIs for advanced analytics and predictive dashboards. Ke

Easy Apply

Contract, Third Party

Healthcare Data Architect

Remote

•

Today

Data Architect- Healthcare Tentative Duration - 6 months+ Location - Remote / EST hours About the Role: The Data Architect is responsible for designing, building, and maintaining the data infrastructure and solutions that enable efficient and secure collection, storage, and analysis of healthcare data in different data platforms (Data Warehouse & Data Lake). This role involves in working range of stakeholders including business and IT teams to ensure data architecture support business needs w

Easy Apply

Third Party, Contract

Lead Data Engineer Palantir & PySpark (MUST)

Remote or New Jersey

•

11d ago

Lead Data Engineer Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference: Should be in the United States and from East coast. Experience: 8-15 Years Location : Remote Client Industry: Reinsurance / Insurance Lead Data engineer role where experience should be on both hands on and leading the team. Key Responsibilities: Hands-on Lead experience working in Reinsurance/ Insurance domain. Work within the Palantir Foun

Easy Apply

Full-time, Third Party, Contract

$Depending upon Experience

Data Architect / Payment / Banking Domain

Remote

•

Today

Data Solution Architect / Payment Duration: - 12 Months Location: - USA / Remote Qualifications: Position Summary As a Senior Solution Architect, you will design comprehensive data and analytics solutions leveraging cutting-edge technologies including Databricks, Collibra, and AWS. You will create reusable data management patterns and provide technical leadership to the data engineering team while collaborating across functional teams to deliver business value. Qualifications Bachelor's degree

Easy Apply

Contract

Depends on Experience

Sr. Data Pipeline Engineer

Remote

•

4d ago

Role: Sr. Data Pipeline Engineer Location: Remote Job Description: The Sr. Data Pipeline Engineer brings years of enterprise data engineering experience with deep proficiency in Databricks development using Python and SQL/PySpark, complemented by strong expertise across the Azure SQL Server ecosystem including Managed Instances, Azure SQL DB, and SQL Server VMs. They should demonstrate solid grounding in data modeling principles and ETL/ELT design patterns, with hands-on experience leveraging D

Easy Apply

Contract

$55 - $65

AI/ML Engineer

Remote or Aurora, Colorado

•

Today

RESPONSIBILITIES: Kforce has a client in Aurora, CO that is seeking an AI/ML Engineer who will act as a technical subject matter expert (SME) in Agentic AI, supporting the IT Director of Agentic AI. This role is critical for driving the adoption of Agentic AI across the company. The Engineer will co-develop advanced AI workflows and build custom Agentic AI platforms and applications at an enterprise level. Key Responsibilities: * Agentic AI Expertise: Design, build, and optimize AI Agents using

Full-time

$70,000 - $135,000 annually

Lead Software Engineer - Remote

Remote or Eden Prairie, Minnesota

•

Today

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health op

Full-time

USD 89,900.00 - 160,600.00 per year

Senior AI Infrastructure Engineer, AI Tooling - DGX Cloud

Remote or Santa Clara, California

•

Today

We are looking for a Senior AI Infrastructure Engineer (AI Tooling) to design and build the backend systems and infrastructure powering our internal AI tools and intelligent agents. This is a hands-on software engineering role with a strong infrastructure focus, ideal for someone who thrives at the intersection of backend development, systems engineering, and applied AI. You will contribute to building robust, scalable systems that support a wide range of applied AI initiatives. These may inclu

Full-time

USD 184,000.00 per year

Palantir Foundry Developer

Remote

•

Today

We are seeking a highly skilled Palantir Foundry Architect to design, implement, and optimize data solutions using Palantir Foundry. The ideal candidate will have deep expertise in data architecture, Integration, and governance, along with strong problem-solving skills to enable scalable and secure data ecosystems. Technical Expertise Proven experience with Palantir Foundry architecture and development. Strong understanding of data modeling, ETL processes, and distributed systems. Proficiency in

Easy Apply

Contract, Third Party

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

python pyspark jobs in Chicago, IL, USA