Apache Spark Jobs in Chicago, IL

Refine Results
301 - 320 of 348 Jobs

Technical Architect

MSquare Systems Inc.

Remote

Full-time

Key Responsibilities: Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure) Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc. Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGaps Optimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environments Collaborate with sales teams to understand client needs and

Databricks Engineer

Oscar Technology

Remote

Full-time

Job Title: Databricks Engineer - Remote Location: Remote Job Type: Full-Time Experience Level: Mid to Senior (5+ years) About the Role: We are seeking a skilled and experienced Databricks Engineer with a strong background in both Azure and AWS cloud platforms. As a key member of our Data Engineering team, you will design, develop, and optimize scalable data solutions using Apache Spark on Databricks, enabling advanced analytics and data-driven decision-making across the organization. This is

Databricks Engineer

Xyant Services, Inc.

Remote

Contract

Lead Databricks Engineer Role SummaryArchitecture & Engineering Leadership:Leads the end-to-end architecture, design, and implementation of big data pipelines on Databricks Lakehouse Platform, integrating with Azure, AWS, or Google Cloud Platform. Data Pipeline & ETL Expertise:Develops scalable, high-performance ETL/ELT pipelines using PySpark, Delta Lake, and SQL, enabling real-time and batch processing of large datasets. Team & Project Oversight:Mentors junior engineers, drives Agile delivery,

Data Engineer

7hillsTS

Remote

Contract, Third Party

Job Title: Data Engineer Location: Remote Experience: 6+ years Job Description: We are seeking a skilled Data Engineer to build and optimize data pipelines and architectures for analytics and operational use. The ideal candidate will be experienced in data integration, transformation, and modeling using modern big data and cloud technologies. Key Responsibilities: Design, build, and maintain scalable data pipelines.Develop ETL/ELT processes to ingest data from various sources.Work with structur

ML Ops Engineer (AWS GovCloud Databricks) - Remote - W2 only

Saksoft

Remote

Contract

Position: ML Ops Engineer (AWS GovCloud Databricks) Duration: 12+ months contract Location: Charlotte, NC (100% remote) JOB DESCRIPTION SKILLS NEEDED : Bachelor's degree in computer science, Engineering, Applied Mathematics or related field4 to 6 years of strong experience with AWS Gov Cloud environments, Export Control FedRAMP environmentsOverall 8 to 10 years of solid experience in the areas of data engineering, machine learning data science4 to 6 years of strong experience with the following

Program Manager

Tektend llc

Remote or New York, New York, USA

Contract, Third Party

Job Title: Program Manager Location: Remote Duration: 12+ Months Key Skills & Qualifications: Experience: 7+ years of experience in program management, with at least 3-5 years focused on digital transformation, cloud data platforms, and data analytics initiatives. Expertise in Databricks: Strong hands-on experience with Databricks platform, including but not limited to data engineering, machine learning workflows, and data science pipelines. Data Analytics: Solid understanding of data analytics

asp.net developer

HCL America Inc.

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 218,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. ( ) The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version

Full Stack Developer - REMOTE

Contract Staffing Recruiters

Remote

Contract

The Opportunity: We are seeking a full stack engineer/developer with experience in projects emphasizing big data and application migration. This person will be responsible for supporting our customers migration of hundreds of applications to Databricks including authentication, rewiring of connections, building new libraries, and adapting notebooks and code. Work with the Business Intelligence team and operational stakeholders to design and implement migration strategy of read only and transact

Data Infrastructure Engineer

Bayside Solutions

Remote

Contract

Data Infrastructure Engineer W2 Contract Salary Range: $124,800 - $145,600 per year Location: Remote Role - PST Job Summary: We require a Data Infrastructure Engineer with strong expertise in distributed systems, API development, and software engineering. This role requires hands-on experience building distributed applications in Scala and Kubernetes. Duties and Responsibilities: Develop and maintain a batch orchestration platform that runs 100,000+ jobs per day Develop migration tooling t

Google Cloud Engineer/Google Cloud Platform Data Engineer

Zenosys

Remote

Contract, Third Party

Hello, Zenosys is looking for Google Cloud Platform Engineer client Remote Work If you are available and interested in the below opportunity, please send me updated resume. Thanks Job Title Google Cloud Platform Engineer Location- Remote Work Duration 6 weeks Contracts Highly Chance to Extend If you are interested, please provide the following details along with the updated resume to speed up the interview process. Full Legal Name as mentioned in Drivers' license: Current Location: Willing to

Databricks Data Engineer

HonorVet Technologies

Remote

Contract

Job Title: Databricks Data EngineerLocation: Remote Only W2()Job Description:The Databricks Data Engineer will play a critical role in accelerating data modernization efforts. Their expertise will support timely report conversion, improve data pipeline efficiency, and help ensure data integrity and accessibility across the organization. Databricks platform expertise (workspace management, clusters, job scheduling). Spark (PySpark/Scala) proficiency. SQL optimization and advanced querying skills.

Software Java backend Engineer

Marici Solutions

Remote

Contract

Title: Software Java backend Engineer Location: Remote Long Term Contract 3 round of video interview Mandatory Skills: Backend Java, microservices, Spring Boot, TDD, API, Multithreading Required skills: Spring, Spring Boot, SQL, Microservices, AWS, Backend Development, Kafka, TDD (Test Driven Development) KEY RESPONSIBILITIES Design and Development: o Design, develop, and maintain backend systems using Java (e.g., Spring, Hibernate), ensuring scalability, performance, and maintainability. o Crea

Data Engineer Microsoft Fabric

Kanini

Remote or Denver, Colorado, USA

Third Party, Contract

Job Title: Data Engineer Microsoft Fabric with Oracle Cloud Integration Location: Nashville TN Job Type: Long Term [Hybrid/ Onsite) Job Summary: We are looking for an experienced Data Engineer with strong expertise in Microsoft Fabric and proven skills integrating data from Oracle Cloud environments. The role involves designing and building scalable data pipelines, supporting data integration and modernization efforts, and ensuring smooth interoperability between Oracle Cloud and Azure-based an

Data Pipeline Engineer

LowCountry Staffing & Consulting

Remote

Full-time

This position is 100% remote. No travel required. Design, develop and maintain manageable and scalable data pipelines and ETL processes to support data acquisition, integration and delivery for upstream applications, analytics, and other data-driven initiatives Design and implement advanced data storage solutions (databases, data warehouses, and data lakes) and efficient data transport layers (REST API s, message queues, message buses) Collaborate with executive leadership, product owners, tech

Couchbase DBA - Spanish Native Speaker

Shimento, Inc.

Remote

Third Party, Contract

Couchbase DBA Location: - Mexico, California Contract Role Spanish language speaker Couchbase certification is a plus Job Description We are looking for an experienced Senior Database Administrator (DBA) with 9+ years of expertise in designing, managing, and optimizing large-scale, high-performance databases across cloud and on-premises environments. The ideal candidate will have deep DBA expertise in both SQL and NoSQL databases, with hands-on experience in Couchbase, PostgreSQL, MySQL, Oracle,

Microservices engineer- API / Security

HCL America Inc.

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 218,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. ( ) The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version

ML/ GEN AI - Python Developer

SANS

Remote

Contract

Job Title - MLOPs Developer Location - Remote Duration - 12+ Months Experience in developing code in Python and TypeScript is needed, with an understanding of Gen AI Job Summary: We are seeking an experienced AI/ML Developer to join our client team. The ideal candidate will create, code, deploy, optimize, and manage machine learning models and AI solutions hosted on the Azure platform. This includes integrating OpenAI models and interfaces as well as handling cutting-edge AI frameworks such as

AI/ML Developer

SANS

Remote

Full-time

Job Title - AI/ML Developer (No data Scientist- Its a developer role) Location - Remote Duration - 12+ Months 11+ years of experience required Experience in developing code in Python and TypeScript is needed, with an understanding of Gen AI Job Summary: We are seeking an experienced AI/ML Developer to join our client team. The ideal candidate will create, code, deploy, optimize, and manage machine learning models and AI solutions hosted on the Azure platform. This includes integrating OpenAI mod

AI/ML Engineer

Tech Brothers LLC

Remote

Full-time

Job Title: AI/ML EngineerLocation: Remote (USA)Pay Rate: Competitive | Based on USA Market StandardsEligible Visas: , Experience Required: Minimum 5+ Years in AI/ML Engineering About the Company Tech Brothers Info Services is a technology-driven company committed to delivering advanced digital solutions to businesses across the United States. We specialize in cutting-edge software, cloud transformation, and AI-powered applications that empower organizations to achieve smarter, faster, and more

Data Architect

NavaTech LLC

Maryland, USA

Third Party, Contract

Data Architect Remote Long Term Experience : Architect and lead implementation of Data platform self-service capabilities across ingestion, processing, storage, and consumption layers Drive adoption of modern data stack technologies and best practices (e.g., data lakehouse architecture). Partner with product managers, data scientists, analysts, and engineering teams to translate business needs into scalable technical solutions. Mentor data engineers and provide architectural oversight during d