Apache spark jobs in chicago, il

Databricks Azure Consultant with Apache Spark- Onsite NJ- and - no corps

Remote or Jersey City, New Jersey

•

Today

Please contact Renu Goel Location: NJ - No corps Must Haves: -Azure -Databricks -Apache Spark -CI/CD Databricks / Azure Consultant Job Summary Seeking two experienced Databricks / Azure Consultants to support the design, implementation, and ongoing development of the Databricks data platform. The consultants will work with technology and data teams to build and enhance scalable data solutions using Databricks and Microsoft Azure, with a strong focus on data engineering, integration, securit

Easy Apply

Full-time

Competitive

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Lead Java Engineer

Hybrid in Chicago, Illinois

•

17d ago

Role Overview We are looking for a Lead Java Engineer to support the development of scalable data and analytics platforms. This role requires strong technical leadership, stakeholder communication, and coordination across onshore/offshore teams. The ideal candidate will have hands-on expertise in Java, Spark, and Google Cloud Platform, with experience working with large financial datasets and distributed databases such as Spanner. Full-stack exposure is a plus. Key Responsibilities Design and de

Easy Apply

Full-time

$140,000 - $160,000

Lead AI Engineer with Spark, AWS Services

Remote

•

Today

We're looking for a Lead AI Engineer skilled in Spark and AWS Services to become part of the RBQM Production Pod within the program. In this position, you'll construct and sustain data pipelines that drive AI/GenAI applications supporting Risk-Based Quality Management for clinical trials. The primary focus of this role includes RAG document ingestion, vector indexing, and developing data APIs for AI applications. Responsibilities Architect and construct RAG document ingestion pipelines (chunking

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Software Engineer/ AI Agents, Azure, Spark

Remote

•

Today

We are looking for an experienced Senior Data Software Engineer with strong hands-on expertise in Azure and the Spark ecosystem , primarily focused on building and maintaining data transformation pipelines. The candidate should be comfortable with any Spark-adjacent technology (PySpark, Spark SQL, Scala Spark, Databricks, Synapse, etc.) rather than being locked into one specific flavor. Experience with Microsoft Fabric is a strong plus but not a requirement. The ideal candidate combines great te

Full-time

Senior AI Engineer with Spark, AWS Services

Remote

•

Today

We are seeking a Senior AI Engineer with Spark and AWS Services expertise to join the RBQM Production Pod within the program. You will build and maintain data pipelines that power AI/GenAI applications for Risk-Based Quality Management in clinical trials. This role focuses on RAG document ingestion, vector indexing, and building data APIs for AI applications. Responsibilities Design and build RAG document ingestion pipelines (chunking, embedding, vector indexing) for clinical trial quality data

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Lead Software Engineer - DataBricks, Spark, Terraform

Chicago, Illinois

•

Today

Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within the Corporate - Employee Platforms, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across mult

Full-time

USD 137,750.00 - 185,000.00 per year

Lead Software Engineer - DataBricks, Spark, Terraform

Chicago, Illinois

•

24d ago

Full-time

Data Architect

Hybrid in Evanston, Illinois

•

30+d ago

Position: Databricks Architect / Architecture & Engineering Specialist Location: Evanston, IL Duration: Contract to Hire Job Summary: Required experience 6 7+ years of strong hands-on Databricks experienceApproximately 3+ years working in a Data Architect / technical architecture capacityMust remain hands-on technically this is not a high-level architecture/management roleExperience designing and implementing enterprise-scale cloud data platformsPharma/life sciences experience strongly preferre

Easy Apply

Contract

$75+

ERP Data Engineer with Healthcare System

Hybrid in Chicago, Illinois

•

Today

Job Title: ERP Data Engineer with Healthcare System Location: Chicago, IL / Minneapolis, MN Hybrid Duration: 12+ Months Skills Needed: ERP Data Engineer, Healthcare System, Workday, Infor, PeopleSoft Job Description Position Summary We are looking for a strong, hands-on Senior Data Engineer with solid experience working with ERP, financial/accounting, and healthcare/hospital management data. The ideal candidate should have strong data engineering skills and experience integrating complex data

Easy Apply

Contract, Third Party

$60 - $70

Senior Software Engineer I, Data Content

Chicago, Illinois

•

Today

Passionate about precision medicine and advancing the healthcare industry? Recent advancements in underlying technology have finally made it possible for AI to impact clinical care in a meaningful way. Tempus' proprietary platform connects an entire ecosystem of real-world evidence to deliver real-time, actionable insights to physicians, providing critical information about the right treatments for the right patients, at the right time. We are seeking a Senior Software Engineer to help design,

Full-time

USD 110,000.00 - 160,000.00 per year

Assistant Director of Engineering

Chicago, Illinois

•

Today

Job Description JOB SUMMARY Assists department head in managing budget, capital expenditures, preventative maintenance and energy conservation. Accountable for maintaining the building and grounds with particular attention towards safety, security and asset protection. Assigns, tracks and follows up on status of work assigned to staff and contractors. Helps increase guest and employee satisfaction through effective communications and training. CANDIDATE PROFILE Education and Experience High s

Full-time

USD 89,000.00 - 121,000.00 per year

Watsonx.data Consultant with Spark and scala experience

Remote

•

28d ago

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Third Party, Contract

Depends on Experience

Senior Associate Engineer - Mechanical

Chicago, Illinois

•

Today

Build the future, spark innovation and align your career with purpose. McKinstry is innovating the waste and climate harm out of the built environment and creating lasting impact. Together, we're building a thriving planet. Buildings are a leading contributor to the climate crisis, generating nearly 40% of total global energy-related carbon emissions. We're making a lasting impact on our industry and within our communities by addressing the climate, affordability and equity crises through: ren

Full-time

USD 120,510.00 - 204,900.00 per year

Project Leader/Principal, Industrial Goods

Chicago, Illinois

•

9d ago

Locations : Chicago | Detroit | Minneapolis Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and h

Full-time

Compensation information provided in the description

Data Engineer

Chicago, Illinois

•

17d ago

We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets. Your Core Responsibilities: Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.) Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink) Collaborate with development teams on data modeli

Full-time

USD 175,000.00 - 225,000.00 per year

Apache spark jobs in Chicago, IL, USA