Apache Spark Jobs in Chicago, IL

Refine Results
301 - 320 of 364 Jobs

Data Architect/Modeler

Innova Solutions, Inc

•

Chicago, Illinois, USA

Contract

Innova Solutions is immediately hiring for an Data Architect( Data Modeling) Position: Data Architect( Data Modeling) Position Type: W2-Contract Hybrid: 3 Days Onsite and 2 Days remote Locations: Chicago, IL, Denver, CO and Washington, DC Main Skills: Data Architecture, Data Modeling, Informatica, Python, Business Intelligence, Tableau and Microstrategy. Job description: 3-5 years experience in relational and dimensional data modeling as well as metadata build and management.Hands on expertise i
Easy Apply
Posted 27 days ago

Data Engineer

Charter Solutions Inc.

•

Remote

Full-time

Data Engineer Information Technology Job Description: Data Engineer Data Engineer Roles and Responsibilities: Collect and process raw data at scale for a variety of projects and initiatives Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects Read, extract, transform, stage and load data to selected tools and frameworks as required and requested Perform tasks such as writing scripts, web scraping, calling API
Posted 60+ days ago | Updated 5 hours ago

MLOps Architect (Databricks Specialist)

Amiseq Inc.

•

Remote

Contract

Job Description: * 12+ years in IT experience with a minimum 10+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current know
Easy Apply
Posted 31 days ago | Updated 24 days ago

Triage Engineer

Stanley David and Associates

•

Remote or West Chester, Pennsylvania, USA

Full-time

Role :: Triage Engineer Location :: West Chester, PA Type :: Fulltime Job Description Job Title: Triage Engineer Must Have Technical/Functional Skills At least 8+ years of experience architecting and implementing complex ETL pipelines preferably with Spark toolset.At least 4+ years of experience with Java particularly within the data spaceTechnical expertise regarding data models, database design development, data mining and segmentation techniquesGood experience writing complex SQL and ETL pr
Easy Apply
Posted 6 days ago

Machine Learning AI Engineer

Buxton Consulting

•

Remote

Contract

Position: Machine Learning AI Engineer Duration: 12+ Months Location: Remote Must Haves Strong project experience in Machine Learning, Big Data, NLP, Deep Learning, RDBMS is must. Strong project experience with Amazon Web Services and Cloudera Data Platform is must. 4-5 experience building data pipelines using Python, MLLib, PyTorch, TensorFlow, Numpy/Scipy/Pandas, Spark, Hive, 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Strong experience with REST API
Easy Apply
Posted 20 hours ago

Big Data Developer

URSI Technologies Inc.

•

Remote

Third Party, Contract

Role : Big Data Developer (10+ exp needed) Location : Austin, Texas Duration: 12 Months Qualifications : Required SkillsShould be able to communicate effectively with business and other stakeholders bull Demonstrate ownership.Hands-on experience designing and implementing data applications in production using Java/ Python/ R and etc on big data platformExperience with related/complementary open source software platforms and languages such as Java, Linux, Apache, Open Street Map, D3.js and etcStr
Easy Apply
Posted 10 days ago | Updated 10 days ago

Full stack Engineer

Prism IT Corp

•

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex
Easy Apply
Posted 29 days ago | Updated 15 days ago

Azure Data Engineer Consultant

Korn Ferry

•

Remote

Contract

Job Summary: We are seeking a highly skilled Azure Data Engineering Consultant to join our data team and drive the development and optimization of enterprise-grade data solutions. The ideal candidate will have extensive experience in enterprise ETL, strong SQL skills, and a solid background in Azure-based data engineering. Proficiency in either Python or Spark SQL is essential to succeed in this role. Key Responsibilities: Design, develop, and optimize scalable ETL pipelines and data workflows
Easy Apply
Posted 9 days ago | Updated 1 hour ago

Confluent/Kafka Developer

Advanced Technology Group, Inc

•

Remote

Full-time

Job Description: What You ll NeedRequired:Bachelor's degree in Computer Science, Engineering, or a related fieldExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka real-time data streaming2+ years of experience with Confluent Platform and KafkaProficient in Java or other JVM languages (e.g., Scala, Kotlin)Experience with Kafka Connect, Kafka Streams, and ksqlDBStrong
Easy Apply
Posted 1 day ago

Data Engineer

Dahl Consulting

•

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,
Easy Apply
Posted 1 day ago

VDOT - Agentic Data Engineer

Inteliblue LLC

•

Remote or Richmond, Virginia, USA

Contract

Data Engineer- Immediate placement This is a very urgent requirement with immediate placement, please apply for immediate consideration. No H1b, No Sponsorship, And No C2C - only W2 or 1099 candidates Urgent Need -- - Required Locals (Richmond, Virginia) Job Title: Data Engineer Location: Richmond, Virginia Interview: Phone /In-Person Duration: Long Term Job description: Required Skills: Strong data engineering fundamentals. Experience with Big Data frameworks (Spark, Databricks). Prof
Easy Apply
Posted 16 hours ago

Google Cloud Platform Architect

Estuate Inc.

•

Remote

Third Party, Contract

Hi, We have a very urgent requirement for Google Cloud Platform Architect. Please let me know if you or someone you know is interested. Please see the job details below. Position: Google Cloud Platform Architect Location: Remote Deep experienced data engineer/architect. Review installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by . 4-5 weeks assessment and analysis/recommendations are the expected
Easy Apply
Posted 56 days ago | Updated 1 day ago

Senior Data Engineer with 15 years of experience-Santa Clara, CA, USA

Apton Inc

•

Remote or Santa Clara, California, USA

Full-time, Third Party

Role : Senior Data Engineer Duration: 12+monthsLocation: Santa Clara, CA-Hybrid RoleRemoteNeed minimum 15 years candidate with strong Data Migration ExperienceLinkedIn need to be before 2016 Job Description 8-12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at scale Proven in-depth experience in creating ELT/integrations p
Easy Apply
Posted 3 days ago | Updated 1 day ago

Palantir Foundry Developer / Data Engineer.

GreyMatter Solutions

•

Remote

Contract

Hello All, Hope you are doing well Looking for Palantir Foundry Developer / Data Engineer Location: [Insert Location or Remote] Experience: 3+ years (min. 1 year in Palantir Foundry) Type: [Full-time / Contract / Remote] Summary: Looking for a professional with hands-on experience in Palantir Foundry, used for data integration and analysis. The role involves building scalable data pipelines, transforming data from multiple sources, and delivering actionable insights. Must-Have Skills: Strong exp
Easy Apply
Posted 17 days ago | Updated 1 day ago

Machine Learning Engineer (Infrastructure)

Photon

•

Remote

Full-time

Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. For a brief 1 minute video about us, you can check Machine Learning Engineer (Infrastructure) Mountain View, CA Description: Experience in Machine Learning engineer or Infrastructure roles, with a focus on Machine Learning infras
Easy Apply
Posted 17 days ago | Updated 7 days ago

Backend Software Engineer, ML

Bayside Solutions

•

Remote

Contract

Backend Software Engineer, ML W2 Contract Salary Range: $135,200 - $156,000 per year Location: Remote Role - PST Job Summary: As a Backend Software Engineer, you will work with the engineering team, EPM, and customers to support customer migration to next-generation services that generate, manage, and consume datasets, features, and embeddings used for ML training. You will utilize tooling to migrate data and work with customers to change their Python clients to start using the new SDK. Thi
Easy Apply
Posted 22 days ago | Updated 1 hour ago

Lead Confluent/Kafka Engineer

RapidIT, Inc

•

Remote

Third Party, Contract

Position: Lead Confluent/Kafka Engineer Fully Remote 6+ months Required: Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.5+ years of experience with Confluent Platform and Kafka, including experience in designing and implementing large-scale data streaming solutionsExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka r
Easy Apply
Posted 1 day ago | Updated 22 hours ago

Python Developer (FULL TIME)

VKore Solutions LLC

•

US

Full-time

Role: Senior Python Developer Location: REMOTE Mode of Hire: Full Time Experience in implementing server-side technologies with RESTful APIs and MVC/MVT design patterns using Django/Flask frameworks. Experienced in MVW frameworks like Django, /Django and jQuery. Experienced in developing web-based applications using Python, Django, PHP, XML, CSS5, HTML, DHTML, JavaScript, RabbitMQ, Jdk1.7. Excellent Programming skills at a higher level of abstraction using Scala and Spark. Experience in pro
Easy Apply
Posted 2 days ago | Updated 16 hours ago

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

•

Remote

Contract

Job Title: Solution Architect with strong Kafka exp Location: Remote Duration: Long Term Contract Required Skills: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streami
Easy Apply
Posted 27 days ago | Updated moments ago

Data & BI Analytics Lead - P&C Insurance

Acunor Infotech

•

New Jersey, USA

Full-time

Ideal Profile: Education: Bachelor's or Master's degree in Data Science, Statistics, Mathematics, Economics, Computer Science, or a related field. An advanced degree is preferred. Experience: 10 - 15 years of experience in data analytics, with a strong focus on insurance analytics. Expertise in the Property & Casualty (P&C) domain is strongly preferred. Technical Skills: Strong in SQL, Python, Spark, and data pipeline architecture Deep understanding of cloud platforms (AWS, Azure, or Google Cl
Easy Apply
Posted 8 days ago | Updated 1 hour ago