apache spark Jobs in chicago, il

Refine Results
301 - 320 of 357 Jobs

Full stack Engineer

Prism IT Corp

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex

Azure Data Engineer Consultant

Korn Ferry

Remote

Contract

Job Summary: We are seeking a highly skilled Azure Data Engineering Consultant to join our data team and drive the development and optimization of enterprise-grade data solutions. The ideal candidate will have extensive experience in enterprise ETL, strong SQL skills, and a solid background in Azure-based data engineering. Proficiency in either Python or Spark SQL is essential to succeed in this role. Key Responsibilities: Design, develop, and optimize scalable ETL pipelines and data workflows

Azure Data Architect with MS Fabric - w2 role

Xyant Services, Inc.

Remote or Jersey City, New Jersey, USA

Contract

Job Description: We are seeking a highly experienced Data Engineering Lead/Architect with a strong background in SQL, Azure Data Services, and data modeling. The ideal candidate will possess a deep understanding of data warehousing, ETL/ELT processes, and big data technologies, and be capable of driving both the technical execution and team coordination in a fast-paced, dynamic environment.Key Responsibilities:Design, develop, and optimize complex SQL queries, dimensional data models, and schema

Data Engineer

Dahl Consulting

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,

Confluent/Kafka Developer

Advanced Technology Group, Inc

Remote

Full-time

Job Description: What You ll NeedRequired:Bachelor's degree in Computer Science, Engineering, or a related fieldExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka real-time data streaming2+ years of experience with Confluent Platform and KafkaProficient in Java or other JVM languages (e.g., Scala, Kotlin)Experience with Kafka Connect, Kafka Streams, and ksqlDBStrong

Google Cloud Platform Architect

Estuate Inc.

Remote

Third Party, Contract

Hi, We have a very urgent requirement for Google Cloud Platform Architect. Please let me know if you or someone you know is interested. Please see the job details below. Position: Google Cloud Platform Architect Location: Remote Deep experienced data engineer/architect. Review installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by . 4-5 weeks assessment and analysis/recommendations are the expected

Senior Data Engineer with 15 years of experience-Santa Clara, CA, USA

Apton Inc

Remote or Santa Clara, California, USA

Full-time, Third Party

Role : Senior Data Engineer Duration: 12+monthsLocation: Santa Clara, CA-Hybrid RoleRemoteNeed minimum 15 years candidate with strong Data Migration ExperienceLinkedIn need to be before 2016 Job Description 8-12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at scale Proven in-depth experience in creating ELT/integrations p

Palantir Foundry Developer / Data Engineer

GreyMatter Solutions

Remote

Contract

Hello All, Hope you are doing well Looking for Palantir Foundry Developer / Data Engineer Location: [Insert Location or Remote] Experience: 3+ years (min. 1 year in Palantir Foundry) Type: [Full-time / Contract / Remote] Summary: Looking for a professional with hands-on experience in Palantir Foundry, used for data integration and analysis. The role involves building scalable data pipelines, transforming data from multiple sources, and delivering actionable insights. Must-Have Skills: Strong exp

Machine Learning Engineer (Infrastructure)

Photon

Remote

Full-time

Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. For a brief 1 minute video about us, you can check Machine Learning Engineer (Infrastructure) Mountain View, CA Description: Experience in Machine Learning engineer or Infrastructure roles, with a focus on Machine Learning infras

Backend Software Engineer, ML

Bayside Solutions

Remote

Contract

Backend Software Engineer, ML W2 Contract Salary Range: $135,200 - $156,000 per year Location: Remote Role - PST Job Summary: As a Backend Software Engineer, you will work with the engineering team, EPM, and customers to support customer migration to next-generation services that generate, manage, and consume datasets, features, and embeddings used for ML training. You will utilize tooling to migrate data and work with customers to change their Python clients to start using the new SDK. Thi

Lead Confluent/Kafka Engineer

RapidIT, Inc

Remote

Contract, Third Party

Position: Lead Confluent/Kafka Engineer Fully Remote 6+ months Required: Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.5+ years of experience with Confluent Platform and Kafka, including experience in designing and implementing large-scale data streaming solutionsExperience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)Must have real-world experience setting up after Kafka r

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

Remote

Contract

Job Title: Solution Architect with strong Kafka exp Location: Remote Duration: Long Term Contract Required Skills: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streami

MLOps Engineer

Ethires LLC

Remote

Contract

Job Title: MLOps Engineer Location: Bellevue, WA (Remote Work: 100%) Remote: Work: 100% Contract : 5+ Months Contract This is a high PRIORITY requisition. This is a PROACTIVE requisition Job Description: MLOps Engineer to work on AWS GovCloud DatabricksBachelor s degree in computer science, Engineering, Applied Mathematics or related field4-6 years of strong experience with AWS Gov Cloud environments / Export Control / FedRAMP environmentsOverall, 8-10 years of solid experience in the areas of d

Data & BI Analytics Lead - P&C Insurance

Acunor Infotech

New Jersey, USA

Full-time

Ideal Profile: Education: Bachelor's or Master's degree in Data Science, Statistics, Mathematics, Economics, Computer Science, or a related field. An advanced degree is preferred. Experience: 10 - 15 years of experience in data analytics, with a strong focus on insurance analytics. Expertise in the Property & Casualty (P&C) domain is strongly preferred. Technical Skills: Strong in SQL, Python, Spark, and data pipeline architecture Deep understanding of cloud platforms (AWS, Azure, or Google Cl

Data Scientist

BEAT LLC

Remote

Full-time

Job Description:Security Clearance: Secret Required BEAT is seeking two highly skilled Data Scientists to join our team, preferably with Army and NATO sustainment process knowledge. These positions will require expertise in Army Vantage and MAVEN, as well as advanced skills in various data science tools and methodologies. The ideal candidates will work remotely, the role requires daily engagement with process owners in the G4 and other MSC G4s. Flexible hours is crucial for effective communicati

SQL Developer - 12+ Yrs Exp - Healthcare Domain must - REMOTE - Minneapolis, MN

Cynosure Technologies LLC

Remote

Contract

Job - SQL Developer - 12+ Yrs Exp - Healthcare Domain must REMOTE - Minneapolis, MN Mandatory Skills - SQL Server, Azure Devops Responsibilities: Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL. Work with structured and unstructured data to build scalable data solutions. Write efficient and scalable PySpark scripts for data transformation and processing. Optimize SQL queries, stored procedures, and indexing strategies to enhance performance. Design and implement data mod

Platform Engineer with Scala@Sunnyvale,CA Remote

iBrain Technologies Inc.

Remote or Sunnyvale, California, USA

Contract, Third Party

Data Platform Engineer with Scala Location: Sunnyvale, CA/Remote Contract 12 Months Exp : 10+ Years Job Description: We are looking for highly skilled Data Infrastructure Engineers with strong expertise in distributed systems, API development, and software engineering. The ideal candidates should have hands-on experience building distributed applications in Scala and Kubernetes. Key Responsibilities: Develop and maintain a batch orchestration platform which runs 100,000+ jobs per day Develo

Full Stack (Java/Python + React) - Remote - Fulltime

Lorven Technologies, Inc.

US

Full-time

Job Title:Full Stack (Java/Python + React) Location: Remote Employment Type: Fulltime Job description: UX prototyping contractors The Relevance team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make: Explore, shape, and develop new product experiences alongside engineers and product managers from the relevance team; from ideation to implementation Develop prototypes to iteratively validate ideas that push th

Confluent/Kafka Engineer

SGS Consulting

Remote

Full-time

Job Title Associate Confluent/Kafka Engineer Location Remote. Duration Contractual 06+ months ( Contact to hire opportunity) Note: Must complete the Associate Confluent/Kafka Engineer Assessment Responsibilities and Duties: Implement and maintain Kafka-based data streaming solutions based on provided designs and specifications.Contribute to the development of new features and improvements to the existing platform.Develop and maintain integrations with various applications and systems using Kafka

Confluent/Kafka Engineer

Dew Softech Inc

Remote or Pittsburgh, Pennsylvania, USA

Full-time, Part-time, Contract, Third Party

Confluent/Kafka Engineer Location : Remote Duration: 6 Months (CTH) Job Description We are looking for a Confluent/Kafka Engineer for a contract-to-hire opportunity that is fully remote. What You'll Do Implement and maintain Kafka-based data streaming solutions based on provided designs and specifications Contribute to the development of new features and improvements to the existing platform Develop and maintain integrations with various applications and systems using Kafka Connect Monitor a