apache spark Jobs in chicago, il

Refine Results
281 - 300 of 345 Jobs

Arity - Senior Data Engineer - Google Cloud Platform

Allstate Insurance Company

•

Remote

Full-time

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Job Description Founded by The Allstate Corporation in 2016, Arity is a da
Posted 60+ days ago | Updated 7 hours ago

Senior Full Stack Developer Lead - Inventory Management - JERSEY CITY

Citi

•

Remote or Jersey City, New Jersey, USA

Full-time

As part of the Inventory Management Applications Suite, Senior Application Developer is responsible for leading very high volume / low latency enterprise multi-tiered Java applications to provide cutting edge solutions for the Stock Record and related Application in the Capital Markets domain while following the industry best practices and Citi standards. The primary responsibility will be leading the design and development and providing Level 3 support for these applications. Coordination betwe
Posted 48 days ago | Updated 7 hours ago

(USA) Staff, Software Engineer

Walmart Inc.

•

Remote or Bentonville, Arkansas, USA

Full-time

Position Summary What you'll do We are seeking an experienced Staff Software Engineer to enhance our team capabilities on delivering key experiences for our Corporate Communication team. An ideal candidate is well versed in Full Stack technologies, collaborating closely with product managers and technical architects supporting our Corporate Communication business on providing the latest technologies and automations. Additionally, you will be responsible to lead and mentor the tech team through
Posted 46 days ago | Updated 7 hours ago

Senior Data Engineer

iSpace, Inc

•

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P
Easy Apply
Posted 60+ days ago | Updated 17 days ago

ML Engineer

VC5 Consulting

•

Bolingbrook, Illinois, USA

Contract

Machine Learning Engineer Contract to Hire Were working with an innovative retail brand thats transforming its customer experience through AI and machine learning. Theyre looking for a Machine Learning Engineer to join their team and help scale their personalization initiatives. In this role, youll work closely with data scientists and engineering teams to build and deploy models on modern cloud and data platforms. Youll need strong skills in: Python TensorFlow Spark Experience with GCP and
Easy Apply
Posted 38 days ago | Updated 2 days ago

Director of Java Kafka Software Engineering

Request Technology, LLC

•

Chicago, Illinois, USA

Full-time

We are unable to sponsor for this permanent full-time role Position is bonus eligible Prestigious Financial Institution is currently seeking a Director of Software Engineering with strong Java and Kafka experience. Candidate will be responsible for leading a team of skilled software engineers designing and delivering scalable and resilient hybrid and Cloud-based applications and data solutions supporting critical financial market clearing and risk activities; helping to drive the strategy of tra
Easy Apply
Posted 60+ days ago | Updated 30 days ago

Sr. Power BI Developer (with MS Fabric)

Resource 1

•

Chicago, Illinois, USA

Full-time

Resource 1 is seeking a highly skilled Sr. Power BI Engineer with strong experience in Microsoft Fabric to join a small, high-impact analytics team. This is a 6-month contract-for-hire position and candidates must currently be located in one of the following states: AZ, FL, IL, IN, KY, MI, MO, PA, or VA. Selected individual will be expected to travel to the Chicago office once a month or once every other month for meetings (client will pay travel expenses). This individual will be the primary Po
Easy Apply
Posted 60+ days ago | Updated 1 day ago

Lead Google Cloud Platform Data Engineer

Compugra Systems

•

Remote

Contract, Third Party

Urgent need Lead Google Cloud Platform Data Engineer with 20+ years experience Remote 6-12 months Expert in Google Cloud Platform deployments and Pipelines Orchestration and Python Data Pipelines - Optimization Skilled in Composer-managed dynamic Dataproc workflows Expert in Hadoop ecosystem and scheduling, Real-time analytics using Kafka and Spark streaming
Easy Apply
Posted 1 day ago

Azure Data Engineer (W2 -Only)

ClifyX

•

Remote

Contract

Hello, Greetings from Clifyx. Title: Azure Data EngineerRemote Job12+ Month Contract W2 -only Notes:- This is a remote position; however, attendance at the office will be required one day per week during the initial stages of the role. Job details7 years of exp in IT3 years of exp in :- Azure, Databricks, Pyspark/ Spark, SQL, Python. Thanks & Best Regards, Vishal Swami Clifyx (US IT Recruiter) Contact Number- LinkedIn: Headquarters: South Plainfield, NJ 07080
Easy Apply
Posted 2 days ago | Updated 2 days ago

Data Bricks Engineer-W2 only

Gemini Consulting Services

•

Remote

Contract

Hello , Hope you are doing well. Please find the below job opportunities with our client. Role: Data Bricks Engineer-W2 only# of Openings: 5 Location: 100% remote Duration: 3-6 months; possible extensions Interview: 2 rounds: Offer Key Skills: Databricks, Python, Apache Spark, Scala, Airflow Experience with Medallion and Lakehouse architecture Databrick Certified is preferred. Job Description: - Need for Databricks engineers to handle data migration tasks. - Integration of Azure OpenAI Service
Easy Apply
Posted 2 days ago | Updated 2 days ago

Pyspark

New Era Technology

•

Remote

Contract, Third Party

Hi, Looking for PySpark Consultant, If you are interested in applying kindly share me your updated resume to Location: Remote Duration: 6+months Note : Palantir Foundry platform is must At least 7 years of experience working with large scale software systems. Proficient in PySpark, Python, SQL with atleast 5 years of experience Working experience in Palantir Foundry platform is must Experience designing and implementing data analytics solutions on enterprise data platforms and distributed com
Easy Apply
Posted 18 days ago | Updated 18 days ago

Big Data Hadoop Engineer with Cloudera Distribution 7.x and Java

Buxton Consulting

•

Remote

Contract

Position: Big Data Hadoop Engineer with Cloudera Distribution 7.x and Java Location: Remote (PST Timing) Duration: 12+ Months (May extend till 48 months) Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development 4-5 years of programming experience in Python, Java, Scala, and SQL is must. Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase. Strong experience with REST API development using Python fra
Easy Apply
Posted 24 days ago | Updated 1 day ago

Hiring for Data Scientist :: Remote

Feuji Inc

•

Remote

Contract

Hi, This is Rehan from Feuji. I have below requirement with one of our client and if you are comfortable with the Job Description kindly share your updated resume with contact details. Data Scientist II/GenAI Remote C2H Required technical skills: Core Duties: Build models, Measure Impact, Prioritization/Optimization Required technical skills: SQL/Spark/Python/Data Science/ML Tools or platform experience requirements: SQL/Spark, Scala, Langchain Should you be interested, please send me a cop
Easy Apply
Posted 39 days ago | Updated 3 days ago

Data Architect with AWS, Databricks and Pyspark

E-Solutions, Inc.

•

California, USA

Full-time

Hi Professionals, Role Data Architect (Databricks) Duration: Fulltime Key Responsibilities: Solution Design & Implementation: Architecting and building scalable, secure, and high-performance data solutions on the Databricks platform using technologies like DLT Pipelines, Spark, Delta Lake, AI/BI Genie, etc. Data Pipeline Development: Designing and implementing end-to-end data pipelines, including ETL/ELT processes, for both batch and real-time data processing. Data Governance & Security: Defini
Easy Apply
Posted 2 days ago | Updated 1 day ago

Lead Azure Data Engineer(15 + Years Exp. Required)

GSPANN Technologies

•

Remote or Fremont, California, USA

Contract

About GSPANN Headquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high-technology, and manufacturing, we help our clients to transform and deliver business value by optimizing their IT capabilities, practices, and operations. Counting on our ten offices, including four global delivery centers, and approximately 1400 employees globally, we offer the intimacy of a
Easy Apply
Posted 12 days ago | Updated 10 days ago

Azure Data Solution Architect

RNR IT Solutions, Inc.

•

Remote or Little Elm, Texas, USA

Full-time

Job Title: Data Warehouse & Azure Data Architect / Principal Data Engineer Location: Remote 15+ years of experience in database architecture, data engineering, and analytics solutionsStrong expertise in Azure Data Platform: Azure Data Factory (ADF), Azure Databricks, Synapse Analytics, Azure Data Lake Storage, Event Hub, Azure Analysis Services, Power BI, Microsoft FabricProficient in Python, Spark SQL, T-SQL, and metadata-driven developmentExperience designing and implementing Data Vault 2.0,
Easy Apply
Posted 17 days ago | Updated 3 days ago

Resident Solution Architect

Cycle 3 IT Staffing

•

Remote

Contract

Cycle3 IT Staffing is seeking several Resident Solutions Architects who are SENIOR LEVEL for a REMOTE role. Architecting and Leadership: o Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh. Data Engineering: o Strong programming experience in Python; Scala is a significant plus. o Proficiency in complex query tuning. o Experience building Slowly Changing Dimensions (SCD) TYPEs. o Familiarity with DBT. o Experience with structured streaming
Easy Apply
Posted 5 days ago

Technical Architect

MSquare Systems Inc.

•

Remote

Full-time

Key Responsibilities: Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure) Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc. Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGaps Optimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environments Collaborate with sales teams to understand client needs and
Easy Apply
Posted 9 days ago

Databricks Engineer

Oscar Technology

•

Remote

Full-time

Job Title: Databricks Engineer - Remote Location: Remote Job Type: Full-Time Experience Level: Mid to Senior (5+ years) About the Role: We are seeking a skilled and experienced Databricks Engineer with a strong background in both Azure and AWS cloud platforms. As a key member of our Data Engineering team, you will design, develop, and optimize scalable data solutions using Apache Spark on Databricks, enabling advanced analytics and data-driven decision-making across the organization. This is
Easy Apply
Posted 9 days ago | Updated 8 hours ago

Databricks Engineer

Xyant Services, Inc.

•

Remote

Contract

Lead Databricks Engineer Role SummaryArchitecture & Engineering Leadership:Leads the end-to-end architecture, design, and implementation of big data pipelines on Databricks Lakehouse Platform, integrating with Azure, AWS, or Google Cloud Platform. Data Pipeline & ETL Expertise:Develops scalable, high-performance ETL/ELT pipelines using PySpark, Delta Lake, and SQL, enabling real-time and batch processing of large datasets. Team & Project Oversight:Mentors junior engineers, drives Agile delivery,
Easy Apply
Posted 2 days ago