apache spark Jobs in chicago, il

Refine Results
1 - 20 of 371 Jobs

Senior Data Engineer - Principal Associate (Spark, Scala, AWS)

Capital One

•

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Senior Data Engineer - Principal Associate (Spark, Scala, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who
Posted 43 days ago | Updated 3 hours ago

Lead Data Engineer (Scala programming, Spark, Azure Cloud)

BayOne Solutions

•

Remote

Contract, Third Party

Hi, This is Amin Shaikh and I represent BayOne Solutions. We have opening with our direct client for Senior Data Engineer for long term project with 100% remote work. Please go through the requirement and send me your updated resume Lead Data Engineer Location: (100% Remote) Duration: 6-12+ months The Opportunity: Technology Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scalab
Easy Apply
Posted 8 days ago

Urgent Need - Java Developer with AWS/Spark - Only 10+ Years resumes - Remote.

SRS Consulting Inc

•

Remote

Third Party, Contract

Role: Sr Java Developer with AWS/Spark. Location: Remote Duration: Long Term Qualifications 12 years developing large scale applicationsProven experience as a Java Backend Developer with successful project implementationsProficient in Java programming and server-side frameworks (e.g., Spring, Spring Boot)At least 3+ years of experience with Big Data & Analytics solutions Spark, Hadoop, MapReduce.At least 3+ years of experience working with AWS, Redshift, Kubernetes, Docker, and TerraformExperien
Easy Apply
Posted 12 days ago | Updated 12 days ago

Spark/ Scala Engineer

Aptino

•

Remote

Contract

Hands on experience Spark, Scala, Python Strong experience with big data methods and with retrieving data Perform detail exploratory data analysis various file formats (Parquet, AVRO, CSV, JSON). Build and enhance Spark-based frameworks Experience with Single Store, Snowflake, Kafka, Nifi and AWS big data technologies is good to have. Experience of architecting data using cloud technologies. Extensive Hands-on experience with Azure cloud services.
Easy Apply
Posted 46 days ago | Updated 2 days ago

Engineering Manager, Spark

Netflix, Inc.

•

Remote

Full-time

Netflix is one of the world's leading entertainment services with 278 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. The Role Big Data Analytics Platform (BDAP) group is responsible for providing orchestration and compute technologies to ETL and to access nearly 1 ExaByte of data in the Ne
Posted 32 days ago | Updated 3 hours ago

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

•

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data
Easy Apply
Posted 60+ days ago | Updated 24 days ago

Google Cloud Platform Data Engineer

Next Gen IT Inc

•

Bolingbrook, Illinois, USA

Full-time

Role: Google Cloud Platform Data EngineerHybrid - Bolingbrook, ILExp: 13+yrsExtensive Google Cloud Platform experience (3-5 years MINIMUIM)Google Cloud Platform (Google Cloud Platform) Dataflow, Dataproc, PubSub, DataProc, BigQuery, Cloud StorageREST API, microservicesDataProc SPARK Engine that Google providesExposure to KafkaExposure to real time ingestion frameworksBuilding data pipelinesKafka
Easy Apply
Posted 2 days ago

Google Cloud Platform Data Engineer || W2

Sibitalent Corp

•

Bolingbrook, Illinois, USA

Contract

Title: Google Cloud Platform Data Engineer Duration: 12+ months (Only W2 or Self corp) Location: Bolingbrook, IL (Hybrid 3 days every other week; 6 days a month) Job Description: Technical Requirements: Google Cloud Platform (Google Cloud Platform) Dataflow, Dataproc, PubSub, DataProc, BigQuery, Cloud StorageREST API, microservicesDataProc SPARK Engine that Google providesExposure to KafkaExposure to real time ingestion frameworksBuilding data pipelinesKafka
Easy Apply
Posted 3 days ago

Architect - Solution Architect - Hybrid

VIVA USA INC

•

Chicago, Illinois, USA

Contract

Title: Architect - Solution Architect - Hybrid Mandatory skills: Azure , Hadoop, Databricks, Control M Spark, SQL Server, Big Data Analytics Azure Services, Unix scripts, Java Description: Need to develop the code in Azure , Hadoop, Databricks, Control M, Spark, SQL Server, Big Data Analytics, Azure Services, Unix scripts, Java and Oracle Responsible for deployment of architectural aspects including hardware, software, security, messaging, work flow, interoperability, flexibility, reliability,
Easy Apply
Posted 47 days ago | Updated 15 days ago

Hadoop Developer

Collabera LLC

•

Chicago, Illinois, USA

Contract

Must Have: Hadoop/Big Data 8+yrs of Experience Distributed Systems 6+ years SQL - Dealing with large volumes of data, transformations, HIVE or Impala Coding experience with Python or PHP - Enhancements, new features, upgrades, maintenance (Python Scripting) backend/ middleware (Pyspark) Spark - Data cleansing, transformation and loading Testing - Creating unit tests, ensure testing is approved from stakeholders Work with Customers/ Stakeholders - Communication skills are key, client facing, inf
Easy Apply
Posted 4 days ago | Updated 1 day ago

Senior Data Analytics Manager

GlobalSource IT

•

Oak Brook, Illinois, USA

Full-time

We are hiring a Senior Data Analytics Manager to lead our Data Product team, bridging the gap between business needs and technology. As a leader in this organization, you will ensure that the business partners can easily understand, access, and utilize data. As a team, we work together onsite in Oak Brook, IL, Monday through Wednesday every week. This is critical to maintaining the balance between business and technical teams and building culture. We enjoy the work we do and the people we work w
Easy Apply
Posted 36 days ago | Updated 3 days ago

Google Cloud Platform Data Engineer

Fynbosys Inc

•

Bolingbrook, Illinois, USA

Contract

Role: Google Cloud Platform Data EngineerClient: Client of KForceHybrid - Bolingbrook, ILExp: 13+yrs Extensive Google Cloud Platform experience (3-5 years MINIMUM)Google Cloud Platform (Google Cloud Platform) Dataflow, Dataproc, PubSub, DataProc, BigQuery, Cloud StorageREST API, microservicesDataProc SPARK Engine that Google providesExposure to KafkaExposure to real-time ingestion frameworksBuilding data pipelinesKafka
Easy Apply
Posted 2 days ago

Hadoop [Big data] Developer

Sriven Systems Inc.

•

Chicago, Illinois, USA

Contract

Position: Hadoop [Big data] Developer Location: Chicago, IL Duration: 1-year CTH Primary Skills: Hadoop, Py spark, Data Lake Experience building/standing up a big data on-prem solution (Hadoop, Cloudera, Hortonworks), data lake or data warehouse or similar solution. All roles require 100% hands on experience and strong data foundations. These skills MUST be on prem NOT in the cloud, if you have both that s fine but they need these skills from an on-prem big data environment. Big Data Platform (d
Easy Apply
Posted 9 days ago

Software Engineer- Data Pipelines

Jobot

•

Chicago, Illinois, USA

Full-time

3 days onsite- Hybrid Opportunity This Jobot Job is hosted by: Heather Burnach Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $170,000 - $210,000 per year A bit about us: We are a company that is a different kind of private investment firm. We invest in technology and technology-enabled companies that innovate and disrupt existing industries - from biosciences to transportation to food to health and wellness. Our mission is to invest in a
Posted 2 days ago | Updated 3 hours ago

Senior Fullstack Engineer

Jobot

•

Chicago, Illinois, USA

Full-time

Private Investment Firm- Hybrid 3 days onsite This Jobot Job is hosted by: Heather Burnach Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $160,000 - $220,000 per year A bit about us: We are a company that is a different kind of private investment firm. We invest in technology and technology-enabled companies that innovate and disrupt existing industries - from biosciences to transportation to food to health and wellness. Our mission is to
Posted 1 day ago | Updated 3 hours ago

Agile Scrum Master

Genesis10

•

Chicago, Illinois, USA

Full-time

Genesis10 is currently seeking an Agile Scrum Master with our client in the financial industry located in Chicago, IL. This is a 12+ month contract position. Responsibilities: Support NextGen Platforms built around Big Data Technologies (Hadoop, Spark, Kafka, Impala, HBase, Docker-Container, Podman, Openshift/Kubernetes, Ansible and many more) Involved in the full life cycle of an application and part of an agile development process Interact, develop, engineer, and communicate collaboratively at
Easy Apply
Posted 1 day ago | Updated 7 hours ago

Senior Data Engineer

Motion Recruitment Partners, LLC

•

Chicago, Illinois, USA

Full-time

Senior Data Engineer Are you passionate about leveraging cutting-edge technology to data-driven innovation? A leading trading firm in Chicago, is seeking a Senior Data Engineer to join our Data Engineering team. We are renowned for our expertise in low latency technology, trading strategies, and data-driven solutions. This full-time position offers a unique opportunity to work with advanced technologies in a dynamic, collaborative environment. At this leading trading firm, you'll be at the foref
Easy Apply
Posted 2 days ago | Updated 2 hours ago

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

•

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin
Easy Apply
Posted 60+ days ago | Updated 9 days ago

Data Modeler

Motion Recruitment Partners, LLC

•

Chicago, Illinois, USA

Full-time

Data Modeler This innovative, leading data science, media, and analytics firm is seeking a talented and dedicated Data Modeler in Chicago. In this role, you will design and optimize advanced data models to support strategic design, collaborate with analysts to ensure data accuracy, and turn complex datasets into actionable insights. At this pioneering company, you will join a dynamic team that leverages cutting-edge technology to drive real-world results, with many opportunities for growth and a
Easy Apply
Posted 24 days ago | Updated 2 hours ago

Senior Associate, Product Management

Publicis Media

•

Chicago, Illinois, USA

Full-time

Job DescriptionJob DescriptionCompany Description Publicis Media harnesses the power of modern media through global agency brands CJ, Performics, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith. A key business solution of Publicis Groupe ([Euronext Paris FR0000130577, CAC 40], Publicis Media's digital-first, data-driven global practices deliver client value and increase growth in a platform-powered world. It is present in more than sixty countries with over 23,000
Posted 11 days ago | Updated 13 hours ago