apache spark Jobs in chicago, il

Refine Results
1 - 20 of 271 Jobs

Senior Data Engineer - Principal Associate (Spark, Scala)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Senior Data Engineer - Principal Associate (Spark, Scala) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are

Python Developer with Spark Expertise

Optimuss Inc

Remote

Third Party, Contract

Position: Python Developer with Spark Expertise Position Overview: We are seeking a talented Python Developer with expertise in Apache Spark to join our growing team. The ideal candidate will have a strong background in Python development and hands-on experience with Spark for processing large-scale datasets. As a key member of our team, you will play a critical role in developing data pipelines, optimizing performance, and implementing robust solutions to meet our clients' evolving needs. Respo

Full-Time Only ::Data engineer strong with Spark and Scala

VeridianTech

Remote or San Francisco, California, USA

Full-time

Job Title: Spark Developer with Scala Location: San Francisco, CA (100% Onsite from Day 1) Duration: 12+ months contract/ Full time Permanent (Both) Please find below JD: Advanced level of Java/Scala/Python development experience. Intermediate level of SQL and NoSQL experience (handling structured and unstructured data). Extensive experience with Spark Processing engine. Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka) Experience analyzing da

Spark Scala Developer (Remote Role)

Nityo Infotech Corporation

Remote

Full-time

Role - Spark Scala Developer Experience 5+ years of IT experience Location 100% Remote Role Employment Type Fulltime Job Description : Required Qualifications: Bachelors degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of educationAt least 4 years of experience in Information Technology.At least 3years of hands on experience with Hadoop distributed frameworks while handling l

Big Data Developer (Spark, Scala, AWS, AWS Elastic MapReduce)

People Force Consulting Inc

Remote

Contract, Third Party

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: Spark frameworkScalaAWS Elastic MapReduce - Strong ExperienceAWSJob Description Requirements: Bachelors degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocki

Full-Time Only::remote::Spark Developer with Scala/Python

VeridianTech

Remote

Full-time

Position : Spark Developer with Scala/Python Location : Sunnyvale, CA or Ausin,TX Duration : Fulltime Job Description: Required Qualifications: Candidate must be located within commuting distance of Sunnyvale, CA or Ausin,TX be willing to relocate to Sunnyvale, CA or Austin, TX. This position may require travel within the US and Canada. Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

HADOOP ARCHITECT

Zele Cloud

Chicago, Illinois, USA

Contract

Hello Everyone, REQUIREMENT: Position: Hadoop Architect/Solution Architect. Location: Chicago, IL (Onsite). Duration: 12+ Months. JOB DESCRIPTION; Bachelor's degree in Computer Science, Information Technology, or related field; Master's degree preferred.Proven experience as a Hadoop Architect or Solution Architect, with a focus on migrations and upgrades.Extensive knowledge of Hadoop ecosystem components, including HDFS, YARN, MapReduce, Hive, HBase, Spark, and Kafka.Hands-on experience with Clo

Sr Data Engineer

Cystems Logic

Chicago, Illinois, USA

Full-time, Contract

Role: Sr Data Engineer (Python/Spark/AWS) Chicago, IL/ Wilmington DE Qualification: BS degree in Computer Science or certification on software engineering. Proficient in data analysis, data engineering, data modelling, and database management. Strong understanding of RDBMS, NoSQL, big data, SQL, and ETL tools. Experience programming with at least one modern language such as Java, Python, Unix Shell. Proficiency in REST APIs, microservices, distributed systems and cloud (hybrid) computing . Stro

Database Engineer (100% Remote - W2 Only)

Performix Business Services, LLC

Remote or Chicago, Illinois, USA

Contract

Database Engineers administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistance to

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Machine Learning Engineer

Jobot

Chicago, Illinois, USA

Full-time

This Jobot Job is hosted by: Amber Wood Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $120,000 - $180,000 per year A bit about us: Financial Services Why join us? Competitive Compensation Full Benefits Bonus Growth Opportunities Job Details Qualifications: Master or PhD in a quantitative subject (Statistics, Mathematics, Computer Science, Operations Research). Expertise in Python with and the ability to write performant production-qua

Php Developer

TEKsystems c/o Allegis Group

Chicago, Illinois, USA

Full-time

Description: We invite you to join our team as a Big Data Developer/Engineer. We are a tight-knit, supportive community passionate about on delivering the best experience for our customers while remaining sensitive to their unique needs. Additional Skills & Qualifications: - Hands on programming experience in at least one of Scala or Shell Scripting is a nice to have. - Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks,

Machine Learning Engineer / MLOps

Motion Recruitment Partners, LLC

Chicago, Illinois, USA

Full-time

We're looking for a Machine Learning Enigneer to join a startup building fraud prevention software. This role can be remote but candidate local to the Chicago office will be preferred so they can easily attend meeting and training opportunities. Join a close-knit group that's building a platform that can handle a high volume and complex latency fraud processing platform. In this role you'll be building end-to-end machine learning platforms. The ideal candidate will have experience building APIs,

Big Data/PHP Developer

TEKsystems c/o Allegis Group

Chicago, Illinois, USA

Full-time

Financial client Hybrid onsite 3x/week Rate: competitive Description: We invite you to join the GIS team our financial client as a Big Data Developer/Engineer. We are a tight-knit, supportive community passionate about on delivering the best experience for our customers while remaining sensitive to their unique needs. Top Skills Details: Hadoop,Sql,Spark,Big data,Etl,rest api,php,Python Additional Skills & Qualifications: - Hands on programming experience in at least one of Scala or Shell Script

Data Scientist - Digital Platforms and Innovation

Kforce Technology Staffing

Remote or Deerfield, Illinois, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a Data Scientist - Digital Platforms and Innovation in Deerfield, IL. Duties: * Responsible for the development and implementation of predictive modeling algorithms and techniques to solve unmet needs, customer/business problems and optimize user experiences * Conduct in-depth research to stay at the forefront of AI advancements, exploring opportunities to integrate predictive and generative AI models into our products and services * Formula

Manager Engineering, Backend

Grubhub

Chicago, Illinois, USA

Full-time

About The Opportunity We're all about connecting hungry diners with our network of over 300,000 restaurants nationwide. Innovative technology, user-friendly platforms and streamlined delivery capabilities set us apart and make us an industry leader in the world of online food ordering. When you join our team, you become part of a community that works together to innovate, solve problems, grow, work hard and have a ton of fun in the process! Why Work For Us Grubhub is a place where authentically

Senior Data Warehouse Architect

UScellular

Chicago, Illinois, USA

Full-time

About This Role Employer : U.S. Cellular Corporation Job Title : Senior Data Warehouse Architect Location : 8410 W. Bryn Mawr Avenue, Chicago, IL 60631 Job Duties: Design a high performing Enterprise Data Warehouse; Collaborate with the stakeholders and build solutions. Participate in process improvement initiatives and in setting best practice standards; Provide expertise in the creation and refinement of agile technical stories for data architecture and development; Provide expertise in t