hadoop big data spark engineer Jobs in chicago, il

Refine Results
1 - 20 of 260 Jobs

Senior Data Engineer - Principal Associate (Spark, Scala)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Senior Data Engineer - Principal Associate (Spark, Scala) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are p

Position: Sr. Hadoop Developer with Spark with Healthcare Domain Needed Location :Jacksonville, FL ( Remote Work )

Synergy Technologies, LLC

Remote

Contract

Hi, Synergy Technologies is a leader in technology services and consulting. We enable clients across the world to create and execute strategies .We help our clients find the right problems to solve, and to solve these effectively. We bring our expertise and innovation to every project we undertake Position: Sr. Hadoop Developer with Spark with Healthcare Domain NeededDuration : ContractLocation : Jacksonville, FL( Remote Work ) Healthcare Domain NeededDirect ClientLooking for Healthcare Domain o

Big Data Engineer (Azure)

Tiger Analytics

Chicago, Illinois, USA

Full-time

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in

Bigdata Hadoop Engineer

Softsol Resources Inc

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S

Senior Azure Databricks Developer

Ventures Unlimited

Chicago, Illinois, USA

Full-time

Job Title: Senior Azure Databricks Developer Location: Chicago, IL - onsite from day one Type: Full Time Position Job Description: Relevant Experience (in Yrs): 10+ years Experience required: Overall 10+ years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystemsExperience in developing Spark applications using spark-SQL in Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing and transforming the data

Bigdata Developer With Spark & Scala EMR

E-Solutions, Inc.

Remote

Third Party

Job title: Bigdata Developer With Spark & Scala EMR Location: Remote Mandatory Skills: Spark, Scala EMR and AWS JD Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployments, te

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Job Description: As a Senior Spark Data Engineer, you will play a pivotal role in designing, developing, and optimizing data processing pipelines using Apache Spark. You will work closely with cross-functional teams to understand business requirements and translate them into scalable and efficient data solutions. Your expertise in SQL, Python, Databricks, and Spark will be critical in ensuring the seamless processing of large-scale imagery and big data sets. This role offers an exc

Big Data Developer (Spark, Scala, AWS, AWS Elastic MapReduce)

People Force Consulting Inc

Remote

Third Party, Contract

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: Spark frameworkScalaAWS Elastic MapReduce - Strong ExperienceAWSJob Description Requirements: Bachelors degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocki

Big Data Engineer

Diamond Pick

Remote

Contract

POSITION SUMMARY: The Big Data Engineer is responsible for designing and developing data pipelines, ensuring efficient data processing, and maintaining data infrastructure. They work with large-scale data sets, implement ETL (Extract, Transform, Load) processes, and collaborate with cross-functional teams to meet business needs. RESPONSIBILITIES: Designing and Building Data Pipelines Develop and maintain data processing pipelines using Python, PySpark, and Big Data technologies (e.g., Dataproc

Big Data Engineer

ADDSOURCE

Remote

Third Party

Role: Bigdata Developer Exp Required: 12+Years Location: Remote Mandatory Skills: Spark, Scala EMR and AWS Job Description Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployme

Senior Data Engineer - Principal Associate

Capital One

Chicago, Illinois, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Senior Data Engineer - Principal Associate Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying d

Senior Data Engineer

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with e

Senior Data Solutions Engineer

Epsilon

Chicago, Illinois, USA

Full-time

Job Description We are looking for a senior data solutions engineer with extensive experience in the big data and data warehouse ecosystems. The Epsilon Digital Data Organization builds and maintains MPP, HDFS and Elastic platforms to capture all data generated from the Ad Stack and external sources to support all aspects of the business. The candidate must be proficient in SQL and Python, with the ability to be a key contributor in delivering critical business features. The candidate must hav

Senior Data Solutions Engineer

Epsilon

Chicago, Illinois, USA

Full-time

Job Description We are looking for a senior data solutions engineer with extensive experience in the big data and data warehouse ecosystems. The Epsilon Digital Data Organization builds and maintains MPP, HDFS and Elastic platforms to capture all data generated from the Ad Stack and external sources to support all aspects of the business. The candidate must be proficient in SQL and Python, with the ability to be a key contributor in delivering critical business features. The candidate must hav

Senior Manager, Data Engineering

Capital One

Chicago, Illinois, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Senior Manager, Data Engineering Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Hadoop Engineer

Buxton Consulting

Remote

Full-time

Hadoop Engineer Remote Role- must work on PST time zone 12+contract Must Haves- Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must.Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must.4-5 experience building data pipelines using Hadoop components Sqoop, Hive, Solr, MR, Impala, Spark, Spark SQL., HBase.4-5 years of programming experience in Python, Java and Scala is must.Strong experience with REST API development using Python fr

AWS Glue Big data engineer

System Soft Technologies

Remote

Contract

System Soft Technologies is widely recognized for its professionalism, strong corporate morals, customer satisfaction, and effective business practices. We provide a full spectrum of business and IT services and solutions, including custom application development, enterprise solutions, systems integration, mobility solutions, and business information management. System Soft Technologies combines business domain knowledge with industry-specific practices and methodologies to offer unique solution

Manager, Data Science (Remote)

WALGREENS

Remote or Deerfield, Illinois, USA

Full-time

Designs, develops, and implements methods, processes and systems to consolidate and analyze diverse data sets including structured and unstructured. Manages the daily operational activities that develop and implement tactical plans for specified area. Oversees team(s) assigned to projects and may manage implementations. Ensures resources are accurately allocated in line with tactical plans and appropriately accounted for. Job ResponsibilitiesManages the daily operational activities that develop

Database Administrator (100% Remote - W2 Only)

Performix Business Services, LLC

Remote

Contract

Database infrastructure administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistanc