spark Jobs in Chicago, IL

Refine Results
1 - 20 of 316 Jobs

Senior Data Engineer - Principal Associate (Spark, Scala)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Senior Data Engineer - Principal Associate (Spark, Scala) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are p

Senior Data Engineer - Principal Associate (Spark, Scala)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Senior Data Engineer - Principal Associate (Spark, Scala) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are

Software Engineer-Spark

Veear

Remote

Contract

Title: Software Engineer (Spark) Duration: 03+ months contract (possible extension) Location: Cupertino, CA(Remote) Job Summary: Strong understanding of distributed systems and cloud computing principles.Demonstrated experience with Apache Spark.Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud.Extensive experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and networking (VPC, N

Databricks Developer ( Spark , PySpark ) | Remote

Bramkas Inc.

Remote

Contract

Title: Databricks Developer Experience: 7 + yrs exp Position Type : Contract Location : Remote Must Have Skill : Spark , Pyspark ,Python ,Data BricksWe are seeking a skilled Databricks Developer to join our team . As a Databricks Developer, you will be responsible for designing, building, and maintaining data pipelines and analytics solutions using the Databricks platform. You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement solutions

Data Architect ( Spark, PySpark, and Python) | Full Time Position | Remote

Bramkas Inc.

Remote

Full-time

Data Architect Location: RemoteEmployment Type: Full-time PositionExperience: 9+ yrs expMust have : Data Architect , Spark , Pyspark , PythonWe are currently seeking a skilled and experienced Data Architect to join our team. The ideal candidate will have a strong background in data architecture, along with expertise in Spark, PySpark, and Python. As a Data Architect, you will play a critical role in designing and implementing data solutions to support our organization's objectives. Responsibili

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa

Software Engineer (Spark)

Bayside Solutions

Remote or

Contract

Software Engineer (Spark) W2 Contract Salary Range: $145,600 - $166,400 per year Location: Seattle, WA - Remote Role Requirements and Qualifications: Strong understanding of distributed systems and cloud computing principles Demonstrated experience with Apache Spark Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud Experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and net

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Spark Scala Developer

Infosys Technologies Ltd

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i

Azure Data Engineer

iTech US, Inc.

Chicago, Illinois, USA

Contract, Third Party

Position: Azure Data Engineer Location: Chicago, IL Duration: 12+ Months Contract Years of experience: 10+ Years Role Description: The candidate will be responsible for designing & building solutions for Analytics applications, in the analytics group. This role will be part of the Enterprise BI team.This role will cover multiple data technology stacks as well as cloud technologies.Responsibilities: Work with business owners and IT stakeholders to understand business and functional requirements

Sr Data Engineer

Cystems Logic

Chicago, Illinois, USA

Full-time, Contract

Role: Sr Data Engineer (Python/Spark/AWS) Chicago, IL/ Wilmington DE Qualification: BS degree in Computer Science or certification on software engineering. Proficient in data analysis, data engineering, data modelling, and database management. Strong understanding of RDBMS, NoSQL, big data, SQL, and ETL tools. Experience programming with at least one modern language such as Java, Python, Unix Shell. Proficiency in REST APIs, microservices, distributed systems and cloud (hybrid) computing . Stro

TDM Architect

Zuven Technologies Inc

Chicago, Illinois, USA

Contract

TDM Specialist - Architect/Lead with expertise in: Development of Test Data Management Strategy and solutioningStakeholder management and leadership communicationDevelop/standardize processes for test data managementEnd to End Production Data migrationTest data management solution architectureCustom ETL development with Java/PythonData processing tools like Starburst Trino, Postgres, Presto, EDBDevelopment of full data analytics pipelines from data ingestion, curation, reconciliation and reporti

Manager Data Science

WALGREENS

Deerfield, Illinois, USA

Full-time

Designs, develops, and implements methods, processes and systems to consolidate and analyze diverse data sets including structured and unstructured. Manages the daily operational activities that develop and implement tactical plans for specified area. Oversees team(s) assigned to projects and may manage implementations. Ensures resources are accurately allocated in line with tactical plans and appropriately accounted for. Job ResponsibilitiesManages the daily operational activities that develop

Snowflake Cloud Engineer, Specialist Sr

Deloitte

Chicago, Illinois, USA

Full-time

The Team AI & Data is an integrated team of data and AI technologists working across Operate, AI, and Engineering. We serve as a trusted advisor and managed service provider bringing a mix of capability and capacity across data modernization, data ops, AI, and ML. Through our unrivaled breadth and depth of services across every major industry and domain, we help our clients run smarter, faster, and more efficiently. With Deloitte's AI & Data, our clients have the support they need to continuous

Ph.D Data Scientist, R&D (Decision Sciences Identity Team)

Epsilon

Chicago, Illinois, USA

Full-time

Job Description In this role, you will contribute to research initiatives and develop enhancements to Epsilon's CORE Personalization Platform to continually increase the capabilities of Epsilon's digital marketing businesses. We prioritize analytical thinking, creativity and computer science skills over ad tech industry experience. If using internet-scale data to drive business impact excites you, and you enjoy the kind of research that starts with a blank sheet of paper that turns ideas into

Sr. Data Engineer

Apex Systems

Rolling Meadows, Illinois, USA

Full-time

Job#: 2024411 Job Description: CHICAGO IL (onsite 3 days week) Sr Data Engineer We are seeking an experienced data engineer to contribute to a high data volume application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with Machine Learning (ML) and Master Data applications. In the future, theres a plan to migrate the existing AWS EMR application to AWS Glue. The ideal candidate will possess robust data engineering expert

PhD Senior Research Data Scientist (Decision Sciences Identity Team)

Epsilon

Chicago, Illinois, USA

Full-time

Job Description In this role, you will lead and contribute to new and ongoing research and development efforts that advance Epsilon's identity match abilities - leveraging data science, machine learning and other disciplines to create new data-driven capabilities for our real-time digital marketing business. We prioritize analytical thinking, creativity and computer science skills over ad tech industry experience. If using internet-scale data to drive business impact excites you, and you enjoy

Senior Engineer - Generative AI Product Engineering (Remote Eligible)

Capital One

Remote or Chicago, Illinois, USA

Full-time

130 5th Ave (22130), United States of America, New York, New York Senior Engineer - Generative AI Product Engineering (Remote Eligible) Our mission at Capital One is to create trustworthy, reliable and human-in-the-loop AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent, automated customer experiences. From informing customers about unusual charges to answering their questions in real time, ou

Senior Engineer - Generative AI Product Engineering (Remote Eligible)

Capital One

Remote or Chicago, Illinois, USA

Full-time

130 5th Ave (22130), United States of America, New York, New York Senior Engineer - Generative AI Product Engineering (Remote Eligible) Our mission at Capital One is to create trustworthy, reliable and human-in-the-loop AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time, intelligent, automated customer experiences. From informing customers about unusual charges to answering their questions in real time, ou