apache spark Jobs

Refine Results
1 - 20 of 1,370 Jobs

Scala/Spark Developer

Photon

Jersey City, New Jersey, USA

Full-time

Greetings from Photon, We hope you are staying safe. We are looking for a Scala/Spark Developerto join our team for large Fortune 500 Client. Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit to learn more about us, how we work, and our customer case studies. Scala/

Spark Engineer

SmartIMS Inc.

Remote

Contract

Spark Engineer MULTIPLE ROLES We can only work on W 2 basis (no H 1 B, no Corp - to - Corp) Spark Engineer Location: REMOTE (Pacific Time) Duration: 6-12 Months Workflows are powered by offline batch jobs written in Scalding, a MapReduce-based framework. To enhance scalability and performance, migrating these jobs from Scalding to Apache Spark. Key Responsibilities: Understanding the Existing Scalding Codebase Analyze the current Scalding-based data pipelines.Document existing business logi

Spark Developer

SmartIMS Inc.

Remote

Contract

Spark Developer MULTIPLE ROLES We can only work on W 2 basis (no H 1 B, no Corp - to - Corp) Spark Developer Location: REMOTE (Pacific Time) Duration: 6-12 Months Workflows are powered by offline batch jobs written in Scalding, a MapReduce-based framework. To enhance scalability and performance, migrating these jobs from Scalding to Apache Spark. Key Responsibilities: Understanding the Existing Scalding Codebase Analyze the current Scalding-based data pipelines.Document existing business lo

Sr. Scala/Spark Developer

Photon

Jersey City, New Jersey, USA

Full-time

Greetings from Photon!! Who are we? Photon has emerged as one of the worlds largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit to learn more about us, how we work, and our customer case studies. Position: Sr. Scala/Spark Developer Location: Jersey City, NJ (Onsite) Job Type: Full Time/W2 Contract Key Responsibilities:

Data Engineer- Spark Scala

Photon

Jersey City, New Jersey, USA

Full-time

Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data proces

Scala/Spark Developer

Photon

Irving, Texas, USA

Full-time

Greetings from Photon, We hope you are staying safe. We are looking for a Scala/Spark Developer to join our team for large Fortune 500 Client. Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit to learn more about us, how we work, and our customer case studies. Sca

Scala/Spark Developer

Photon

Jersey City, New Jersey, USA

Full-time

Greetings from Photon!! Who are we? Photon has emerged as one of the worlds largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit to learn more about us, how we work, and our customer case studies. Role is 100% onsite per week in Jersey City, NJ. Only Fulltime / Contract (W2). No C2C. Minimum 8+ years of experience (Must

Lead Data Engineer (Python, Spark, AWS)

Capital One

Chicago, Illinois, USA

Full-time

Lead Data Engineer (Python, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engi

Data Engineer - Python/AWS/Spark

Motion Recruitment Partners, LLC

Philadelphia, Pennsylvania, USA

Full-time

A national pharmaceutical company is looking for a fulltime Data Engineer to join their team. This company, based in Philadelphia, is transforming lives and reinventing healthcare as they tackle society's most pressing health issues. In this role, you will help build out a data platform, support clinical trials, and deliver patient and drug data. The ideal candidate will feel comfortable jumping into a fast moving and critical project. If you want to join an organization making a difference in t

Spark Developer

Rivi Consulting Group

New York, New York, USA

Contract

Please note: The candidate must come for In person interview in New York. Responsibilities will include: Understand and implement tactical or strategic solution for a given business problem Discussion with stakeholders on business needs and technology requirements. Define and derive the strategic solutions as well as identify tactical solutions when necessary. Write technical design & other solution documents per Agile (SCRUM) standards. Perform data analysis to aid development work and oth

Spark Developer (Only locals NY & NJ)

Rivi Consulting Group

New York, New York, USA

Contract, Third Party

Scala Developer The Financial Crimes Technology (FCT) is a dynamic and fast-paced global group within the Non- Financial Risk Technology (NFRT) organization. We are responsible for implementing state-of-the-art technology solutions for the firm Global Financial Crimes (GFC) division which manages the Firm's Anti Money Laundering (AML), Sanctions/PEP & Adverse News Screenings, Know your Customer (KYC), Anti-Bribery & Corruption programs. Financial Crimes Technology (FCT) has global presence suppo

Spark Scala Engineer

Maveric NXT Inc

Irving, Texas, USA

Full-time

Job title: Spark + Scala Engineer location: Irving, TX (Hybrid) Type: Full-time (Not open for C2C) Job Summary: We are looking for a Spark Scala Engineer to develop and optimize data pipelines using Apache Spark and Scala. You will work on processing large datasets, ensuring scalability and performance. Key Responsibilities: Build and maintain ETL pipelines with Spark and Scala.Optimize data processing workflows.Collaborate with teams to deliver data-driven solutions.Qualifications: Strong exper

Data engineer /Scala/Spark Developer

Photon

Jersey City, New Jersey, USA

Full-time

Data engineer / Sr Scala/Spark Developer Jersey City Fulltime with Photon No. of positions: 5 Minimum 8 years of experience in application development. Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing. Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop. Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi. Experience building and optimizing ETL pipe

Data Engineer with Spark, AWS, Java

Thinklusive

Phoenix, Arizona, USA

Contract

ob Title: Data Engineer with Java AWSLocation: Phoenix, AZ (Onsite)Duration: Long Term ContractYears of Experience Required: 9+ years Job Description: Must have hands on Experience on Spark, Java, AWS Data Engineer with expertise in Kafka, MongoDB, OpenShift (AWS). The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines, ensuring the efficient flow of data across various systems. You will work closely with data scientists, analysts, and other stak

Lead Software Engineer (Spark/AWS/Data pipeline/Java/Spring)--ACSGSWA2

Pro Integrate

Wilmington, Delaware, USA

Contract

Sr Software Engineer (Spark/AWS/Data pipeline/Java/Spring) Wilmington, DE (Nearby candidates only) W2 Candidates Preferred Need Lead Software Engineer with atleast 7+ years hands-on development(Java SpringBoot) + Frontend (Angular OR React) + Any familiarity with mobile technologies or tools (Android or IOS or any mobile frameworks of irrespective of android and IOS like Kotlin or Swift) Job Description- Engineering Manager with experience in leading or managing one or more technology teams

ETL/Spark Developer

Innova Solutions, Inc

Charlotte, North Carolina, USA

Contract

Innova Solutions has a client that is immediately looking for an ETL/Spark Developer Position type: Full-time, Contract Duration: 12 months (with high possibilities of extension) Location: Charlotte, NC (Hybrid 3 days onsite 2 days remote) As an ETL/Spark Developer you will: Description: To support Ongoing Regulatory changes in Americas Reg Reporting with large focus on Axiom development for FRR reports.If role not approved, it will impact our ability to address reg reporting changes within thei

Bigdata Developer with Apache Spark

Federal Soft Systems Inc.

Phoenix, Arizona, USA

Full-time

Job/Role Description: Senior Bigdata Developer with Apache Spark Location: Phoenix, Arizona, USA Employment Type: Contractor/Full-time Key Responsibilities: Data pipeline development: Design, develop, and maintain large-scale, distributed data pipelines using Apache Spark. ii. Performance optimization: Implement best practices for optimizing Spark jobs for performance and scalability. . Integration: Work with diverse data sources, including HDFS, NoSQL databases, relational databases, and cloud

Spark developer (W2 only)

Yashco Systems, Inc.

Remote

Contract

Skills needed Opportunity for a skilled consultant in conversion of Cascading/MapReduce to SparkThe Sr Software Engineer will be responsible for migrating Big Data workloads to Kubernetes/Spark 3.Will lead the conversion of Cascading/MapReduce to Spark 3.Will be touching the code daily within the IntelliJ IDEdoing Scala code reviews, making coding changes needed for the Scala/Spark upgrade, designing the new Kubernetes environment, etc.Yashco Systems, Inc. is an Equal Opportunity Employer M/F/V/

Java Spring SQL Spark Developer

Kforce Technology Staffing

Houston, Texas, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a team of intermediate to senior Java Spring SQL Spark Developers in Houston, TX and Jersey City, NJ. This is an 11-month plus contract with opportunity to become fulltime employee with client. Key Tasks: * Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems * Creates secure and high-quality producti

Cloud Engineer III (Java/Spark/AWS)

Eliassen Group

Westlake, Texas, USA

Contract

Description: We are currently sourcing for a Cloud Engineer to work for us in the Dallas-Fort-Worth area! The Role We are looking for a Cloud Engineer with Strong working experience in AWS to augment the capability of core platforms using Cloud services. This position involves working as a senior developer, building tools to support cloud enablement, supporting the team; with a focus on achieving solutions of high value. As an AWS Cloud Engineer, you will be applying your development and auto