Apache Spark jobs in New York

Jersey City, New Jersey

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Market Risk Developer for a right to hire assignment with one of our premier financial services clients in Jersey City, NJ. Responsibilities: Architect and build robust, scalable data pipelines to ingest and process billions of trade-level PV calculations from various stress engines. Develop and optimize large-scale aggregation jobs using Apache Spark, ensuring high performance and efficiency. Design and deliver a suite of "inte

Contract

Java Spark Engineer

Berkeley Heights, New Jersey

•

22d ago

Responsibilities: Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java) Lead design of batch and streaming ETL/ELT systems handling large data volumes Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reduction Set coding standards and lead code/design reviews across the team Drive technical decisions on data architecture, storage formats, and pipeline orchestration Mentor mid-level and junior engineers; ac

Easy Apply

Contract, Third Party

60 - 70

Data Engineer, SQL, ETL, PySpark & Spark

Hybrid in Rutherford, New Jersey

•

Today

Date Posted: 08/19/2026 Hiring Organization: Rose International Position Number: 505952 Industry: Financial Services Job Title: Data Engineer, SQL, ETL, PySpark & Spark Job Location: Rutherford, NJ, USA, 07070 Work Model: Hybrid Work Model Details: 3 days onsite and 2 days remote Employment Type: Temp to Hire FT/PT: Full-Time Estimated Duration (In months): 6 Min Hourly Rate($): 65.00 Max Hourly Rate($): 74.00 Must Have Skills/Attributes: Agile, Analytical Skills, Data Scientist, Python E

Easy Apply

Full-time

USD 65.00 per hour

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Watsonx.data Consultant with Spark and scala experience

Remote

•

Today

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Contract, Third Party

Depends on Experience

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Java/Spark, Market Risk, Quantitative - C13

Rutherford, New Jersey

•

12d ago

Title: Senior Java Spark Developer - Market Risk Location: Jersey City, NJ Employment Type: Contract - Hybrid Compensation: Pay Range: $79.00-$89.00 Per HR Job Summary: Join our dynamic team as a Senior Developer focusing on building and optimizing distributed data platforms. This role is based in Jersey City, NJ, and offers a hybrid work environment. As a key player, you will design and implement scalable systems, collaborating with cross-functional teams to enhance risk analytics. This

Easy Apply

Third Party, Contract

$79 - $89

Scala/Spark Engineer – Data Engineering & AI Workflows

East Brunswick, New Jersey

•

30+d ago

Position: Scala/Spark Engineer Data Engineering & AI Workflows (Over 10+ exp) Location: Sunnyvale, CA (Onsite)- Prefer local candidates FTE/Contract Salary/hourly Pay rate: Market+ based on candidate experience Job Description We are looking for a Scala/Spark Engineer with strong Data Engineering experience and exposure to building AI-enabled data processing workflows. Key Skills:Strong hands-on experience in Scala and Apache SparkSolid background in Data Engineering, including building scalab

Easy Apply

Contract, Third Party

Depends on Experience

Senior Data Engineer - Spark & AWS

Remote or Greenwood Village, Colorado

•

Today

RESPONSIBILITIES: Kforce has a client in the telecommunications industry that is seeking an experienced Senior Data Engineer in Greenwood Village, CO to join a high-impact engineering team developing enterprise-scale data solutions. This role offers the opportunity to work on modern cloud technologies, large-scale data processing, and AI-driven analytics that support mission-critical business initiatives. If you enjoy solving complex data challenges, building scalable data pipelines, and working

Contract

$65 - $75 hourly

Senior Data Software Engineer, Spark, Java, Scala

Remote

•

Today

We are seeking a Senior Software Data Engineer to join our team in a software engineering capacity. This is not a data-science or analytics position centered on ad-hoc data exploration; instead, the role focuses on building software, data processing jobs, and data pipelines consumed by internal and external partners. Data is our main product and first-class citizen, and we value correct, high-quality data as much as clean and maintainable code. Responsibilities Write new data pipelines and jobs

Full-time

Senior Software Development Engineer, Consumer Domains

Newark, New Jersey

•

Today

At Audible, we believe stories have the power to transform lives. It's why we work with some of the world's leading creators to produce and share audio storytelling with our millions of global listeners. We are dreamers and inventors who come from a wide range of backgrounds and experiences to empower and inspire each other. Imagine your future with us. ABOUT THIS ROLE This opportunity is for a Senior Software Development Engineer for Audible's Consumer Domains group. We are the team that create

Full-time

Databricks/Data Architect

Hybrid in New York, New York

•

11d ago

Job Title:Databricks/DataArchitect(Enterprise Data Platform) Experience:14+ Years Location- NJ, Hybrid Note- Need Independent candidate for C2H after 3-6 months We are seeking a highly skilledDatabricksArchitectto lead the design and implementation of next-generation data platforms built on the Lakehouse paradigm. This role goes beyond pipeline developmentyou will own theDatabricksplatformarchitecture end-to-end, driving scalability, governance, performance, and cost optimization across enterpr

Easy Apply

Contract

70 - 80

Data Engineer - Market Risk Analytics - Fulltime

Hybrid in Jersey City, New Jersey

•

Today

Job Title: Data Engineer - Market Risk Analytics Location: Jersey City, NJ (Hybrid, 2-3 days onsite in a week) Duration: Fulltime Job Description: Senior Hands-on Technologist, Massive Scale Risk Analytics Strong Big Data Engineer (BDE) with hands-on development experience in Python, Java, and Scala (Scala is not mandatory). Mandatory - Strong experience with Spark and large-scale data processing platforms Must be a hands-on engineer/developer, capable of designing and coding scalable solutions

Easy Apply

Full-time

Depends on Experience

Java Full Stack Developer with Scala

Hybrid in New York, New York

•

7d ago

Role: Java Full Stack Developer with Scala Location: New York, NY / Hybrid Onsite Mode of interview: 2 Virtual and 1 In-person (NY) Team Profile The NFRT organization provides IT support to the Legal and Compliance division. The Fraud Technology Department is responsible for detecting, preventing, notifying, and reporting on all Fraud outside and inside the firm. We provide technology solutions, consultation, controls, governance, and expertise to fraud analysts in operations and cybersecurity,

Easy Apply

Contract

Depends on Experience

Senior Backend Java Developer

New York, New York

•

Today

Position: Senior Backend Java Developer Location: NYC, NY( onsite + IN person interview ) Duration: 12 months Roles and Responsibilities: Provide technical leadership and vision for software development projects, setting high standards for quality and innovation. Define and oversee the technical architecture and roadmap for large-scale, mission-critical systems. Align departmental goals and objectives with broader business priorities, ensuring shared vision and clarity. Lead and mentor a tea

Easy Apply

Third Party, Contract

Depends on Experience

Palantir AI Engineer (Insurance / Financial Services) !!! Jersey City, NJ & Atlanta, GA (Onsite)

Jersey City, New Jersey

•

Today

Position: Palantir AI Engineer (Insurance / Financial Services) Location - Jersey City, NJ & Atlanta, GA (Onsite) Duration: Long Term Must haves:- Palantir Foundry, Palantir AIP, LLM, RAG/OAG, GenAI, Python, Pyspark, Apache Spark, Kafka Job Description: We are seeking an experienced GenAI Engineer specialized in Palantir Foundry and Palantir Artificial Intelligence Platform (AIP) to design, build and operationalize LLM-powered, ontology-driven AI workflows for enterprise-scale use cases. You w

Easy Apply

Contract

Depends on Experience

Senior Search Architect (SOLR / Elasticsearch) in NYC, NY

Hybrid in New York, New York

•

19d ago

SOLR / Elastic Search: Location- New York City Hybrid Duration: Long Term Inviting applications for the role of Principal Consultant, Search Platform Engineer Solr / Lucidworks / Elasticsearch In this role, you will be responsible for coding and delivering high quality deliverables and should be willing to learn about new technologies. Responsibilities Design, develop, and implement enterprise search solutions using Fusion and SOLR. Tune search relevancy and query pipelines to ensure fast an

Easy Apply

Contract, Third Party

Data Engineers - Matillion and BigQuery - Remote / Telecommute

Secaucus, New Jersey

•

3d ago

We are looking for Data Engineers - Matillion and BigQuery - Remote / Telecommute for our client in Secaucus, NJ. Job Title: Data Engineers - Matillion and BigQuery - Remote / Telecommute Job Location: Secaucus, NJ Job Type: Contract Job Overview: Pay Range: $47.00hr - $52.00hr Requirement/Must Have: Bachelor s degree in computer science, Engineering, Information Technology, or a related field.5+ years of experience as a Data Engineer or in a similar role.Proficiency in Snowflake SQL and experie

Easy Apply

Contract, Third Party

Depends on Experience

Systems Manager - Google Cloud Platform Lead Data Engineering

Hybrid in New York, New York

•

12d ago

SummarySeeking a Systems Manager, Google Cloud Platform Data Engineering, Enterprise Data & Analytics, leads the hands-on technical team responsible for designing, building, and maintaining the enterprise-grade data pipelines that power the Enterprise Data & Analytics Platform (EDAP). This role manages a highly skilled team of engineers who own the core stages of the data lifecycle on Google Cloud Platform (Google Cloud Platform)including data transfer, ingestion, transformation, curation, expos

Easy Apply

Full-time

140,000 - 190,000

Java Backend Engineer

New York, New York

•

3d ago

Job Title - Java Backend Engineer Contract Position through Genpact Skill: The ideal candidate will have over 7 years of enterprise Java development experience, a strong background in big data processing using Apache Spark, and a passion for engineering excellence. While this is primarily a backend role, knowledge of Angular UI is a plus. Key Responsibilities System Architecture: Design, develop, and deploy robust, scalable, and microservices-based backend systems using Java and Spring Boot.Dat

Easy Apply

Contract

Depends on Experience

Apache Spark jobs in New York, NY, USA