Apache Spark Jobs in New Jersey

Refine Results
1 - 20 of 499 Jobs

Python Spark Lead

ITBMS Inc.

•

Clinton, New Jersey, USA

Third Party, Contract

Design & develop scalable data applications using Python and Apache Spark for batch and real-time (streaming) data processing.Build, orchestrate, and optimize AWS Glue jobs to manage large-scale ETL workflows across heterogeneous data sources.Collaborate with data engineers and analysts to understand requirements and efficiently implement business logic and transformations.Implement robust error handling, logging, and performance tuning to support high-throughput, reliable data pipelines.Ensure
Easy Apply
Posted 18 days ago

Lead Data Engineer (Databricks & Spark)

Reveille Technologies

•

Jersey City, New Jersey, USA

Contract

Hi Hope You're doing well! Role: Lead Data Engineer (Databricks & Spark) Location: Princeton, NJ (Hybrid) Hire Mode: Contract Responsibilities: Demonstrate a strong sense of ownership and responsibility with release goals. This includes understanding requirements, technical specifications, design, architecture, implementation, unit testing, builds/deployments, and code management.Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles a
Easy Apply
Posted 2 days ago

Senior Python Engineer with Spark

EPAM Systems

•

Remote

Full-time

We are looking for a talented Senior Python Engineer with Spark to join our team working on financial data and analytics. You'll be a crucial player in a team accountable for data integration and transformation, developing models and managing a vast array of structured financial data. You'll design and build robust software that efficiently processes data through our medallion architecture. We make use of cutting-edge technology with Databricks on Microsoft Azure. This position offers remote se
Posted 60+ days ago | Updated 1 hour ago

Databricks Developer: Java Spark

Zolon Tech Solutions Inc

•

Remote

Contract

Databricks Developer: Java Spark Location: Remote Duration: Long Term Task Description: The Databricks Developer will be responsible for designing, developing, and maintaining scalable data processing solutions on the Databricks platform, with a focus on integrating and transforming IRS datasets such as the Information Returns Master File (IRMF), Business Master File (BMF), and Individual Master File (IMF). This role requires advanced proficiency in Java and Apache Spark, and a deep understandi
Easy Apply
Posted 5 days ago

Data Engineer - Spark

Exl Service

•

Remote or Fremont, California, USA

Full-time

Company Overview: EXL Service is a global technology and analytics company specializing in delivering innovative, scalable, and high-quality technology solutions. Our global team consists of experienced professionals in design, software engineering, analytics, and data science, committed to solving complex business problems and enabling our clients to achieve their strategic goals. We focus on solving customer business problems by delivering products designed with best-in-class engineering pract
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Jr. Data Engineer (Langchain, Spark) - Remote

ConsultNet, LLC

•

Remote or South Jordan, Utah, USA

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur
Easy Apply
Posted 30 days ago | Updated 1 hour ago

Senior Big Data/ Spark Engineer - C13

Citi

•

Remote or Irving, Texas, USA

Full-time

The Senior Big Data engineering lead will play a pivotal role in designing, implementing, and optimizing large-scale data processing and analytics solutions. This role requires a visionary leader who can drive innovation, define architecture strategy, and ensure the scalability and efficiency of our big data infrastructure. Key ResponsibilitiesLead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and re
Posted 6 days ago | Updated 1 hour ago

Java Spark Developer - AVP

Citi

•

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an
Posted 20 days ago | Updated 1 hour ago

Software Engineer III - Java,/Scala/Spark/ AWS

JPMorgan Chase & Co.

•

Jersey City, New Jersey, USA

Full-time

Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer at JPMorgan Chase within the Corporate Technology, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in suppor
Posted 1 hour ago

Java Spark Senior Developer AVP C12 (Irving)

Citi

•

Remote or Irving, Texas, USA

Full-time

We are looking for a seasoned Developer who is passionate in writing clean and efficient code, building scalable systems, driving engineering excellence in a fast-paced, Agile environment. This role is ideal for developers with deep hands-on experience in Java and Apache Spark, combined with a strong foundation in object-oriented design principles. Responsibilities: Perform detailed impact analysis for code changes with understanding of dependencies across the application componentsDesign and
Posted 54 days ago | Updated 1 hour ago

Senior java developer with Spark - VP - TAMPA

Citi

•

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi
Posted 60+ days ago | Updated 1 hour ago

Databricks Developer

Zolon Tech Solutions Inc

•

Remote

Contract

Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on DatabricksImplement data processing logic in Java 8+, leveraging functional programming and OOP best practicesOptimize Spark jobs for performance, reliability, and cost-efficiencyCollaborate with cross-functional teams to gather requirements and deliver data solutionsEnsure compliance with data security, privacy, and governance standardsTroubleshoot and debug production issues in distributed data en
Easy Apply
Posted 2 days ago

Big Data Developer

OJUS LLC

•

Berkeley Heights, New Jersey, USA

Contract, Third Party

Title:Big Data Developer (Location: NJ, DL, FL) Responsibilities: Strong Experience in Spark Scala Programing. Very extensive experience on Hive, Impala, Kafka & Hbase. Should have good knowledge on Spark Streaming. Clear understanding of Hadoop Ecosystem & Spark Architecture. Must have experience in Unix Shell Scripting, PL/SQL & Autosys Scheduler. Should have used udeploy, TeamCity, SharePoint. Should be expert in debugging & tracing errors/exceptions. occurred in Spark job execution. Must ha
Easy Apply
Posted 5 days ago

Data Engineer - Scala

Exl Service

•

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des
Easy Apply
Posted 30 days ago | Updated 30 days ago

Data Engineer

Innova Solutions, Inc

•

Remote

Contract

Let Volt help move you forward Volt is immediately hiring for Data Engineer in Remote As a Data Engineer, you will: Key responsibilities: Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.Develop, implement, and deploy ETL solutions.Preprocess and analyze large datasets to identify patterns, trends, and insights.Evaluate, validate, and optimize data models to ensure efficiency, and generaliza
Easy Apply
Posted 11 days ago

Lead Python Developer | Clinton, NJ | Local Prefered

HAN IT Staffing Inc.

•

Clinton, New Jersey, USA

Contract, Third Party

Local Preferred Job: Lead Python Developer Duration: Long Term Location: Clinton, NJ (Onsite from Day 1) Job Description: Design & develop scalable data applications using Python and Apache Spark for batch and real-time (streaming) data processing.Build, orchestrate, and optimize AWS Glue jobs to manage large-scale ETL workflows across heterogeneous data sources.Collaborate with data engineers and analysts to understand requirements and efficiently implement business logic and transformations.I
Easy Apply
Posted 17 days ago | Updated 3 days ago

Databricks Architect

Amiseq Inc.

•

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg
Easy Apply
Posted 19 days ago

Azure Solution Architect

PETADATA

•

Mount Laurel Township, New Jersey, USA

Full-time, Third Party

Position : Azure Solution Architect Location: Mount Laurel, NJ-Hybrid(2days onsite/per week) Experience: 12+ yrs Work type: W2/C2C Primary Skills: Solutions Architecture, Data Modeling, Azure, Databricks, PySpark Job duties: Design scalable, secure, and high-performance cloud solutions on Microsoft Azure services Design large-scale data processing and analytics solutions using Azure Databricks. Develop comprehensive architecture blueprints and technical documentation for data solutions. Lea
Easy Apply
Posted 3 days ago | Updated 2 days ago

Contract Only-Azure Databricks Architect

Corporate Biz Solutions Inc

•

Branchville, New Jersey, USA

Third Party, Contract

Azure Databricks Architect Branchville, NJ - Onsite Contract 10+ years of experience in data engineering and architecture roles. 4+ years of experience specifically with Azure Databricks and Spark. Strong experience with Azure services: Data Factory, Data Lake, Key Vault, Synapse Analytics, Event Hubs, and Functions. Expertise in PySpark, SQL, and optionally Scala or Python. We are an Equal Opportunity Employer. Thanks! Ronalyn
Easy Apply
Posted 30 days ago | Updated 26 days ago

Big Data Technology Architect

Accenture LLP

•

Remote or New York, New York, USA

Full-time

We Are Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world's largest network of Advanced Technology and Intelligent Operations centers. Our 738,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 c
Posted 7 days ago | Updated 1 hour ago