apache spark Jobs in new jersey

Refine Results
1 - 20 of 391 Jobs

Sr. Lead Data Engineer (Databricks & Spark)

Microgreen Technologies LLC

Princeton, New Jersey, USA

Third Party, Contract

Sr. Lead Data Engineer (Databricks & Spark) Princeton, NJ (Hybrid) Responsibilities: Demonstrate a strong sense of ownership and responsibility with release goals. This includes understanding requirements, technical specifications, design, architecture, implementation, unit testing, builds/deployments, and code management.Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles aligned with organization standards.Build and maintain the en

Sr. Lead Data Engineer - Databricks & Spark (Onsite)

SRI Tech Solutions

Princeton, New Jersey, USA

Contract, Third Party

Responsibilities: Demonstrate a strong sense of ownership and responsibility with release goals. This includes understanding requirements, technical specifications, design, architecture, implementation, unit testing, builds/deployments, and code management.Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles aligned with organization standards.Build and maintain the environment for speed, accuracy, consistency and up timeHands-on p

Big Data/Spark Principal Architect

Marici Solutions

Remote

Full-time

Big Data/Spark Principal Architect | Location: Remote | Full Time Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Presales, Client Relationship, Presentation. Years Of Experience15 to 20 Years Job Description Handson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data

Roles: Sr Data Engineer (Databricks & Spark)Location: Princeton, NJ (Hybrid)

First Object Inc.

Princeton, New Jersey, USA

Full-time, Third Party

Roles: Sr Data Engineer (Databricks & Spark) Location: Princeton, NJ (Hybrid) Responsibilities: Demonstrate a strong sense of ownership and responsibility with release goals. This includes understanding requirements, technical specifications, design, architecture, implementation, unit testing, builds/deployments, and code management.Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles aligned with organization standards.Build and main

Python Spark Lead

ITBMS Inc.

Clinton, New Jersey, USA

Third Party, Contract

Design & develop scalable data applications using Python and Apache Spark for batch and real-time (streaming) data processing.Build, orchestrate, and optimize AWS Glue jobs to manage large-scale ETL workflows across heterogeneous data sources.Collaborate with data engineers and analysts to understand requirements and efficiently implement business logic and transformations.Implement robust error handling, logging, and performance tuning to support high-throughput, reliable data pipelines.Ensure

Senior Python Engineer with Spark

EPAM Systems

Remote

Full-time

We are looking for a talented Senior Python Engineer with Spark to join our team working on financial data and analytics. You'll be a crucial player in a team accountable for data integration and transformation, developing models and managing a vast array of structured financial data. You'll design and build robust software that efficiently processes data through our medallion architecture. We make use of cutting-edge technology with Databricks on Microsoft Azure. This position offers remote se

Databricks Developer: Java Spark

Zolon Tech Solutions Inc

Remote

Contract

Databricks Developer: Java Spark Location: Remote Duration: Long Term Task Description: The Databricks Developer will be responsible for designing, developing, and maintaining scalable data processing solutions on the Databricks platform, with a focus on integrating and transforming IRS datasets such as the Information Returns Master File (IRMF), Business Master File (BMF), and Individual Master File (IMF). This role requires advanced proficiency in Java and Apache Spark, and a deep understandi

Data Engineer - ETL, Spark hadoop and Funds background.

RIIM

Jersey City, New Jersey, USA

Full-time

Looking for Data Engineer having experience with ETL, Spark hadoop and Funds background. Jersey City, NJ - Hybrid ETL, spark hadoop as tech skills but needs someone from Funds background.Proficient in Hadoop, Python, Spark, SQL Unix and HiveBasic understanding of on Prem and Google Cloud Platform data securityHands on development experience on large ETL/ big data systems .Google Cloud Platform being a big plus

Data Engineer - Spark

Exl Service

Remote or Fremont, California, USA

Full-time

Company Overview: EXL Service is a global technology and analytics company specializing in delivering innovative, scalable, and high-quality technology solutions. Our global team consists of experienced professionals in design, software engineering, analytics, and data science, committed to solving complex business problems and enabling our clients to achieve their strategic goals. We focus on solving customer business problems by delivering products designed with best-in-class engineering pract

Jr. Data Engineer (Langchain, Spark) - Remote

ConsultNet, LLC

Remote or South Jordan, Utah, USA

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur

Senior Big Data/ Spark Engineer - C13

Citi

Remote or Irving, Texas, USA

Full-time

The Senior Big Data engineering lead will play a pivotal role in designing, implementing, and optimizing large-scale data processing and analytics solutions. This role requires a visionary leader who can drive innovation, define architecture strategy, and ensure the scalability and efficiency of our big data infrastructure. Key ResponsibilitiesLead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and re

Java Spark Developer - AVP

Citi

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an

Java Spark Senior Developer AVP C12 (Irving)

Citi

Remote or Irving, Texas, USA

Full-time

We are looking for a seasoned Developer who is passionate in writing clean and efficient code, building scalable systems, driving engineering excellence in a fast-paced, Agile environment. This role is ideal for developers with deep hands-on experience in Java and Apache Spark, combined with a strong foundation in object-oriented design principles. Responsibilities: Perform detailed impact analysis for code changes with understanding of dependencies across the application componentsDesign and

Senior java developer with Spark - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi

Databricks Developer

Zolon Tech Solutions Inc

Remote

Contract

Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on DatabricksImplement data processing logic in Java 8+, leveraging functional programming and OOP best practicesOptimize Spark jobs for performance, reliability, and cost-efficiencyCollaborate with cross-functional teams to gather requirements and deliver data solutionsEnsure compliance with data security, privacy, and governance standardsTroubleshoot and debug production issues in distributed data en

Big Data Developer

OJUS LLC

Berkeley Heights, New Jersey, USA

Contract, Third Party

Title:Big Data Developer (Location: NJ, DL, FL) Responsibilities: Strong Experience in Spark Scala Programing. Very extensive experience on Hive, Impala, Kafka & Hbase. Should have good knowledge on Spark Streaming. Clear understanding of Hadoop Ecosystem & Spark Architecture. Must have experience in Unix Shell Scripting, PL/SQL & Autosys Scheduler. Should have used udeploy, TeamCity, SharePoint. Should be expert in debugging & tracing errors/exceptions. occurred in Spark job execution. Must ha

Lead Data engineer

Cogent IBS, Inc

Princeton, New Jersey, USA

Contract

Minimum 8+ years of working experience in Technology (application development and production support).5+ years of experience in development of pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic goals.Minimum 3+ years of experience in developing & supporting ETLs and using Python/Scala in Databricks/Spark platform.Experience with Python, Spark, and Hive and Understanding of data-warehousing and data modeling techniques.Know

Big Data Developer

Hecta Data LLC DBA Vilwaa

Hanover, New Jersey, USA

Contract

Job Title: Python PySpark Big Data Developer Location: Whippany, NJ Duration: Long Term About US At Vilwaa (), we are focused towards delivering IT services and solutions in Data Engineering, Cloud Infrastructure solutions , Digital Application Development, (IoT) - Internet of Things. Job Description We are seeking a Python PySpark Big Data Developer with strong expertise in building scalable data processing solutions using PySpark and Python. You will design, develop, and optimize high perform

Data Engineer

Innova Solutions, Inc

Remote

Contract

Let Volt help move you forward Volt is immediately hiring for Data Engineer in Remote As a Data Engineer, you will: Key responsibilities: Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.Develop, implement, and deploy ETL solutions.Preprocess and analyze large datasets to identify patterns, trends, and insights.Evaluate, validate, and optimize data models to ensure efficiency, and generaliza

Lead Data Engineer-MicroStrategy (Onsite)

SRI Tech Solutions

Princeton, New Jersey, USA

Third Party, Contract

Micro Strategy Engineer: Having experience in creating visualizations on Power BI/ Tableau/ MicroStrategy preferably Micro Strategy Responsibilities: Demonstrate a strong sense of ownership and responsibility with release goals. This includes understanding requirements, technical specifications, design, architecture, implementation, unit testing, builds/deployments, and code management.Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding princi