Search Jobs | Dice.com

45 results (1 new)

Group by company

Apache Spark / Big Data Administrator

MphasiS Corporation USA

Berkeley Heights, New Jersey • Today

Easy Apply

Full-time

$100,000 - $120,000

Scala / Apache Spark Developer

Talent Groups

Hybrid in Jersey City, New Jersey • 4d ago

Easy Apply

Third Party, Contract

Depends on Experience

Apache Spark/Core Java Developer

Judge Group, Inc.

Bayonne, New Jersey • Today

Full-time

USD 140,000.00 - 145,000.00 per year

Manager, Data Science

American Express

New York, New York • Today

Full-time

USD 103,750.00 - 174,750.00 per year

Scala Sparks Developer

Ztek Consulting

Hybrid in New York, New York • 4d ago

Easy Apply

Contract, Third Party

Depends on Experience

Big Data Engineer

GlobalLogic Inc.

Bernards, New Jersey • Today

Easy Apply

Third Party, Contract

Depends on Experience

Machine Learning & Data Engineer, Bureau of Data Technology & Strategy

City of New York

New York, New York • Today

Full-time

USD 125,000.00 - 150,000.00 per year

Senior Java Big Data Developer - AVP

Citi

Jersey City, New Jersey • Today

Full-time

USD 121,200.00 - 181,800.00 per year

Senior Data Engineer - With DataBricks

Neurolynx Global inc

Remote • 18d ago

Easy Apply

Contract

Depends on Experience

Data Integration Lead, VP

MUFG

Jersey City, New Jersey • Today

Full-time

Principal Engineer, Big Data Platform

Pinterest, Inc.

Remote or San Francisco, California • Today

Full-time

USD 242,634.00 - 499,541.00 per year

Azure Databricks Platform Administrator

Saksoft

Raritan, New Jersey • 3d ago

Easy Apply

Third Party, Contract

Depends on Experience

Senior Software Engineer (Java- Big Data)

Grid Dynamics Holdings, Inc

Remote • Today

Full-time

Databricks Architect

GreyMatter Solutions

Remote • Today

Easy Apply

Contract

Depends on Experience

Senior Databricks / Snowflake Data Architect - BestX, VP

State Street Corporation

Clifton, New Jersey • Today

Full-time

USD 125,000.00 - 226,250.00 per year

Sr. Databricks Architect

SysMind, LLC

Remote • 18d ago

Easy Apply

Contract, Third Party

$78 - $84

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

EPAM Systems

Remote • Today

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

EPAM Systems

Remote • Today

Full-time

Lead Data Architect

Fulton Bank

Remote or Pennsylvania • Today

Full-time

USD 127,800.00 - 213,000.00 per year

Databricks Architect

TekLeaders, Inc

Remote or San Francisco, California • Today

Easy Apply

Full-time, Part-time, Third Party, Contract

Senior Data Software Engineer/ AI Agents, Azure, Spark

EPAM Systems

Remote • Today

Full-time

Big Data Architect IT Consultant Master

AHU Technologies Inc

Remote • Today

Full-time

USD 75.00 - 80.00 per hour

Lead AI Engineer with Spark, AWS Services

EPAM Systems

Remote • Today

Full-time

Senior AI Engineer with Spark, AWS Services

EPAM Systems

Remote • Today

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Software Guidance & Assistance

Remote or Jacksonville, Florida • Today

Contract

USD 50.00 - 55.00 per hour

Data Engineer

ANALYTICA

Remote or Washington, District of Columbia • Today

Full-time

Lead Data Architect - Databricks & AWS

Software Guidance & Assistance

New York, New York • Today

Contract

AWS ETL Data Engineer - REMOTE

NTT DATA, Inc.

Remote or Memphis, Tennessee • Today

Full-time

USD 97,725.00 - 162,875.00 per year

Lead Database Administrator

Cambium Learning Group, Inc.

Remote or Dallas, Texas • Today

Full-time

Electronic Health Record Data Engineer

Booz Allen Hamilton

Remote • Today

Full-time

USD 62,000.00 - 141,000.00 per year

Job Details

Skills

Apache Spark
Splunk
Big Data
Hadoop
HDFS
Kafka
Hive

Summary

Job Description

10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance.
Focuses on cluster health, performance tuning, and production data pipelines.
Technical Experience: Deep hands-on experience with Apache Spark architecture (Driver, Workers, Executors, RDDs/DataFrames) and cluster managers (YARN, Kubernetes, or Mesos).
OS & Scripting: Strong proficiency in Linux/Unix administration and scripting languages (Bash, Python, or Scala).
Ecosystem Knowledge: Familiarity with big data and streaming tools like Hadoop HDFS, Kafka, Hive, or monitoring suites (Splunk, Prometheus, Grafana).
Debugging Skills: Strong analytical capabilities to inspect logs, thread dumps, and metrics under heavy production loads
Excellent coordination with stakeholders and communication skills

Must have experience with below responsibilities

Cluster Management: Install, configure, and maintain Apache Spark clusters and node infrastructure in production and staging environments.
Performance & Monitoring: Monitor cluster health, resource utilization (CPU, memory), and execution logs using tools like Spark UI, Splunk, or Elastic. Identify bottlenecks and optimize job execution times.
Troubleshooting: Diagnose and resolve out-of-memory errors, executor failures, shuffle issues, and node crashes in distributed workloads.
Pipeline & Integration Support: Support data engineers and developers in managing Spark applications, streaming jobs, and integrations with message brokers like Kafka.
Security & Access Control: Implement security principles, role-based access control, authentication, and data encryption across the cluster.
Backup & Disaster Recovery: Execute backup, recovery, and failover plans for Spark applications, configurations, and critical data stores.

Patching & Upgrades: Apply software patches, driver updates, and version upgrades with minimal disruption to ongoing production jobs.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 501494924
Position Id: 9118481
Posted 13 hours ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Contact the job poster

Rishinath Arunavel

Recruiter @ MphasiS Corporation USA

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Apache Spark/Core Java Developer

Bayonne, New Jersey

•

Today

Location: Bayonne, NJ Salary: $140,000.00 USD Annually - $145,000.00 USD Annually Description: Apache Spark/core Java Developer New York, NY 10110 Fulltime Final round F2F in NYC Core java, Apache Spark, Python, DB SQL, Linux, Application/ server-side development. Hands-on experience designing, building, and integrating analytical systems. Experience - 5-10 years Strong programming experience in Core Java Hands-on expertise in Apache Spark Proficiency in Python Strong knowledge of SQL and Data

Full-time

USD 140,000.00 - 145,000.00 per year

Scala / Apache Spark Developer

Hybrid in Jersey City, New Jersey

•

4d ago

Job Role: Scala / Apache Spark Developer (Onsite or Hybrid or Remote): Hybrid 3 days (Relocation allowed or Not allowed): Need locals either from NY/NJ Contract Duration: 11+ months Interview Mode: In-person at client location Position Overview The ideal candidate will have solid programming skills, experience developing scalable data processing solutions, and the ability to collaborate with technical teams in a fast-paced environment. Key Responsibilities Design, develop, and maintain applicat

Easy Apply

Third Party, Contract

Depends on Experience

Scala Sparks Developer

Hybrid in New York, New York

•

4d ago

Hi, I would like to share an excellent opening Contact Scala Sparks Developer do go through the details and kindly send me the updated resume. Location : NYC, NY (Hybrid)- Local Candidate Type of Hire : Contract Mode of interview : WebEx / Teams /2nd round in person Job Summary: Key Responsibilities Develop, test, and maintain scalable data processing pipelines using Scala and Apache Spark.Implement data transformation and ETL workflows to handle structured and unstructured data.Utilize Pytho

Easy Apply

Contract, Third Party

Depends on Experience

Data Engineer

Remote or New York, New York

•

Today

RESPONSIBILITIES: Kforce's client in NYC is seeking a highly skilled Data Engineer with strong hands-on experience in Apache Spark/PySpark, AWS EMR, Databricks, and Snowflake. The Data Engineer will be responsible for designing and building scalable, high-volume data pipelines, optimizing distributed data processing workloads, implementing data quality and observability frameworks, and resolving complex performance and production challenges across cloud-based data platforms. REQUIREMENTS: * Str

Contract

$74 - $74 hourly

Job Details

Skills

Apache Spark
Splunk
Big Data
Hadoop
HDFS
Kafka
Hive

Summary

Job Description

10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance.
Focuses on cluster health, performance tuning, and production data pipelines.
Technical Experience: Deep hands-on experience with Apache Spark architecture (Driver, Workers, Executors, RDDs/DataFrames) and cluster managers (YARN, Kubernetes, or Mesos).
OS & Scripting: Strong proficiency in Linux/Unix administration and scripting languages (Bash, Python, or Scala).
Ecosystem Knowledge: Familiarity with big data and streaming tools like Hadoop HDFS, Kafka, Hive, or monitoring suites (Splunk, Prometheus, Grafana).
Debugging Skills: Strong analytical capabilities to inspect logs, thread dumps, and metrics under heavy production loads
Excellent coordination with stakeholders and communication skills

Must have experience with below responsibilities

Cluster Management: Install, configure, and maintain Apache Spark clusters and node infrastructure in production and staging environments.
Performance & Monitoring: Monitor cluster health, resource utilization (CPU, memory), and execution logs using tools like Spark UI, Splunk, or Elastic. Identify bottlenecks and optimize job execution times.
Troubleshooting: Diagnose and resolve out-of-memory errors, executor failures, shuffle issues, and node crashes in distributed workloads.
Pipeline & Integration Support: Support data engineers and developers in managing Spark applications, streaming jobs, and integrations with message brokers like Kafka.
Security & Access Control: Implement security principles, role-based access control, authentication, and data encryption across the cluster.
Backup & Disaster Recovery: Execute backup, recovery, and failover plans for Spark applications, configurations, and critical data stores.

Patching & Upgrades: Apply software patches, driver updates, and version upgrades with minimal disruption to ongoing production jobs.