Search Jobs | Dice.com

3259 results (156 new)

Group by company

Apache Spark / Big Data Administrator

MphasiS Corporation USA

Berkeley Heights, New Jersey • 18d ago

Easy Apply

Full-time

$100,000 - $120,000

Databricks/Spark Migration Delivery Consultant

Randstad Digital

Remote or Menlo Park, California • Today

Contract

USD65 - USD70

Databricks/Spark Migration Delivery Consultant

Randstad Digital

Remote or Menlo Park, California • Today

Contract

USD65 - USD70

Java Spark Backend Developer

Motion Recruitment Partners, LLC

Jersey City, New Jersey • Today

Easy Apply

Contract

$90 - $97.83

Bigdata /Hadoop/Spark Admin

Envision Technology Solutions

Berkeley Heights, New Jersey • Yesterday

Easy Apply

Third Party, Contract

Java/Spark Developer

Software Guidance & Assistance

Jersey City, New Jersey • Today

Contract

Only Local to NY - Java Spark Developer ( In Person Interview mandatory)

Bright Sol

Hybrid in New York, New York • Today

Easy Apply

Contract, Third Party

55 - 60

Data Engineer – Oracle, Spark

Rivago infotech inc

Irving, Texas • Today

Easy Apply

Third Party, Contract

50 - 58

Need Sr. Hadoop Developer with Spark, Python & Health Insurance experience:: Jacksonville, FL (Hybrid)

Synergy Technologies, LLC

Hybrid in Jacksonville, Florida • 11d ago

Easy Apply

Contract

Depends on Experience

Apache Spark/Core Java Developer

Judge Group, Inc.

Bayonne, New Jersey • Today

Full-time

USD 140,000.00 - 145,000.00 per year

Lead Databricks/Spark Engineer

InfiCare

Almont, Colorado • 6d ago

Easy Apply

Contract, Third Party

Depends on Experience

Remote Data Engineer (Snowflake, Spark/Scala)

Software Guidance & Assistance

Remote or Jacksonville, Florida • Today

Contract

USD 50.00 - 55.00 per hour

Senior AWS Python Developer / Pyspark Data Engineer

System One

Hybrid in Knoxville, Tennessee • Yesterday

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer

System One

Hybrid in Lafayette, Louisiana • 14d ago

Easy Apply

Full-time

Depends on Experience

Senior Telecom Data Engineer - Verizon, AT&T, Nokia, Tmobile experience only with Python, BigQuery, Looker, Tableau, Power BI, Spark (PySpark)

APN Software Services, Inc

Remote • Today

Easy Apply

Third Party, Contract

55 - 67

Hybrid: Lead Data Engineer - Databricks/AWS (Locals only)

J-RAM IT Consulting Inc.

Hybrid in Dallas, Texas • 2d ago

Easy Apply

Contract, Third Party

Depends on Experience

AWS Data Engineer Spark & Databricks

Tymon Global

Hybrid in Dallas, Texas • 9d ago

Easy Apply

Contract

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

System One

Hybrid in Columbia, South Carolina • 14d ago

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

System One

Hybrid in Knoxville, Tennessee • 3d ago

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

System One

Hybrid in Birmingham, Alabama • 14d ago

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

System One

Hybrid in Knoxville, Tennessee • 11d ago

Easy Apply

Full-time

Depends on Experience

Software Engineer 2 - Spark/MapReduce/SQL/NoSQL/Pandas/Numpy/SciPy

Captivation Software

Annapolis, Maryland • Today

Full-time

USD 130,000.00 - 270,000.00 per year

Senior Staff Applications Engineer - Spark

Crusoe

Denver, Colorado • Today

Full-time

USD 190,000.00 - 215,000.00 per year

Principal Sustaining Engineering Manager - Spark

Crusoe

Denver, Colorado • Today

Full-time

USD 225,000.00 - 255,000.00 per year

Principal NPI Engineering Manager - Spark

Crusoe

Denver, Colorado • Today

Full-time

USD 225,000.00 - 255,000.00 per year

Lead Software Engineer - DataBricks, Spark, Terraform

JPMorgan Chase & Co.

Chicago, Illinois • Today

Full-time

USD 137,750.00 - 185,000.00 per year

Software Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWS

Captivation Software

Annapolis, Maryland • Today

Full-time

USD 130,000.00 - 270,000.00 per year

Manager of Software Engineering - Spark, AWS, Databricks, Java

JPMorgan Chase & Co.

Wilmington, Delaware • Today

Full-time

Senior Data Engineer - Oracle, Spark & Cloud Analytics

Katalyst Healthcares and Lifesciences

Charlotte, North Carolina • 3d ago

Full-time

Software Engineer lll - Senior Databricks/Spark/AWS Data Engineer

JPMorgan Chase & Co.

Columbus, Ohio • Today

Full-time

Job Details

Skills

Apache Spark
Splunk
Big Data
Hadoop
HDFS
Kafka
Hive

Summary

Job Description

10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance.
Focuses on cluster health, performance tuning, and production data pipelines.
Technical Experience: Deep hands-on experience with Apache Spark architecture (Driver, Workers, Executors, RDDs/DataFrames) and cluster managers (YARN, Kubernetes, or Mesos).
OS & Scripting: Strong proficiency in Linux/Unix administration and scripting languages (Bash, Python, or Scala).
Ecosystem Knowledge: Familiarity with big data and streaming tools like Hadoop HDFS, Kafka, Hive, or monitoring suites (Splunk, Prometheus, Grafana).
Debugging Skills: Strong analytical capabilities to inspect logs, thread dumps, and metrics under heavy production loads
Excellent coordination with stakeholders and communication skills

Must have experience with below responsibilities

Cluster Management: Install, configure, and maintain Apache Spark clusters and node infrastructure in production and staging environments.
Performance & Monitoring: Monitor cluster health, resource utilization (CPU, memory), and execution logs using tools like Spark UI, Splunk, or Elastic. Identify bottlenecks and optimize job execution times.
Troubleshooting: Diagnose and resolve out-of-memory errors, executor failures, shuffle issues, and node crashes in distributed workloads.
Pipeline & Integration Support: Support data engineers and developers in managing Spark applications, streaming jobs, and integrations with message brokers like Kafka.
Security & Access Control: Implement security principles, role-based access control, authentication, and data encryption across the cluster.
Backup & Disaster Recovery: Execute backup, recovery, and failover plans for Spark applications, configurations, and critical data stores.

Patching & Upgrades: Apply software patches, driver updates, and version upgrades with minimal disruption to ongoing production jobs.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 501494924
Position Id: 9118481
Posted 18 days ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Contact the job poster

Rishinath Arunavel

Recruiter @ MphasiS Corporation USA

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Bigdata /Hadoop/Spark Admin

Berkeley Heights, New Jersey

•

Yesterday

Role: Apache Spark / Big Data Administrator Location: Berkley Heights, NJ Onsite Job Description 10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance. Focuses on cluster health, performance tuning, and production data pipelines. Technical Experience: Deep hands-on experience with Apache Spark architecture (

Easy Apply

Third Party, Contract

Senior Data Engineer - Hybrid

Jersey City, New Jersey

•

Today

Genesis10 is currently seeking a Senior Data Engineer - Hybrid for a contract position with a Global Financial Institution located in Jersey City, NJ. This is a 12 month contract opportunity. This role will be responsible for working closely with technical leads and Product Owners to deliver and support data, analytics, and reporting functionalities on an enterprise platform. The right candidate will be responsible for hands-on application development and migration of legacy database modules ove

Easy Apply

Full-time

USD 58.26 - 66.26 per hour

Java Spark Backend Developer

Jersey City, New Jersey

•

Today

Grow your career as a Java Spark Backend Developer with an innovative global bank in Jersey City, NJ. Contract role with strong possibility of extension. Will require working a hybrid schedule 3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you. Contract

Easy Apply

Contract

$90 - $97.83

Data Engineer

Berkeley Heights, New Jersey

•

Yesterday

Role: Data Engineer Java & Spark Work Location: Alpharetta, GA or Berkeley Heights, NJ. Exp: 12+ Years Strong experience in Java and Apache Spark. Hands-on experience in data engineering and big data technologies.

Easy Apply

Contract

Depends on Experience

Job Details

Skills

Apache Spark
Splunk
Big Data
Hadoop
HDFS
Kafka
Hive

Summary

Job Description

10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance.
Focuses on cluster health, performance tuning, and production data pipelines.
Technical Experience: Deep hands-on experience with Apache Spark architecture (Driver, Workers, Executors, RDDs/DataFrames) and cluster managers (YARN, Kubernetes, or Mesos).
OS & Scripting: Strong proficiency in Linux/Unix administration and scripting languages (Bash, Python, or Scala).
Ecosystem Knowledge: Familiarity with big data and streaming tools like Hadoop HDFS, Kafka, Hive, or monitoring suites (Splunk, Prometheus, Grafana).
Debugging Skills: Strong analytical capabilities to inspect logs, thread dumps, and metrics under heavy production loads
Excellent coordination with stakeholders and communication skills

Must have experience with below responsibilities

Cluster Management: Install, configure, and maintain Apache Spark clusters and node infrastructure in production and staging environments.
Performance & Monitoring: Monitor cluster health, resource utilization (CPU, memory), and execution logs using tools like Spark UI, Splunk, or Elastic. Identify bottlenecks and optimize job execution times.
Troubleshooting: Diagnose and resolve out-of-memory errors, executor failures, shuffle issues, and node crashes in distributed workloads.
Pipeline & Integration Support: Support data engineers and developers in managing Spark applications, streaming jobs, and integrations with message brokers like Kafka.
Security & Access Control: Implement security principles, role-based access control, authentication, and data encryption across the cluster.
Backup & Disaster Recovery: Execute backup, recovery, and failover plans for Spark applications, configurations, and critical data stores.

Patching & Upgrades: Apply software patches, driver updates, and version upgrades with minimal disruption to ongoing production jobs.

Dice Id: 501494924
Position Id: 9118481
Posted 18 days ago

Fitment

Dice Job Match Score™

To see how well you match this job, please log in or create an account.

Once logged in, be sure to complete your profile to get the most accurate match score.

Contact the job poster

Rishinath Arunavel

Recruiter @ MphasiS Corporation USA

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Bigdata /Hadoop/Spark Admin

Berkeley Heights, New Jersey

•

Yesterday

Easy Apply

Third Party, Contract

Senior Data Engineer - Hybrid

Jersey City, New Jersey

•

Today

Easy Apply

Full-time

USD 58.26 - 66.26 per hour

Java Spark Backend Developer

Jersey City, New Jersey

•

Today

Easy Apply

Contract

$90 - $97.83

Data Engineer

Berkeley Heights, New Jersey

•

Yesterday

Easy Apply

Contract

Depends on Experience