Apache Spark jobs

Berkeley Heights, New Jersey

•

9d ago

Job Description 10+ years solid experience with deploying, configuring, monitoring, and troubleshooting Apache Spark clusters and associated big data frameworks (such as Hadoop, Kafka, or cloud-based data platforms) to ensure high availability and performance.Focuses on cluster health, performance tuning, and production data pipelines.Technical Experience: Deep hands-on experience with Apache Spark architecture (Driver, Workers, Executors, RDDs/DataFrames) and cluster managers (YARN, Kubernetes,

Easy Apply

Full-time

$100,000 - $120,000

Application Programmer (Python/Spark) - Onsite

Pennington, New Jersey

•

Today

Genesis10 is currently seeking an Application Programmer (Python/Spark) for an Onsite position with a Global Financial Institution located in Charlotte, NC, Pennington, NJ or Plano, TX. This is a 12 month contract opportunity. This role is part of a growing Developer Experience (DevEx) department within the Global Technology division. This team is responsible for improving the experience for developers, advancing technology platforms through innovation, and reducing risk and improving quality a

Easy Apply

Full-time

USD 55.06 - 63.06 per hour

Java/Spark Developer

Jersey City, New Jersey

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Java/Spark Developer for a right to hire assignment with one of our premier financial services clients in Jersey City, NJ . Responsibilities : Take the immense output from our pricing and calculation engines-billions of P&L vectors across thousands of scenarios-and apply the complex aggregation logic required for our most important risk measures. Your primary mission is to build a platform that is not only incredibly fast and scalab

Contract

Java Spark Backend Developer

Jersey City, New Jersey

•

Today

Grow your career as a Java Spark Backend Developer with an innovative global bank in Jersey City, NJ. Contract role with strong possibility of extension. Will require working a hybrid schedule 3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you. Contract

Easy Apply

Contract

$90 - $97.83

Lead Databricks and Spark engineer - Onsite in GA

Atlanta, Georgia

•

Today

We are looking for a Lead Spark and Databricks engineer to support a strategic customer migration initiative. The ideal candidate should have strong hands-on experience with Apache Spark, Databricks, and Python, along with experience working on large-scale data platforms. This role will involve understanding existing applications/frameworks, resolving migration challenges, optimizing Spark workloads, and helping modernize solutions on Databricks. Required Skills Strong Apache Spark / PySpark ex

Easy Apply

Contract, Third Party

Depends on Experience

Kafka/Spark Developer

Hybrid in Pittsburgh, Pennsylvania

•

28d ago

Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full Time Work Model: Hybrid onsite and remote Responsibilities Develop and maintain scalable big data solutions using Hadoop, Spark, Kafka, and Impala to support enterprise data processing and analytics initiatives.Design, build, and optimize batch and real-time data pipelines for ingesting, processing, transforming, and delivering large volumes of structured and unstructured data.Develop Spark applications usi

Easy Apply

Full-time

Depends on Experience

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Scala / Apache Spark Developer

Hybrid in Jersey City, New Jersey

•

Today

Job Role: Scala / Apache Spark Developer (Onsite or Hybrid or Remote): Hybrid 3 days (Relocation allowed or Not allowed): Need locals either from NY/NJ Contract Duration: 11+ months Interview Mode: In-person at client location Position Overview The ideal candidate will have solid programming skills, experience developing scalable data processing solutions, and the ability to collaborate with technical teams in a fast-paced environment. Key Responsibilities Design, develop, and maintain applicat

Easy Apply

Contract, Third Party

Depends on Experience

Apache Spark/Core Java Developer

Bayonne, New Jersey

•

Today

Location: Bayonne, NJ Salary: $140,000.00 USD Annually - $145,000.00 USD Annually Description: Apache Spark/core Java Developer New York, NY 10110 Fulltime Final round F2F in NYC Core java, Apache Spark, Python, DB SQL, Linux, Application/ server-side development. Hands-on experience designing, building, and integrating analytical systems. Experience - 5-10 years Strong programming experience in Core Java Hands-on expertise in Apache Spark Proficiency in Python Strong knowledge of SQL and Data

Full-time

USD 140,000.00 - 145,000.00 per year

Need Sr. Hadoop Developer with Spark, Python & Health Insurance experience:: Jacksonville, FL (Hybrid)

Hybrid in Jacksonville, Florida

•

2d ago

Job Title: Sr. Hadoop Developer Location: Jacksonville, FL (Hybrid/Onsite) Experience: 10+ years preferred Job Description: We are seeking an experienced Senior Hadoop Developer with strong expertise in Hadoop, Spark, Python, SQL, and Stored Procedures. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing solutions, building ETL/ELT pipelines, and managing complex data integration workflows. Experience with Snowflake is a plus. Roles & R

Easy Apply

Contract

Depends on Experience

Lead Databricks/Spark Engineer

Almont, Colorado

•

Today

Job Title: Lead Databricks/Spark Engineer Location: Columbus, GA or Atlanta, GA (Onsite) Job Type: Contract Overview The ideal candidate will have deep hands-on expertise with Apache Spark, Databricks, and Python, and experience working on large-scale data platforms. This role involves understanding existing applications and frameworks, resolving migration challenges, optimizing Spark workloads, and modernizing solutions on Databricks. Required Skills Strong Apache Spark / PySpark experi

Easy Apply

Contract, Third Party

Depends on Experience

Data Analyst (6-10 yrs exp/Data Bricks/PySpark/Spark SQL/Power BI/Data Mapping/Modeling/Data Quality/Analysis): 6+ Mnths Hybrid Project Raleigh NC: $ 74/hr C2C/1099: $ 69/hr W2

Hybrid in Raleigh, North Carolina

•

2d ago

NCDIT 814178: This is a hybrid position. The manager is unsure how often he will need the contractor onsite, but the maximum requirement would be threedays a week on Tuesday, Wednesday, and Thursday. The ideal candidate will have hands-on expertise with Databricks (PySpark) and visualization tools, including both Databricks native tools and Power BI. In this role, you will be responsible for developing business requirements, supporting change management documentation, and actively collaborating

Easy Apply

Contract

69 - 74

Python AWS Spark Engineer, Plano, TX (Hybrid)

Hybrid in Plano, Texas

•

22d ago

Python AWS Spark Engineer Location: Plano, TX Duration: Long-TermJob SummarySeeking an experienced Python AWS Spark Engineer to join the team in Plano, TX. The ideal candidate will have strong hands-on experience with Python, Apache Spark/PySpark, AWS cloud services, and data engineering. This role will focus on developing scalable data processing solutions, building cloud-based data pipelines, and supporting enterprise data platforms. Key ResponsibilitiesDesign, develop, and maintain scalable d

Easy Apply

Contract

Depends on Experience

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

Senior AWS Python Developer

Hybrid in Lafayette, Louisiana

•

6d ago

Job Title: Senior AWS Python Developer / PySpark Data Engineer Location: Lafayette, LA Knoxville, TN Columbia, SC Birmingham, AL Type: Direct Hire Work Model: Hybrid Overview We are looking for a Senior Python + PySpark Data Engineer with strong AWS big data experience ideally someone who has worked in cybersecurity or security data environments. This is primarily a hands-on data engineering role, not a traditional Python application developer role. Responsibilities Developing scalable Py

Easy Apply

Full-time

Depends on Experience

Database Engineer

New York, New York

•

12d ago

A client of Innova Solutions is immediately hiring for a Database Engineer Position type: Full-time Contract (W2) Role: Database Engineer Duration: 4+ months Contract Location : New York, NY Remote role Must have Skills Python, Spark / PySpark, RESTful APIs, API versioning, input validation, pagination, and error standards in Python using FastAPI / Django / Flask, Airflow, Dagster, or similar Primary Skill Required for the Role: 5+ years of experience in Data Engineering or equivalent comb

Easy Apply

Contract

Depends on Experience

AWS Data Engineer Spark & Databricks

Hybrid in Dallas, Texas

•

Today

We are seeking an experienced AWS Data Engineer with 6+ years of experience in data engineering, cloud technologies, and large-scale data processing. The ideal candidate must have strong hands-on experience with AWS, Apache Spark, PySpark, and Databricks to build and optimize scalable data pipelines and data processing solutions. Roles & Responsibilities6+ years of experience in data engineering with strong hands-on expertise in AWS, Apache Spark, PySpark, and Databricks.Design, develop, and mai

Easy Apply

Contract

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

Hybrid in Knoxville, Tennessee

•

6d ago

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

Hybrid in Columbia, South Carolina

•

6d ago

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

Hybrid in Birmingham, Alabama

•

6d ago

Easy Apply

Full-time

Depends on Experience