Apache Spark jobs

Chantilly, Virginia

•

Today

Job Number: R0245365 Spark Data Engineer, Senior The Opportunity: Ever-expanding technology like IoT, machine learning, and artifi cia l intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their big data to impact important missions-from fra

Full-time

USD 77,600.00 - 176,000.00 per year

Lead Spark Scala Engineer

Austin, Texas

•

Today

Job Title: Lead Spark Scala Engineer Role Summary We are seeking a Lead Spark Scala Engineer with strong expertise in Apache Spark and Scala to design, build, and optimize largescale data platforms. The ideal candidate must have prior Apple experience and proven ability to lead technical execution, manage distributed systems, and drive strategic initiatives across complex data environments. Key Responsibilities Design and develop Spark applications using Scala DataFrame APIs. Build and manage a

Easy Apply

Full-time, Part-time, Contract, Third Party

Senior AWS EMR / Spark Engineer - W2 Contract

Seattle, Washington

•

4d ago

Amazon s RFM team is seeking an engineer to optimize DRAM usage across EMR on EC2 clusters through cluster tuning, Spark/YARN optimization, and EC2 instance right-sizing. The role involves analyzing utilization, identifying over-provisioned resources, running optimization experiments, and delivering measurable memory/cost savings without impacting performance or SLAs.Key ResponsibilitiesAnalyze EMR, Spark, YARN, and CloudWatch metrics to identify memory waste, underutilized executors, and ineffi

Easy Apply

Contract

Depends on Experience

Kafka/Spark Developer

Pittsburgh, Pennsylvania

•

Today

Position Description: CGI is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintenance team, supporting our client which is a large US Bank, working in an advanced technology environment. This role will require someone at our client site 5 days a week in Pittsburgh, PA. Duties and Responsibilities: . As Kafka Spark Software developers, you will be responsible for developing and maintaining scalable big data solutions using Hadoop, Spark, Kaf

Full-time

USD 70,800.00 - 156,700.00 per year

Apache Spark/Core Java Developer

Bayonne, New Jersey

•

Today

Location: Bayonne, NJ Salary: $140,000.00 USD Annually - $145,000.00 USD Annually Description: Apache Spark/core Java Developer New York, NY 10110 Fulltime Final round F2F in NYC Core java, Apache Spark, Python, DB SQL, Linux, Application/ server-side development. Hands-on experience designing, building, and integrating analytical systems. Experience - 5-10 years Strong programming experience in Core Java Hands-on expertise in Apache Spark Proficiency in Python Strong knowledge of SQL and Data

Full-time

USD 140,000.00 - 145,000.00 per year

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Java/Spark Developer

Jersey City, New Jersey

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Market Risk Developer for a right to hire assignment with one of our premier financial services clients in Jersey City, NJ. Responsibilities: Architect and build robust, scalable data pipelines to ingest and process billions of trade-level PV calculations from various stress engines. Develop and optimize large-scale aggregation jobs using Apache Spark, ensuring high performance and efficiency. Design and deliver a suite of "inte

Contract

Java/Spark Developer

Tampa, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Java/Spark Developer for a contract assignment with one of our premier financial services clients in Tampa, FL . Responsibilities : Seeking a candidate with expertise in big data processing, particularly within the TechFin industry. Should have experience working with financial enterprise technologies and large-scale distributed computing systems. This role involves developing and optimizing data pipelines for credit risk calculatio

Contract

Senior Kubernetes Engineer (with Spark) - W2 Contract

Remote

•

2d ago

We are seeking an expert Kubernetes engineer to configure, deploy, and operate mission-critical Amazon EKS infrastructure supporting petabyte-scale data processing workloads. This role requires deep technical expertise in Kubernetes internals, large-scale cluster management, and Apache Spark optimization to support thousands of concurrent jobs processing large volumes of Bigdata. Core Responsibilities Design, deploy, and maintain production-grade Amazon EKS clusters architected for petabyte-scal

Easy Apply

Contract

Depends on Experience

Watsonx.data Consultant with Spark and scala experience

Remote

•

Yesterday

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Contract, Third Party

Depends on Experience

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Databricks Engineer (Scala Spark)

Hybrid in Boston, Massachusetts

•

12d ago

Role: Databricks Engineer (Scala/Spark) Location: Quincy, MA Industry: Financial Services Key Skills: Databricks, AWS, SQL, Scala, Bigdata Overall experience 9-12 years in Scala-Spark data engineering and Data pipeline designExperience in Databricks preferredHands on experience in Design and development of Ingestion pipeline, ETL pipeline and jobs in Databricks. Databricks workspace and cluster configuration and Job scheduling and workflow managementHands on experience in Scala-Spark Developmen

Easy Apply

Contract, Third Party

Depends on Experience

Core Java + Apache Spark Engineer

Tampa, Florida

•

Today

Job Title: NAM-US-Java Developer-Supervisory (USD) Location: Tampa, FL Duration: Contract - 6 months, potential Right-to-Hire About TSR TSR is a trusted staffing and workforce solutions partner with more than 50 years of experience delivery highly qualified talent to support clients' most critical business and technology initiatives. Through a disciplined approach to sourcing, candidate vetting, and delivery, TSR helps organizations scale teams quickly while maintaining quality and reliability

Easy Apply

Contract

$90 - $90.59 per hour

QA Analyst with Python, Pandas and Py-Spark

Maryland

•

2d ago

QA Analyst Remote Long Term Rate:45/hr on 1099/c2c EST or CST(Need consultants from EST OR CST) Important Note - Need 3 years stay in US is mandatory Note: We request you to please go through the requirement carefully and send the resumes as per the requirement. Job Description: The candidate will work as a member of the Independent Verification & Validation (IV&V) and Data Quality Testing Team. Required technical skills for this position: 3+ years experience in Python knowledge of AWS clou

Contract, Third Party

Java Spark Engineer

Berkeley Heights, New Jersey

•

27d ago

Responsibilities: Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java) Lead design of batch and streaming ETL/ELT systems handling large data volumes Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reduction Set coding standards and lead code/design reviews across the team Drive technical decisions on data architecture, storage formats, and pipeline orchestration Mentor mid-level and junior engineers; ac

Easy Apply

Contract, Third Party

60 - 70

Big Data Engineer Python/Scala, Spark, Hadoop (LOCAL CANDIDATES ONLY)

Hybrid in Arlington, Virginia

•

Yesterday

Job Summary: Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable itExperience building robust and efficient data pipelines end-to-end with a strong focus on data qualityHigh proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platformsExperience in building and deploying production-level data-driven

Easy Apply

Contract, Third Party

Depends on Experience

Data/Snowflake Architect (Snowflake, Databricks, Talend, SPARK, Power BI, Microsoft Fabric)

Hybrid in New York, New York

•

3d ago

Minimum 10 years of recent experience in data architecture, data engineering, or a similar field. Hands-on expertise with PostgreSQL and Snowflake administration and performance tuning. Strong scripting and automation skills (Python, Ansible, etc.). Familiar with Cloud Based Architectures /Data-Warehousing Platforms, prior experience / knowledge in Snowflake Design Patterns and migration workflow would be a plus. Prior exposure building ML and generative AI solutions using Snowflake Cortex A

Easy Apply

Contract

Depends on Experience

Big Data Engineer – Python/Scala, Spark, Hadoop

Arlington, Virginia

•

9d ago

Role: Big Data Engineer Python/Scala, Spark, Hadoop Location: Arlington, VA (3 Days onsite/week) Exp Level : 6 to 12 Year Position : 2 Job Summary: Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality High proficiency in using Python or Scala, Spark, Hadoop platforms & tools

Easy Apply

Full-time, Third Party

$120000 - $135000

Senior Data Software Engineer, Spark, Java, Scala

Remote

•

Today

We are seeking a Senior Software Data Engineer to join our team in a software engineering capacity. This is not a data-science or analytics position centered on ad-hoc data exploration; instead, the role focuses on building software, data processing jobs, and data pipelines consumed by internal and external partners. Data is our main product and first-class citizen, and we value correct, high-quality data as much as clean and maintainable code. Responsibilities Write new data pipelines and jobs

Full-time

Java/Spark, Market Risk, Quantitative - C13

Rutherford, New Jersey

•

17d ago

Title: Senior Java Spark Developer - Market Risk Location: Jersey City, NJ Employment Type: Contract - Hybrid Compensation: Pay Range: $79.00-$89.00 Per HR Job Summary: Join our dynamic team as a Senior Developer focusing on building and optimizing distributed data platforms. This role is based in Jersey City, NJ, and offers a hybrid work environment. As a key player, you will design and implement scalable systems, collaborating with cross-functional teams to enhance risk analytics. This

Easy Apply

Contract, Third Party

$79 - $89