Spark jobs | Dice.com

Chantilly, Virginia

•

Today

Job Number: R0245365 Spark Data Engineer, Senior The Opportunity: Ever-expanding technology like IoT, machine learning, and artifi cia l intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their big data to impact important missions-from fra

Full-time

USD 77,600.00 - 176,000.00 per year

Kafka/Spark Developer

Pittsburgh, Pennsylvania

•

Today

Position Description: CGI is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintenance team, supporting our client which is a large US Bank, working in an advanced technology environment. This role will require someone at our client site 5 days a week in Pittsburgh, PA. Duties and Responsibilities: . As Kafka Spark Software developers, you will be responsible for developing and maintaining scalable big data solutions using Hadoop, Spark, Kaf

Full-time

USD 70,800.00 - 156,700.00 per year

Lead Software Engineer, Full Stack (Python, Java, PySpark/Spark, AWS)

Plano, Texas

•

Today

Lead Software Engineer, Full Stack (Python, Java, PySpark/Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Full Stack Software Engineers who are passionate about marrying data with emerging t

Full-time

USD 179,400.00 - 204,700.00 per year

HYBRID::Senior Kubernetes Big Data Engineer (Kubernetes / AWS / Spark) at Rockville, MD or McLean, VA

Hybrid in Rockville, Maryland

•

4d ago

Hello, Greetings.! This is Hima from Appridat Solutions LLC. I was reviewing your resume online and would like to talk to you regarding an exciting opportunity for Senior Kubernetes Big Data Engineer (Kubernetes / AWS / Spark) at Rockville, MD or McLean, VA. We have with one of Appridat Solutions LLC premier clients. Title: Senior Kubernetes Big Data Engineer (Kubernetes / AWS / Spark) Location: Rockville, MD or McLean, VA (Hybrid 3 days onsite with 2 days remote) Duration: 6 Months with possibl

Easy Apply

Third Party, Contract

Depends on Experience

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Senior Kubernetes Engineer (with Spark) - W2 Contract

Remote

•

3d ago

We are seeking an expert Kubernetes engineer to configure, deploy, and operate mission-critical Amazon EKS infrastructure supporting petabyte-scale data processing workloads. This role requires deep technical expertise in Kubernetes internals, large-scale cluster management, and Apache Spark optimization to support thousands of concurrent jobs processing large volumes of Bigdata. Core Responsibilities Design, deploy, and maintain production-grade Amazon EKS clusters architected for petabyte-scal

Easy Apply

Contract

Depends on Experience

Java/Spark Developer

Jersey City, New Jersey

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Market Risk Developer for a right to hire assignment with one of our premier financial services clients in Jersey City, NJ. Responsibilities: Architect and build robust, scalable data pipelines to ingest and process billions of trade-level PV calculations from various stress engines. Develop and optimize large-scale aggregation jobs using Apache Spark, ensuring high performance and efficiency. Design and deliver a suite of "inte

Contract

Java/Spark Developer

Tampa, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Java/Spark Developer for a contract assignment with one of our premier financial services clients in Tampa, FL . Responsibilities : Seeking a candidate with expertise in big data processing, particularly within the TechFin industry. Should have experience working with financial enterprise technologies and large-scale distributed computing systems. This role involves developing and optimizing data pipelines for credit risk calculatio

Contract

Watsonx.data Consultant with Spark and scala experience

Remote

•

2d ago

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Third Party, Contract

Depends on Experience

Java Spark Engineer

Berkeley Heights, New Jersey

•

2d ago

Role: Java Spark Engineer Location: Berkley Heights, NJ Work Mode: 5-days in office Responsibilities: Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java) Lead design of batch and streaming ETL/ELT systems handling large data volumes Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reduction Set coding standards and lead code/design reviews across the team Drive technical decisions on data architectu

Easy Apply

Contract

60 - 70

Data Engineer (Pyspark /Python/spark) -Fulltime -Irving ,TX

Hybrid in Irving, Texas

•

2d ago

Data Engineer Irving,TX Fulltime Bachelor s or Master s degree in Computer Science, Engineering, Information Systems, or related field. 5 10 years of experience in Data Engineering. Strong expertise in SQL and Python. Experience with Apache Spark (Pyspark preferred). Hands-on experience with Hadoop ecosystem technologies. Experience with cloud platforms (AWS, Azure, or Google Cloud Platform). Experience building ETL pipelines using tools such as Informatica, Talend, DataStage, or cloud-native

Easy Apply

Full-time

Up to $105,000

Senior Data Engineer | Denver, CO |Strong SQL, Python, Spark, AI/ML, Delta Lake & Big Data experience required

Denver, Colorado

•

2d ago

Senior Data Engineer | Denver, CO | Strong SQL, Python, Spark, AI/ML, Delta Lake & Big Data experience required Job Title: Senior Data Engineer Job Overview: We are seeking a skilled professional with strong expertise in SQL, Python, Spark, and leading AI/ML frameworks to design and build scalable, intelligent data solutions. The ideal candidate will have hands-on experience with big data platforms and distributed data processing. Key Responsibilities: Extensive experience in SQL and databases

Easy Apply

Contract

Depends on Experience

Java Spark Engineer

Berkeley Heights, New Jersey

•

7d ago

Responsibilities: Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java) Lead design of batch and streaming ETL/ELT systems handling large data volumes Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reduction Set coding standards and lead code/design reviews across the team Drive technical decisions on data architecture, storage formats, and pipeline orchestration Mentor mid-level and junior engineers; ac

Easy Apply

Contract, Third Party

60 - 70

Data Engineer SQL Spark PySpark ADF Databricks

Hybrid in Irving, Texas

•

5d ago

Microsoft SQL Server SQL, Azure SQL, Azure DataBricks SQL Administrator " Location - Irving, TX, Hybrid 3 days Onsite Job Summary We are seeking a highly skilled Senior Database Developer with deep expertise in SQL Server and Azure SQL and hands-on experience with Databricks to design, develop, optimize, and maintain scalable data solutions. The ideal candidate will play a key role in building performant data models, supporting analytics and reporting needs, and collaborating with data engineers

Contract

$45 - $50

Java developer with Spark

Hybrid in Berkeley Heights, New Jersey

•

3d ago

Job Title:Java developer with Spark Location: Berkley Heights, NJ Duration: 12+ Months Bill Rate: $180k Job Type: W-2 Contract Client: To Be Discussed Later Work Authorization: USC GC H-1B OPT-EAD GC-EAD -EAD Job Summary Responsibilities: Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java) Lead design of batch and streaming ETL/ELT systems handling large data volumes Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimizati

Easy Apply

Contract

$160,000 - $180,000

Software Engineer Java/Spark

Rutherford, New Jersey

•

2d ago

Software Engineer Java/Spark Jersey City, NJ Long term Contract Java/Spark, Market Risk, Quantitative Tech assessment will be on Java What you'll do in the role: Deeply hands-on development while leading technical design and implementation of key components of the Market Risk platform. Communicate regularly with product leads across the technology organization and discuss opportunities for improvement to existing and future technology solutions. Implement scalable and high-performance computin

Easy Apply

Full-time, Part-time, Contract, Third Party

Java Spark Engineer

Remote

•

5d ago

Job Title:Java Spark Engineer Location: Westlake, TX Duration: 12 Months + Extension Bill Rate: $60/hour Job Type: Contract/1099 Client: To Be Discussed Later Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD Responsibilities: Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java) Lead design of batch and streaming ETL/ELT systems handling large data volumes Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job c

Easy Apply

Contract

$60 - $70

Data Engineer - & GC

Denver, Colorado

•

2d ago

Role: Data Engineer Location: Denver, CO - 4 days per week work from Client office Please find below JD for your reference. Primary Skill Expectations:- Strong in SQL, Spark , Good Communication. Job Overview: We are seeking a skilled professional with strong expertise in Python, Spark, and leading AI/ML frameworks to design and build scalable, intelligent data solutions. The ideal candidate will have hands-on experience with big data platforms and distributed data processing. Design, develop,

Easy Apply

Contract

$40 - $50

Google Cloud Platform Data Engineer

Hybrid in Phoenix, Arizona

•

2d ago

Skills: Years of experience : 5-7 yearsGoogle Cloud Platform Cloud : GCS, DataProc, BigQuery, Composer/AirflowBig Data: PySparkSpark, Python, Google Cloud Platform is must haveStrong experience with Spark , Data FramesBig Query background with data processing for large volumes Another NO Sql DB is big plus - Spanner DB & Graph DB Qualifications: Degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field (or equivalent work experience)6+ years of experienc

Easy Apply

Contract, Third Party

60 - 65

Scala/ Java Developer (Onsite- Local resources- F2F interview)

New York, New York

•

3d ago

Proficiency in Java, Python and SQL. Experience with Scala is required Experience with distributed data processing using Spark. Experience with databases technologies: Snowflake and Teradata preferably. Experience with cloud technologies (Azure, AWS, Google Cloud Platform). Experience with cloud compute technologies, Databricks. Experience with building data pipeline & ETL Development using Airflow. Experience with DevOps automation and CI/CD pipelines

Easy Apply

Contract

Depends on Experience