Spark jobs

Hybrid in Wilmington, Delaware

•

15d ago

Position Summary: College Ave is seeking a Data Engineer to join our Data & Reporting team. This role focuses on the Databricks platform, building and maintaining data pipelines and databases that power our credit analytics. We're looking for someone with strong problem-solving, logical reasoning, and technical skills to ensure our data is reliable, scalable, and secure. Team: The Data Engineer-Credit Analytics falls under the Chief Operating Officer s remit and reports directly to the Head of D

Sponsored

Easy Apply

Full-time

$120,000 - $140,000

Lead Data Engineer (Python/Spark/AWS)

McLean, Virginia

•

Today

Lead Data Engineer (Python/Spark/AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engine

Full-time

USD 193,400.00 - 220,700.00 per year

Senior Manager Data Engineering (Python/Java, Spark/Pyspark, AWS)

Chicago, Illinois

•

Today

Senior Manager Data Engineering (Python/Java, Spark/Pyspark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a

Full-time

USD 204,900.00 - 233,800.00 per year

Senior Manager Data Engineer (Python/Java, Spark/Pyspark, AWS)

Chicago, Illinois

•

Today

Senior Manager Data Engineer (Python/Java, Spark/Pyspark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Cap

Full-time

USD 204,900.00 - 233,800.00 per year

W2-Data Engineer (Python / Spark / AWS) - F2F, VA

Virginia

•

Today

Job Title: Data Engineer (Python / Spark / AWS) Location: McLean, VA or Richmond, VA - Onsite | Face-to-Face (In-Person) Interview Positions: Multiple Duration: Long-Term Contract Rate: $55 57/hr Start Date: Immediate Role Summary: We are seeking talented and experienced Data Engineers with strong expertise in Python, Spark (PySpark), and AWS to work on enterprise-scale data modernization initiatives. The selected candidates will be responsible for building, optimizing, and maintaining rob

Easy Apply

Contract

W2-Data Engineer (Python / Spark / AWS) - F2F, TX

Texas

•

Today

Job Title: Data Engineer (Python / Spark / AWS) Location: Texas - Onsite | Face-to-Face (In-Person) Interview Positions: Multiple Duration: Long-Term Contract Rate: $55 57/hr Start Date: Immediate Role Summary: We are seeking talented and experienced Data Engineers with strong expertise in Python, Spark (PySpark), and AWS to work on enterprise-scale data modernization initiatives. The selected candidates will be responsible for building, optimizing, and maintaining robust data pipelines t

Easy Apply

Contract

Onsite- Sr. Scala Developer-F2F Must

New York, New York

•

2d ago

Position: Scala Developer Location: NYC, NY (Local or near by resources preferred) Duration; 12 Months we were looking for a more hands-on person with strong in-depth knowledge on Scala and more database knowledge Key Qualifications: Proficiency in Scala Moderate Java Experience is requiredExperience with SQL and NoSQL databases(Teradata, PostgreSQL, MongoDB)Expertise in ETL pipeline development and data warehousing(Snowflake, Redshift)Familiarity with cloud infrastructure AzureExperience with A

Easy Apply

Contract, Third Party

Depends on Experience

Kafka Admin

St. Louis, Missouri

•

8d ago

Kafka Admin and support- Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm.Monitoring and optimizing Kafka clusters.Troubleshooting Kafka related issues.Performing 3rd level administrator support for Kafka infrastructure.Maintaining the availability, performance and security of Kafka infrastructure.Creating and managing Kafka topics, producers, consumers, and Java-based Kafka consumers and producers to enable

Easy Apply

Contract, Third Party

Depends on Experience

Data Engineer (Python, Spark & Hadoop)

Hybrid in Irving, Texas

•

16d ago

Key Responsibilities: Design, develop, and optimize scalable data pipelines usingApache Spark,Python, andHadoop.Implement robust data ingestion, transformation, and storage solutions for large-scale datasets.Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.Manage and deploy Big Data tools and frameworks includingKafka,Hive,HBase, andFlink.Ensure data quality, integrity, and availability across distributed systems.Conduct perf

Easy Apply

Full-time

Depends on Experience

Java Spark Developer

Wilmington, Delaware

•

Today

Job description:-Job Title: Java Spark Developer Experience Level: [8-12 years] Location: Wilmington DE ( 5 Days Onsite every Week) JOB Description Engineering / Technology: Key responsibilities include developing efficient data workflows, monitoring database performance, ensuring data governance and security, and working with cloud platforms (AWS, AWS Glue). Familiarity with scheduling tools like Grafana and Control-M, pipeline frameworks such as Apache Airflow, and monitoring tools like Splu

Easy Apply

Full-time, Contract

BASED ON EXPERIENCE

Scala Developer - New York, NY (Onsite)

New York, New York

•

2d ago

Role: Scala Developer New York, NY (Onsite) In person Interview 12 Months+ Key Qualifications: Proficiency in ScalaExperience with SQL and NoSQL databases(Teradata, PostgreSQL, MongoDB)Expertise in ETL pipeline development and data warehousing(Snowflake, Redshift)Familiarity with cloud infrastructure AzureExperience with Apache Spark, Kafka, Databricks, and Airflow These roles provide an excellent opportunity to learn, grow, and work with leading technology in a fast-paced, innovative environm

Easy Apply

Contract, Third Party

Depends on Experience

Sr. Python Developer with Spark and AWS

McLean, Virginia

•

Yesterday

Role: Sr. Python Developer Location: McLean, VA (Hybrid - 3 days a week onsite) Job Type: Contract Required Skills: Python, Spark, AWS (S3, Lambda, IAM, SG etc.), AWS IAM Idaas Qualifications: Min. 06+ years of IT experience in Python technologies Working and Hands on experience on AWS Excellent expertise in Python Microservices Experience in Implementing Rest API using Python Primary skills Python , Spark, AWS (S3 , Lambda, IAM, SG ..etc.) Proficiency in Advanced SQL and SparkSQL Good exposu

Easy Apply

Contract, Third Party

Databricks Data Engineer || 14+ years experience || LinkedIn Must || Remote in Texas(Locals only)

Remote

•

2d ago

Role: Databricks Data EngineerDuration: Long-term contractLocation: RemoteExperience: 14+ years required Local to Texas Only Responsibilities: Design & develop scalable data pipelines using Apache Spark on Databricks Implement ETL/ELT workflows for structured & unstructured data Optimize Spark jobs for performance and cost Integrate with Azure Data Factory and other Azure services Automate deployments via CI/CD pipelines Ensure data quality, governance (Unity Catalog, Delta Lake), and security C

Easy Apply

Contract

Up to $65

Sr. Data Analytics Engineer - Databricks/Apache Spark, PySpark

Remote or San Jose, California

•

Yesterday

This is a remote position. Job Title: Sr. Data Analytics Engineer - Databricks/Apache Spark, PySpark Company: Ajmera Infotech Inc. Location: Remote (U.S., flexible across U.S. time zones) Employment Type: Contract - 1099 (Independent Contractor) Experience: 7+ years About Ajmera Infotech Inc.:Join Ajmera Infotech, a global engineering partner powering a $3-billion NYSE-listed health-tech company. Our 120-engineer team builds planet-scale data systems that support FDA-regulated devices, HIPAA-co

Contract

140 - 170 K

Core Java Developer, Spring, Scala, Apache Spark, Hadoop, Mongo DB, SQL, 12+ Mths Cont NYC

New York, New York

•

2d ago

JPC - 3485 Level 3 Role : 3 to 8 yrs exp Core Java Developer, Spring, Scala, REST AND WebServices, Apache Spark, Hadoop, Mongo DB, SQL, DevOps 12+ Mths Cont NYC Loc: NYC (Hybrid 3 Days a Week Onsite) Dur: 12+ Mths Cont Interview Type: Inperson MUST Description: Hybrid 3 Days a Week Onsite Technology Technology works as a strategic partner with MS business units and the world's leading technology companies to redefine how we do business in ever more global, complex, and dynamic financial marke

Easy Apply

Third Party, Contract

Sr. Golang Developer with Strong experience in Spark, Python, Golang.

Remote

•

3d ago

Position: Sr. Golang Developer Location: Remote Experience Needed:8+ Years Must have updated LinkedIn Candidate must show the DL copy on video at the time of submission Required Skills: Strong experience in Spark, Python, Golang. Description: 8 years of software development experience with a strong focus on GolangProficiency in Python for scripting or service developmentExpertise in RESTful API design, implementation, and integrationSolid grasp of SDLC processes including Agile methodologies, ve

Easy Apply

Contract, Third Party

Depends on Experience

AWS Data Engineer - Python, Pyspark, EMR, Spark, Kafka/ Kinesis, SQL/NoSQL

Hybrid in Illinois

•

Today

As a Data Engineer with deep expertise in Python, Pyspark, AWS, big data ecosystems, and SQL/NoSQL technologies, driving scalable, real-time data solutions with CI/CD and stream-processing frameworks. Experience: - 8+ Years Contract In-person Interview Required Location: - Chicago, IL (Local Only) Educational Qualifications: - Engineering Degree BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable. Mandatory skills: - Python, PySpark, AWS Good to have sk

Easy Apply

Contract, Third Party

$Depends on Experience

Onsite Data Engineer, AWS, Python, SQL, Snowflake, Spark

Coppell, Texas

•

8d ago

Onsite Data Engineer with 5-8+ years in Data Engineering, AWS, Snowflake, SQL, Python, API for a contract, potentially to hire position. No 3rd Party / C2C / H1B sponsorship. This position is 100% onsite near the greater Dallas / Coppell area. What you will be doing: Support and build data pipelines, ETL pipelines and integrations of multiple data sourcesCollaborate with data scientists for analysisManage noisy data with inconsistent values across sourcesDevelop APIs to share data internally an

Easy Apply

Contract

$40 - $45

Full Stack Engineer/Developer (Java / Spark)

Remote

•

8d ago

Job Title: Full Stack Engineer (Java / Spark) Location : Remote Hire Type :W2 Job Description: Proficient in Java, Spark, Scala, Hibernate, and Spring Boot. Experience with cloud platforms: AWS (Glue) and Azure (Databricks). Strong knowledge of MS-SQL Server and database management.

Easy Apply

Contract

$35 - $45

Senior Data Engineer Google Cloud Platform, BigQuery, Spark *** Direct End Client ***

Oakland, California

•

Today

Job Title: Senior Data Engineer Google Cloud Platform, BigQuery, Spark, Monte CarloWe are seeking a highly skilled and motivated Senior Data Engineer to join our data platform team. The ideal candidate will have hands-on experience with Google Cloud Platform (Google Cloud Platform) services, including BigQuery, Cloud Composer, Dataflow, and Apache Spark/PySpark, along with a strong understanding of data quality frameworks using Monte Carlo. You will be responsible for designing, building, and m

Easy Apply

Contract, Third Party

Depends on Experience

Senior / Staff Software Engineer (Spark, Kafka, Iceberg), Apple Data Platform

Washington

•

Today

Seeking extraordinary software engineers with deep experience in scalable streaming processing systems. You will have a passion to push the limits of distributed stateful streaming computing frameworks to get every ounce of performance out of them. Looking for engineers with in depth knowledge of systems like Spark, Beam, Kafka, Iceberg and other existing frameworks. Also someone who will be passionate by the prospect of working reciprocally with other groups internal to Apple and also communiti

Full-time

USD 171,600.00 - 302,200.00 per year

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization