Spark jobs

Principal Solutions Architect - AI & Data Science

Salisbury, Maryland

•

Today

Perdue Foods has a goal of becoming the most trusted name in premium proteins by creating products for consumers and for retail and foodservice customers around the globe while changing the way animals are raised for food. It is part of Perdue Farms, a fourth-generation, family-owned food and agricultural business deeply rooted in tradition yet with a forward-thinking mindset. We believe that success starts with our people, and our culture is built on a foundation of teamwork, integrity, and res

Sponsored

Full-time

USD 143,000.00 - 215,000.00 per year

Lead Data Engineer (Java, Scala, Spark)

McLean, Virginia

•

Today

Lead Data Engineer (Java, Scala, Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engi

Full-time

USD 193,400.00 - 220,700.00 per year

Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations)

McLean, Virginia

•

Today

Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying da

Full-time

USD 225,400.00 - 257,200.00 per year

Spark and Scala Developer

Irving, Texas

•

2d ago

Required Qualifications: At least 4 years of experience with Information Technology. Strong understanding of distributed computing principles and big data technologies At least 2 years of experience working with Apache Spark, Scala, Spark SQL and Starburst Knowledge of data serialization formats such as Parquet, Avro, or ORC Familiarity with data processing and transformation techniques Preferred Qualifications: Experience with data lakes, data warehouses, and ETL processes Good understanding of

Easy Apply

Full-time

Big Data Java Spark Developer

Jersey City, New Jersey

•

Today

Grow your career an innovative global bank in Jersey City, NJ as a Big Data Developer with strong Java, Hadoop, Scala, Spark expeirence. Contract role with strong possibility of extension. Will require working a hybrid schedule 2-3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their know

Easy Apply

Full-time

0/hr - 0/hr

Lead/Principal Data Engineer/ Architect (HDFS, S3, Spark, Kafka)

Charlotte, North Carolina

•

Today

Trigyn has an immediate opening for Lead/Principal Data Engineer in Charlotte, NC (Remote). The particulars of the opportunity are below: Description: ? Must be able to architect new systems from scratch. experience in modern cloud Data technologies, including Spark, Spark Streaming, Confluent Kafka, Git, Databricks, CICD, SQL, and ETL tools such as Data Stage. ? Possess experience in Python and Spark for automation, data transformation, reporting, data manipulation, and data cleaning. Require

Contract, Third Party

DOE

Senior Spark/PySpark Developer

Hybrid in Montgomery, New Jersey

•

4d ago

Title: Senior Spark/PySpark Developer Location: Hybrid work in Skillman, NJ (Three days onsite is a must) Duration-12 months contract Overall, Skills needed: Working knowledge of industry standard Data Infrastructure (e.g. Warehouse, BI, Analytics, Big-Data, etc.) toolsProficient at developing, architecting, standardizing and supporting technology platforms using Industry leading ETL solutions.Building scalable and high throughput systemsExperience with agile BI & ETL practices to assist with

Easy Apply

Full-time, Third Party

$70 - $90

Java Lead with AWS Glue, Spark

Hybrid in McLean, Virginia

•

11d ago

Position: Java Lead with AWS Glue, Spark Location: McLean, VA 22102 & Wilmington, DE (Hybrid Model) Job Type: 12+ Months Contract Note: Only W2 (No C2C) Required Qualification Java Backend Developer.Java & Spark, AWS, (stepfunction, Glue & Lambda).Building ETL pipeline, extraction & loading.Receive file from Discover, transfer to C1 ecosystem.

Easy Apply

Contract

Depends on Experience

Big Data Engineer / Scala Developer (Hybrid Onsite - W2 contract)

Hybrid in Atlanta, Georgia

•

2d ago

Job Title : Big Data Engineer / Scala Developer Location: Atlanta, GA (3 days a week Hybrid onsite) Duration : Long term contract Contract: W2 Job Description: Key Responsibilities: Design and implement high-performance data pipelines using Apache Spark and Scala.Optimize Spark jobs for efficiency, scalability, and reliability.Collaborate with cross-functional teams and diverse data sources to deliver data-driven insights.Monitor, troubleshoot, and maintain production data pipelines to ensure

Easy Apply

Contract

$60 - $70

Data Engineer (Scala & Spark)

Hybrid in Atlanta, Georgia

•

3d ago

Job Title: Sr. Data Engineer Location: Atlanta, GA (Hybrid Onsite) Client: Financial Services (Direct) W2/Fulltime Key Responsibilities: Design and implement high-performance data pipelines using Apache Spark and Scala.Optimize Spark jobs for efficiency, scalability, and reliability.Collaborate with cross-functional teams and diverse data sources to deliver data-driven insights.Monitor, troubleshoot, and maintain production data pipelines to ensure seamless operations.Create and maintain compre

Easy Apply

Contract

$60 - $70

SAS Lead Consultant

Hybrid in Irving, Texas

•

17d ago

Job Title: SAS Lead Consultant Location: Irving, TX ( 3 days from Office ) Job Type: Only Fulltime Experience Required: Minimum 10 YearsJob Description:Analyze SAS programs to understand sources, dependencies, data flow. Sanitize SAS programs in preparation for conversion.Optimize SAS programs in preparation for conversion.Incorporate changes in accelerator to ensure generated code aligns to required standardsUtilize accelerator to convert SAS programs to PySpark programs.Demonstrate and documen

Easy Apply

Full-time

$100,000 - $120,000

Java Developer with Spark and Scala expertise (Onsite in Scottsdale AZ)

Scottsdale, Arizona

•

Today

Mandatory Skills: Minimum 8-12 years of hands-on experience in Java (version 8 or above)Expertise in Spring Boot frameworkStrong proficiency in Spark and ScalaSolid understanding of RESTful web servicesExperience with version control systems such as Git/GitLabBuild tools: Maven and/or Gradle

Easy Apply

Third Party, Contract

Depends on Experience

Senior Python/PySpark/Spark Developer

Hybrid in Princeton, New Jersey

•

4d ago

Title: Senior Python/PySpark/Spark Developer Location: Princeton areas NJ 08544 (Three days onsite is must) Duration: One Year Project Description: Migration of legacy data ingestion pipelines to a shared data management system (BDMS). The work will involve: Datasets will be loaded into BDMS New tools will be created to allow data analysts to modify the datasets Analysts will validate and cleanse the data which will then be delivered to AWS S3 Data will then be enriched using technologies like D

Easy Apply

Contract, Third Party

$80 - $90

Data Engineer- Python,, Spark/ PySpark, AWS, Golang || Onsite - Mclean VA

McLean, Virginia

•

2d ago

Data Engineer- Python,, Spark/ PySpark, AWS, Golang Onsite - Mclean VA Able to write complex SQL queries against Snowflake tables / Troubleshoot issues- Thanks Navya

Easy Apply

Contract

Depends on Experience

Junior Scala Developer

Remote

•

3d ago

Role: Junior Scala Developer Location: Remote Duration: 1-3 years of experience Ideally Must-haves: Hands-on Scala experienceUnderstanding of AWS cloud technologiesPractical knowledge of Apache KafkaFamiliarity with Spark Structured Streaming (in Scala)Experience with Git

Easy Apply

Contract

Depends on Experience

Java Spark Developer

New Jersey

•

29d ago

Title: Java Spark Developer Location: Jersey City, NJ/ NYC, NY Job Description: Mandatory Skills: Strong experience in Java Spark, understanding of distributed computing, big data principles, and batch processing. Proficiency in understanding and working with AWS services, especially S3, Glue and Athena. Detailed Description: Combine interface design concepts with digital design and establish milestones to encourage cooperation and teamwork. Develop overall concepts for improving the user ex

Third Party

Google Cloud Platform Data Engineer (W2 Position)

Phoenix, Arizona

•

14d ago

Google Cloud Platform Data Engineer (W2 Position) Location : Phoenix, AZ Duration: 6+ Months Need Local s & F2F Job Description: 7+ years of professional experience in Data Engineer. Strong expertise in SQL, Python, Spark. Hands-on experience in ERD design and relational data modelling. Proven experience working with Google Cloud Platform data services. Advanced experience with DBT for transformations and orchestration. Solid understanding of modern data architectures (data lakes, lakehouses, w

Easy Apply

Contract

Depends on Experience

Devops Engineer

Hybrid in San Jose, California

•

3d ago

Role: Devops Engineer Location: Raleigh NC and San Jose CA Job Requirements You will design and lead the team in important architectural decisions. The candidate will provide technical leadership for the team(s) they are associated with and participate in key technical decisions.They will engage with customers on escalations and ensure that there is continuous improvement in all areas.Participate in technical discussions within the team and with other groups within Business Units associated with

Easy Apply

Contract

Depends on Experience

Devops Engineer

San Jose, California

•

3d ago

Easy Apply

Contract

Depends on Experience

Backend Developer - Java / Spark / AWS (ETL Pipeline)

Virginia

•

Today

STRATEGIC STAFFING SOLUTIONS HAS AN OPENING! Job Title: Backend Developer Java / Spark / AWS (ETL Pipeline) Location McLean, VA ; Wilmington, DE On-Site Duration:7+ Months Role Type: W2 Contract Engagement Overview We are seeking an experienced Backend Developer to design and implement ETL data pipelines supporting data ingestion, transformation, and integration within the Bank ecosystem. This role will focus on developing services that extract and load files received from Discover into inter

Easy Apply

Contract

USD0 - USD0

Java Developer with Spark

Hybrid in Richmond, Virginia

•

11d ago

Job Title: Java Developer (Apache Spark) Location: Richmond, VA- Hybrid Employment Type: Contract Overview Seeking an experienced Java Developer with strong proficiency in Apache Spark to design and develop scalable, high-performance data processing applications. The candidate will collaborate with data engineers, solution architects, and DevOps teams to build reliable distributed systems supporting enterprise analytics and real-time data platforms. Key Responsibilities Design, develop, and opt

Easy Apply

Contract

$60 - $65

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization