apache spark jobs

Principal Solutions Architect - AI & Data Science

Salisbury, Maryland

•

Today

Perdue Foods has a goal of becoming the most trusted name in premium proteins by creating products for consumers and for retail and foodservice customers around the globe while changing the way animals are raised for food. It is part of Perdue Farms, a fourth-generation, family-owned food and agricultural business deeply rooted in tradition yet with a forward-thinking mindset. We believe that success starts with our people, and our culture is built on a foundation of teamwork, integrity, and res

Sponsored

Full-time

USD 143,000.00 - 215,000.00 per year

Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations)

McLean, Virginia

•

Today

Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying da

Full-time

USD 225,400.00 - 257,200.00 per year

Data Engineer - Spark & Scala

Remote

•

Today

Data Engineer - Spark & Scala Remote Role Experience with Azure/AWS technologies like Synapse, IAAS VM, SQLserver and ADSL Gen 2should be solid in Spark, Scala Programming, SQL and Powershell Scripting.Experience with developing, maintaining, and debugging Azure automation account run books using PowershellKnowledge of performing SQL server DB backup restore through storage account, Azure and OnPrem SQLSolid understanding of distributed computing concepts and Spark processingPreferred prior expe

Easy Apply

Contract, Third Party

Depends on Experience

Data Architect( Data Warehouse, Data lake , Big Data ,Hadoop, Spark, Python , Customer 360, Google Cloud Platform, and Banking Domain exp)

Sunrise, Florida

•

Today

Role: Data Architect Location: Sunrise, FL onsite JD: 12-14 years of overall IT experience with expertise in Data landscape - Data Warehouse, Data lake etc.Hands on experience in Big Data and Hadoop ecosystem; Strong skills in SQL, Python or SparkProficient in Data Warehousing concepts and Customer Data Management (Customer 360)Experience in Google Cloud Platform platform - Dataflow, Dataproc, Kubernetes containers etc.Expertise in deep Data exploration and Data analysisExcellent communication a

Easy Apply

Contract

$60 - $70

W2/1099 (No C2C) Senior Java Big Data Engineer (Spark / Google Cloud Platform / Kubernetes)

Remote

•

Today

Job Title: Senior Java Big Data Engineer (Spark / Google Cloud Platform / Kubernetes)Richardson, TX 75082Duration: 12 MonthsExperience Required: 8+ Years Must Have SkillsJava Spring Boot Apache Spark SQL Scala* (listed as Scarlet in JD, corrected for accuracy) HBase Google Cloud Platform (Google Cloud Platform) Jenkins Kubernetes Nice to Have Skills(Identical to Must-Haves) Java Spring Boot Spark SQL Scala HBase Google Cloud Platform Jenkins Kubernetes Job DescriptionLooking for an experienced

Easy Apply

Contract

Depends on Experience

Spark and Scala Developer

Irving, Texas

•

Today

Required Qualifications: At least 4 years of experience with Information Technology. Strong understanding of distributed computing principles and big data technologies At least 2 years of experience working with Apache Spark, Scala, Spark SQL and Starburst Knowledge of data serialization formats such as Parquet, Avro, or ORC Familiarity with data processing and transformation techniques Preferred Qualifications: Experience with data lakes, data warehouses, and ETL processes Good understanding of

Easy Apply

Full-time

Lead/Principal Data Engineer/ Architect (HDFS, S3, Spark, Kafka)

Charlotte, North Carolina

•

Today

Trigyn has an immediate opening for Lead/Principal Data Engineer in Charlotte, NC (Remote). The particulars of the opportunity are below: Description: ? Must be able to architect new systems from scratch. experience in modern cloud Data technologies, including Spark, Spark Streaming, Confluent Kafka, Git, Databricks, CICD, SQL, and ETL tools such as Data Stage. ? Possess experience in Python and Spark for automation, data transformation, reporting, data manipulation, and data cleaning. Require

Contract, Third Party

DOE

Big Data Java Spark Developer

Jersey City, New Jersey

•

Today

Grow your career an innovative global bank in Jersey City, NJ as a Big Data Developer with strong Java, Hadoop, Scala, Spark expeirence. Contract role with strong possibility of extension. Will require working a hybrid schedule 2-3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their know

Easy Apply

Full-time

0/hr - 0/hr

Senior Spark/PySpark Developer

Hybrid in Montgomery, New Jersey

•

9d ago

Title: Senior Spark/PySpark Developer Location: Hybrid work in Skillman, NJ (Three days onsite is a must) Duration-12 months contract Overall, Skills needed: Working knowledge of industry standard Data Infrastructure (e.g. Warehouse, BI, Analytics, Big-Data, etc.) toolsProficient at developing, architecting, standardizing and supporting technology platforms using Industry leading ETL solutions.Building scalable and high throughput systemsExperience with agile BI & ETL practices to assist with

Easy Apply

Full-time, Third Party

$70 - $90

Azure Databricks Engineer with Python & Spark - 2 Positions (Senior & Lead) - Only W2

Weehawken Township, New Jersey

•

Today

Role: Azure Databricks Engineer with Python & Spark (Senior / Lead) Location: Weehawken, NJ (Onsite from Day 1) Job Type: W2 Contract Note: 2 positions are available - Senior & Lead Experience Level: Senior OR Lead Must have skills (Mandatory): Apache Spark Python Azure Data Factory Azure SQL Microsoft Azure Synapse Analytics ETL/ELT Solutions Nice to have skills: Apache Kafka CI/CD Experience & Qualifications: Expert level understanding of Azure Data Factory, Azure Synapse, Azure SQL, Azure

Easy Apply

Contract, Third Party

Sr Data Analyst- ML/AI Expertise, big data platforms (Spark, Hadoop),data scientist- Need Local to Peoria, IL- NO Visa sponsorship OR Transfer

Peoria, Illinois

•

2d ago

Sr Data Analyst Peoria, IL( Onsite- 5 Days a week) Fulltime Hire Key Responsibilities Lead the development of advanced analytics solutions for equipment telemetry, IoT sensor data, and operational datasets. Perform exploratory data analysis on large and complex datasets to uncover trends, patterns, and actionable insights. Apply machine learning algorithms to solve real-world business problems, including predictive maintenance and anomaly detection. Architect and deploy scalable ML models into p

Easy Apply

Full-time

$100,000 - $120,000

Java Lead with AWS Glue, Spark

Hybrid in McLean, Virginia

•

2d ago

Position: Java Lead with AWS Glue, Spark Location: McLean, VA 22102 & Wilmington, DE (Hybrid Model) Job Type: 12+ Months Contract Note: Only W2 (No C2C) Required Qualification Java Backend Developer.Java & Spark, AWS, (stepfunction, Glue & Lambda).Building ETL pipeline, extraction & loading.Receive file from Discover, transfer to C1 ecosystem.

Easy Apply

Contract

Depends on Experience

Big Data Engineer (Spark / Scala / Power BI) @ USA _ Remote

Remote

•

Today

Position: Big Data Engineer (Spark / Scala / Power BI)Location: Redmond, WA (Remote) Must work in PST time zone)Duration: Long Term Please share the resume at Job DescriptionWe are seeking an experienced Big Data Engineer with strong expertise in Apache Spark, Scala, SQL, and Power BI. The ideal candidate will be responsible for designing scalable data solutions, developing analytical workflows, and delivering interactive reports to support business decision-making. Key ResponsibilitiesDesign,

Easy Apply

Contract

55 - 60

Backend Developer - Java / Spark / AWS (ETL Pipeline)

Virginia

•

Today

STRATEGIC STAFFING SOLUTIONS HAS AN OPENING! Job Title: Backend Developer Java / Spark / AWS (ETL Pipeline) Location McLean, VA ; Wilmington, DE On-Site Duration:7+ Months Role Type: W2 Contract Engagement Overview We are seeking an experienced Backend Developer to design and implement ETL data pipelines supporting data ingestion, transformation, and integration within the Bank ecosystem. This role will focus on developing services that extract and load files received from Discover into inter

Easy Apply

Contract

USD0 - USD0

Ab Initio & Spark Admin

Irving, Texas

•

8d ago

We are looking for an experienced Ab Initio & Spark Administrator to join our team. The ideal candidate will have strong hands-on experience in Ab Initio and Spark administration, with solid expertise in Linux/Unix environments. Location: Irving, TX, Tampa, FL, Or Delaware (On-site) Duration: 6 months (possibility of extension) JD:5+ years of relevant experience in Ab Initio and Spark administration.Strong understanding of Linux/Unix environments.Hands-on experience with job management and plat

Easy Apply

Contract

Depends on Experience

Big Data Engineer / Scala Developer (Hybrid Onsite - W2 contract)

Hybrid in Atlanta, Georgia

•

Today

Job Title : Big Data Engineer / Scala Developer Location: Atlanta, GA (3 days a week Hybrid onsite) Duration : Long term contract Contract: W2 Job Description: Key Responsibilities: Design and implement high-performance data pipelines using Apache Spark and Scala.Optimize Spark jobs for efficiency, scalability, and reliability.Collaborate with cross-functional teams and diverse data sources to deliver data-driven insights.Monitor, troubleshoot, and maintain production data pipelines to ensure

Easy Apply

Contract

$60 - $70

SAS Lead Consultant

Hybrid in Irving, Texas

•

8d ago

Job Title: SAS Lead Consultant Location: Irving, TX ( 3 days from Office ) Job Type: Only Fulltime Experience Required: Minimum 10 YearsJob Description:Analyze SAS programs to understand sources, dependencies, data flow. Sanitize SAS programs in preparation for conversion.Optimize SAS programs in preparation for conversion.Incorporate changes in accelerator to ensure generated code aligns to required standardsUtilize accelerator to convert SAS programs to PySpark programs.Demonstrate and documen

Easy Apply

Full-time

$100,000 - $120,000

Java Developer with Spark and Scala expertise (Onsite in Scottsdale AZ)

Scottsdale, Arizona

•

Today

Mandatory Skills: Minimum 8-12 years of hands-on experience in Java (version 8 or above)Expertise in Spring Boot frameworkStrong proficiency in Spark and ScalaSolid understanding of RESTful web servicesExperience with version control systems such as Git/GitLabBuild tools: Maven and/or Gradle

Easy Apply

Contract, Third Party

Depends on Experience

Data Engineer with Apache Spark, Apache NiFi - Hybrid - St.louis,MO - Must be local

Hybrid in St. Louis, Missouri

•

Yesterday

Job title: Data Engineer with Apache Spark, Apache NiFi Location: Hybrid in St Louis, MO Duration: Longterm Must have: Apache Spark, Apache NiFi, etc Job Description: We are looking for a hands-on Data Engineer with strong experience in designing, developing, and maintaining large-scale data processing systems. The ideal candidate should have solid expertise in Apache Spark and a good understanding of modern data engineering tools and technologies. Required Skills: Experience working on on-prem

Easy Apply

Contract, Third Party

Depends on Experience

Java Spark Developer

New Jersey

•

21d ago

Title: Java Spark Developer Location: Jersey City, NJ/ NYC, NY Job Description: Mandatory Skills: Strong experience in Java Spark, understanding of distributed computing, big data principles, and batch processing. Proficiency in understanding and working with AWS services, especially S3, Glue and Athena. Detailed Description: Combine interface design concepts with digital design and establish milestones to encourage cooperation and teamwork. Develop overall concepts for improving the user ex

Third Party

Data Engineer St Louis, MO Need Local In-person interview

Hybrid in St. Louis, Missouri

•

Yesterday

Data Engineer Hybrid in St Louis, MO Need Local In-person interview Long Term Contract Apache Spark, Apache NiFi Data Engineer with strong experience in designing, developing, and maintaining large-scale data processing systems. The ideal candidate should have solid expertise in Apache Spark and a good understanding of modern data engineering tools and technologies. Experience working on on-premises setups and willingness to continue working in on-premises environments. Strong hands-on experienc

Easy Apply

Third Party, Contract

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

apache spark jobs