Apache Spark jobs

Herndon, Virginia

•

Today

Absolute Business Solutions Corp (ABSC) is not just another tech company. We're a community of innovators, engineers, analysts and business professionals working together with our customers to tackle the most complex challenges. For more than 20 years we've supported critical DoD, IC and Federal Civilian missions and global, multi-national corporations. We specialize in supporting our clients in the Intelligence, Technology, Defense, AI/ML, and Data Science fields. As we continue to grow at a ra

Full-time

USD 150,000.00 - 275,000.00 per year

Modular Data Center Systems Engineer - Spark

Denver, Colorado

•

Today

Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack - from electrons to tokens - to power the world's most ambitious AI workloads. When you join Crusoe, you join a team that is building the future, faster. We're in the midst of the greatest industrial revolution of our time. The demand for AI compute is boundless, and power is a bottleneck.

Full-time

USD 148,740.00 - 170,000.00 per year

Software Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWS

Annapolis, Maryland

•

Today

Build to something to be proud of. Captivation has built a reputation on providing customers exactly what is needed in a timely manner. Our team of engineers take pride in what they develop and constantly innovate to provide the best solution. Captivation is looking for software developers who can get stuff done while making a difference in support of the mission to protect our country. Description Captivation Software is looking for a mid level software engineer who shall be responsible for

Full-time

USD 130,000.00 - 270,000.00 per year

Big Data Architect- Databricks, Spark, AWS

Atlanta, Georgia

•

Today

We are currently hiring a Big Data Architect for a hybrid role in Atlanta, GA Essential functions Data Architecture & Engineering Design and implement medallion architecture (raw, silver, gold layers) to enable efficient data ingestion, processing, and quality management.Develop standardized ETL and streaming pipelines using Databricks, Apache Spark, and Apache Airflow, ensuring low-latency data processing.Define and enforce data quality and observability frameworks, integrating dashboards and

Full-time

Senior Data Engineer - Enterprise Data Frameworks (Java Spark Focus)

Phoenix, Arizona

•

Today

Job Description Senior Java Data Engineer Enterprise Data Frameworks Role Summary The Enterprise Data Frameworks team is seeking a Senior Java focused software engineer who builds and maintains large scale data processing systems using Java, Apache Spark, and Kafka. This role is intended for experienced backend engineers with strong core Java fundamentals who apply traditional software engineering practices to data intensive platforms and distributed systems. The ideal candidate has hands on

Full-time

USD 105,000.00 - 158,000.00 per year

Senior Software Development Engineer, Consumer Domains

Newark, New Jersey

•

Today

At Audible, we believe stories have the power to transform lives. It's why we work with some of the world's leading creators to produce and share audio storytelling with our millions of global listeners. We are dreamers and inventors who come from a wide range of backgrounds and experiences to empower and inspire each other. Imagine your future with us. ABOUT THIS ROLE This opportunity is for a Senior Software Development Engineer for Audible's Consumer Domains group. We are the team that create

Full-time

Forward Deployed Engineer

Remote

•

4d ago

Job Title: Forward Deployed Engineer (Databricks & Data Platforms) FDE should be AI/ML oriented but with Resident Solution Architect background in Databricks Role Overview We are seeking an experienced Forward Deployed Engineer (FDE) to act as the primary technical bridge between our data platforms and client success. This is a high-velocity role for an engineer who thrives in ambiguity and can context-switch seamlessly between multiple concurrent client projects. Unlike traditional architectur

Easy Apply

Contract

Depends on Experience

Software Developer - Java - W2

Remote

•

12d ago

Software Developer - Java Criteria- Need ship because of federal regulations and the sensitive nature of the work involved. Ability to obtain Public Trust Clearance Responsibilities: Design, code, and maintain applications and data processing solutions using Java, Kotlin, Scala.Design and implement data loading and transformation for large datasets. Process data in various formats and compression codecs.Collaborate with cross-functional teams to understand data requirements and deliver solutions

Easy Apply

Full-time

130,000 - 140,000

Machine Learning Operations Engineer

Farmers Branch, Texas

•

17d ago

Job Title: Machine Learning Operations Engineer Location: Dallas, Texas Type: Contract To Hire Visa : (Only W2, No Sponsorship) Responsibilities Optimize and maintain large-scale feature engineering pipelines using PySpark, Pandas, and PyArrow on Hadoop-based infrastructure.Refactor and modularize ML codebases to enhance reusability, maintainability, and performance.Collaborate with platform teams on compute capacity planning, resource allocation, and system upgrades.Integrate with existing mo

Easy Apply

Contract

$120000

Staff Data Engineer/ Lead Data Engineer

Hybrid in Chicago, Illinois

•

3d ago

Position: Staff Data Engineer Location: Chicago, IL As a Staff Data Engineer in the Epsilon Attribution Product Development team, you will: Set the technical direction for large-scale data processing solutions using Scala, Spark, SQL, and modern data platform technologies across the attribution platform. Architect and oversee the operation of trusted data processing pipelines that handle advertiser, customer, and measurement datasets within secure cloud environments (AWS, Google Cloud Platform,

Easy Apply

Contract

Depends on Experience

Sr. Data Engineer(PA locals only )

Hybrid in Philadelphia, Pennsylvania

•

4d ago

Job Title: Sr. Data Engineer Location: Hybrid-2 days a week onsite in downtown Philadelphia, PA- locals only within one drive distance Duration: 6 month contract to hire Visa: only Exp Level: 10+ years Must have: These roles are focused on building real time streaming data solutions that enable data-driven decisions on live devices and telemetry data. While the Senior Data Engineer will support batch data processes, the primary focus is on real-time streaming use cases, data services for APIs a

Easy Apply

Third Party, Contract

Depends on Experience

Lead Software Engineer (Java Lead - Kafka & AWS)

Remote or Atlanta, Georgia

•

4d ago

Job Title: Lead Software Engineer (Java Lead - Kafka & AWS)Location: Atlanta, Georgia, USA Duration: 8 Months + Extension Bill Rate: $76/hr Job Type: C2C/1099 Contract Client: To Be Discussed Later Work Authorization: USC GC H1B OPT-EAD Job responsibilities Executes standard software solutions, design, development, and technical troubleshootingWrites secure and high-quality code using the syntax of at least one programming language with limited guidanceDesigns, develops, codes, and troubleshoots

Easy Apply

Contract

$70 - $80

Big Data / AWS Software Engineer

Hybrid in McLean, Virginia

•

24d ago

Hi, I have a HYBRID project so if interested then do let me know Role: Big Data / AWS Software Engineer Duration: Contract Location: Hybrid in Maclean VA or Hybrid in Rockville, MD Responsibilities: 8+ years of professional software engineering experience with demonstrated leadership capabilities3+ years of hands-on development experience in Java, JavaScript/TypeScript, or SQL2+ years developing REST/web services and writing complex SQL queries for relational databases3+ years working with big d

Easy Apply

Contract

Depends on Experience

Sr. Java Full Stack Developer

No location provided

•

Today

Job Title: Sr. Java Full Stack Developer Location: Omaha, NE (100% Onsite) Employment Type: Contract Job Description We are looking for a Senior Java Full Stack Developer with strong backend expertise to join our team. This role is primarily focused on backend development using Java and modern frameworks while also contributing to frontend development with Angular as needed. The ideal candidate is a hands-on engineer with excellent problem-solving skills, strong ownership, and the ability to w

Easy Apply

Contract

$DOE

Full Time- Data Engineer

Remote

•

2d ago

Role:Data Engineer Location:Remote, USA (Frequent travel anywhere in USA one or two weeks in a month) Duration:Fulltime Employee Numbers of Interview: 3 to 4 Mode of Interviews Virtual Tentative start date ASAP Must have skills: Minimum 8 - 10 years of experience.Strong in SQL and Python proficiency with hands-on experience in medallion/Lakehouse architectures on Databricks, Snowflake, AWS, or Azure.Job Overview: Data Engineering Skilled in building scalable cloud data pipelines for high-volum

Easy Apply

Full-time

120000 - 130000

Data Architect

Windsor, Connecticut

•

11d ago

Position: Senior Data Architect Location: Location: Windsor, CT (5 Days from office) Experience: 10+ Years Rate: DOE About the Role: We are seeking a Senior Data Architect to lead enterprise data strategy, data platform modernization, and solution design. This role works directly with business, architecture, and engineering teams to define scalable data architectures aligned to organizational priorities. Key Responsibilities: Lead enterprise data architecture and solution designPartner with bus

Easy Apply

Contract

65 - 85

Data Engineer

Remote

•

2d ago

Job Title: Senior Data Engineer Experience:10+ Years Title: Data Engineer Location: Remote Need Data Engineers with: 1. Hands on experience working in Databricks understanding the core engineering capabilities of the tool (data organization, engineering techniques, compute). 2. Strong understanding of data i.e. ability to read tables and come up with the right join criteria, run data checks like duplicate identification, etc. 3. Very strong communication skills. We are moving very fast, many m

Easy Apply

Contract

Local Only :: Need Google Cloud Platform Data Engineer at Phoenix, AZ

Phoenix, Arizona

•

2d ago

Role Google Cloud Platform Data Engineer Location Phoenix, AZ - Onsite - Local Only Long Term Contract In-Person Interview Skills: Years of experience : 5-7 years Google Cloud Platform Cloud : GCS, DataProc, BigQuery, Composer/Airflow Big Data: PySpark Spark, Python, Google Cloud Platform is must have Strong experience with Spark , Data Frames Big Query background with data processing for large volumes Another NO Sql DB is big plus - Spanner DB & Graph DB Qualifications: Degree in Computer Sci

Easy Apply

Third Party, Contract

50 - 60

Data Engineer

Remote or Boston, Massachusetts

•

Today

Job Title: Data Engineer Location: Boston, MA, Hartford, CT, Princeton, NJ, Philadelphia, PA, New York City, NY Contact: 12+ Months Looking for W2 candidates. No C2C Job Summary: We are seeking an experienced Data Engineer to join our team in Chicago, IL. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and modern data infrastructure to support business intelligence, analytics, and machine learning initiatives. The successful candidate wi

Contract

$DOE

Sr Data Engineer

Remote

•

9d ago

Job Description: We are not looking for typical ETL developers who just move data from point A to point B or build a unique pipeline for every single source. As we are building a generic, automated data platform where one single master job handles everything based on configuration parameters. Therefore, we need Software Engineers who happen to work with data. Any change these candidates make will impact the entire system, so they must be abstract, system-level thinkers. Technical Profile Breakdo

Easy Apply

Third Party, Contract

$34

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Apache Spark jobs