Hadoop PySpark Data Pipeline Build Engineer jobs

New York, New York

•

Today

Bachelor's or master's degree in computer science, Engineering, or a related quantitative field. 15+ years of progressive experience in software engineering, with at least 5+ years in a Technical Architect, Lead Data Architect, or Principal Data Engineer role, specifically focused on data quality, data governance, or data platform architecture. Exceptional hands-on proficiency and deep architectural understanding of the Big Data ecosystem: Apache Spark (PySpark, Scala, or Java): Expert-level ex

Easy Apply

Full-time

Healthcare Data Engineer

Remote

•

2d ago

About ISG International Solutions Group (ISG) An award-winning IT services company. Our company is based in Herndon, VA with offices in all major cities across the United States. We have been a trusted partner to some of the world s biggest companies for almost 22 years. At ISG we provide high-quality solutions in several areas of IT and build customized solutions for our clients. Here is our open requirement which can be filled immediately. Kindly respond to this requirement with your contact i

Easy Apply

Contract

Depends on Experience

Full Stack Java Developer

Woodbridge Township, New Jersey

•

Today

Job Title: Full Stack Java Developer Location: Iselin NJ (Hybrid) Duration: 24 Months Contract to hire role Must Haves: Full Stack Developer with experience with the below tech stack Programming Languages: Java, Python, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch) ETL/ELT Tools: AWS Glue, Python, PySpark, Databricks Data Integration & Migration: Experience with Hadoop, Kafka, data lakes,

Easy Apply

Full-time, Contract, Third Party

Data Architects

Salt Lake City, Utah

•

Today

Announcement Details Open Date 11/07/2025 Requisition Number PRN43536B Job Title Data Architects Working Title Data Architects Career Progression Track P00 Track Level P3 - Career, P2 - Developing, P1 - Entry Level Pro FLSA Code Computer Employee Patient Sensitive Job Code? No Standard Hours per Week 40 Full Time or Part Time? Full Time Shift Day Work Schedule Summary Full-time, 40 hours per week. Monday - Friday from 8:00 am to 5:00 pm This position offers a flexible, mostly remote

Full-time

USD 61,599.00 - 112,068.00 per year

Lead Software Engineer (Big Data / Cloudera Platform)

Reston, Virginia

•

Today

Job Title: Lead Software Engineer (Big Data / Cloudera Platform)Location: Reston, VA / Washington, DC (Hybrid - 1 Day per Month Onsite) Job Type: Contract-to-Hire Overview:We are seeking a Lead Software Engineer with deep hands-on expertise in Big Data platforms, Cloudera (CDP/CDH), and AWS environments. This role focuses on production support, performance optimization, and on-call rotation for mission-critical big data systems. The ideal candidate will be an experienced technical leader who thr

Easy Apply

Contract

BASED ON EXPERIENCE

Lead Big Data Cloud Engineer

Remote

•

3d ago

Title: Lead Big Data Cloud EngineerLocation: Remote Terms of Employment: W2 Contract-to-Hire, Six Months This position is primarily remote. Candidates must be willing to work onsite in Reston, VA or Washington, DC once per month for all-hands meetings. Overview & Responsibilities: We are seeking a Lead Big Data Cloud Engineer for a crucial production support role with a leading healthcare services client. You will be responsible for the administration and support of the "Enterprise Data Hub" (

Easy Apply

Contract

Depends on Experience

Cloudera Data Engineer-65050

Remote

•

10d ago

Position:- Cloudera Data EngineerLocation:- 100% RemoteClient: STATE OF NE Job code: 65050 Job Description: Client Info : Nebraska Department of Health and Human Services Cloudera Data EngineerJob Summary We are seeking a Cloudera Data Engineer to support the migration of a Medicaid Data Warehouse Implementation in AWS environment. The resource will support the migration and continued operations of an existing Cloudera/Hive/Scala-based data pipeline environment from one AWS account to another. T

Easy Apply

Full-time

Depends on Experience

Hadoop Platform Engineer

Remote or Hybrid

•

Today

At this time, we are unable to consider candidates requiring visa sponsorship or third-party recruitment agencies for this role. We thank you for your understanding. Overview: Role is specifically a Hadoop Platform Engineer. Engineer will have deep, hands-on experience across the Apache Hadoop ecosystem, focused on building and maintaining a reliable, scalable data platform; strong core Hadoop and Java expertise, enabling them to diagnose, optimize, and tune performance at the cluster and infra

Easy Apply

Contract

$80-$100 per hour

Data Engineer III

Seattle, Washington

•

Today

RESPONSIBILITIES: Kforce has an enterprise client that is seeking a Data Engineer in Seattle, WA. Summary: As a Senior Data Engineer, you will create solutions to integrate with multi heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in reporting, analysis, machine learning models and ad-hoc data requests. You will be responsible for designing, developing, and operating a data service platform using Python, Airflow, and SQL to build t

Contract

$65 - $73 hourly

Engineer, Big Data - Claims Data/Databricks - Remote

Remote or Long Beach, California

•

Today

Job Description Job Description Job Summary Responsible for collecting, storing, processing, and analyzing large sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. He/she will also be responsible to follow architecture and best practices used across the enterprise. Knowledge/Skills/Abilities: Define ideal Architecture, Evaluating tools and Frameworks, Standards & Best Practices for implementing

Full-time

Data Engineer (L5) - Games

Remote

•

Today

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Games are our next big frontier and an incredible opportunity for us to deliver new experiences to delight and entertain our quickly growing membership. You will be joi

Full-time

USD 170,000.00 per year

Cloudera Data Engineer

Lincoln, Nebraska

•

Today

Job#: 3011123 Job Description: Job Summary Apex Systems is seeking a Cloudera Data Engineer to support the migration of our customers' Medicaid Data Warehouse Implementation in AWS environment. The resource will support the migration and continued operations of an existing Cloudera/Hive/Scala-based data pipeline environment from one AWS account to another. This position is responsible for ensuring a seamless transition, validating data integrity and job performance, and maintaining reliable da

Easy Apply

Full-time

Sr. Data Engineer

San Francisco, California

•

Today

As a leading financial services and healthcare technology company based on revenue, SS&C is headquartered in Windsor, Connecticut, and has 27,000+ employees in 35 countries. Some 20,000 financial services and healthcare organizations, from the world's largest companies to small and mid-market firms, rely on SS&C for expertise, scale, and technology. Job Description Sr. Data Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA / New York, NY (Hybrid) Get To Know The Team: Ou

Full-time

USD 140,000.00 per year

Senior Big Data Engineer - Vice President

Remote or New York, New York

•

Today

We are seeking a highly skilled and experienced Big Data Lead to join our Jersey City location in order to deliver on major business priorities within the Client Financial Platform. As a Big Data Lead, you will play a critical role in designing, developing, and maintaining our big data applications and pipelines. You will lead a team of talented engineers, providing technical guidance and mentorship while ensuring the successful delivery of high-quality solutions. This role requires a deep under

Full-time

USD 142,320.00 - 213,480.00 per year

Site Reliability Engineer, Data Management and Applications - USDS

San Jose, California

•

Today

Responsibilities About the Team: The Data Management and Applications team maintains products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These products support various businesses, so data engineers and data scientists could greatly boost their productivity. As a Site Reliability Engineer in the Data Management and Applications team, you will have the opportunity to maintain, optimi

Full-time

USD 118,657.00 - 259,200.00 per year

Site Reliability Engineer, Data Management and Applications - USDS

Seattle, Washington

•

Today

Full-time

USD 129,960.00 - 246,240.00 per year

Senior Data Engineer - USDS (Multiple Positions)

New York, New York

•

Today

Responsibilities About TikTok U.S. Data Security TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security ("USDS") is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U.S. users safe. Our focus is on providing oversight and protection of the TikTok platform and U.S. user data,

Full-time

USD 187,040.00 - 359,720.00 per year

Big Data Tech Delivery Lead - SVP

Remote or Tampa, Florida

•

Today

The Applications Development Technology Senior Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology Team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Design and implement robust data pipelines and systems for data ingestion, processing, and storage.Develop, test, and maintain big data solutions using Ja

Full-time

USD 141,440.00 - 212,160.00 per year

Cleared Data Engineer/Scientist

Reston, Virginia

•

Today

Responsibilities Noblis is seeking to hire a Data Engineer/Scientist with an ACTIVE Top Secret with SCI and Polygraph in Chantilly, VA As a Data Engineer/Scientist with our team, you will be working with our federal clients to rapidly develop innovative solutions for our clients' immediate mission challenges. In this role, you will work with a team of developers, data scientists, SMEs, and cyber analysts to design, develop, build, and analyze data management systems. You will work with and ana

Full-time

USD 120,700.00 - 188,725.00 per year

Senior ML Ops Engineer

San Francisco, California

•

6d ago

At Early Warning, we've powered and protected the U.S. financial system for over thirty years with cutting-edge solutions like Zelle , Paze, and so much more. As a trusted name in payments, we partner with thousands of institutions to increase access to financial services and protect transactions for hundreds of millions of consumers and small businesses. Positions located in Scottsdale, San Francisco, Chicago, or New York follow a hybrid work model to allow for a more collaborative working envi

Full-time

USD 124,000.00 - 165,000.00 per year

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Hadoop PySpark Data Pipeline Build Engineer jobs