Hadoop PySpark Data Pipeline Build Engineer jobs

Senior Software Engineer (Hadoop, Databricks, PySpark, SQL, Java, React)

Arlington, Virginia

•

Today

Experience as a full-stack Software Engineer, with exposure to building platforms using modern technologies such as Java/Spring Boot, TypeScript, and React. Experience building large-scale data platforms, distributed systems, and enterprise integration solutions across both on-premises and cloud environments, leveraging technologies such as Spark, Kafka, Flink, NiFi, Hadoop/Cloudera, Databricks, and modern cloud-native data services. Experience integrating AI driven capabilities into data platfo

Easy Apply

Contract

Depends on Experience

Hadoop and PySpark Data Engineer

Plano, Texas

•

2d ago

Job Title - Hadoop and PySpark Data Engineer Duration: Full Time Location - Charlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TX Job Description: Required Skill and Experience Experience in data warehousing architectural approaches. Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in

Easy Apply

Full-time, Third Party

$100000 - $120000

Senior Lead Software Engineer - Python, PySpark, Big Data, Data pipeline, ML/AI

Plano, Texas

•

Today

Job Description Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking - Risk Technology Portfolio team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your ca

Full-time

Kafka/Spark Developer

Hybrid in Pittsburgh, Pennsylvania

•

Today

Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full Time Work Model: Hybrid onsite and remote Responsibilities Develop and maintain scalable big data solutions using Hadoop, Spark, Kafka, and Impala to support enterprise data processing and analytics initiatives.Design, build, and optimize batch and real-time data pipelines for ingesting, processing, transforming, and delivering large volumes of structured and unstructured data.Develop Spark applications usi

Easy Apply

Full-time

Depends on Experience

Senior Data Engineer - PySpark / ETL

Greenwood Village, Colorado

•

Today

RESPONSIBILITIES: Kforce has a client that is seeking a Senior Data Engineer - PySpark/ETL in Greenwood Village, CO. Summary: We're looking for a Senior Data Engineer to join a highly technical Data Engineering team supporting Data Science initiatives. This role will focus on building and maintaining large-scale data pipelines, implementing ETL processes, and making sure data is accurate, reliable, and ready for analytics and machine learning. The ideal candidate is comfortable working with Py

Contract

$65 - $75 hourly

Data Engineer - Big Data (Spark/Scala, Hadoop, SQL, Python)

Piscataway, New Jersey

•

Today

CTG is seeking to fill a Data Engineer - Big Data (Spark/Scala, Hadoop, SQL, Python) position for our client. Location: Piscataway, NJ Duration: 12 months Duties: Design, develop, test, and maintain scalable data-processing applications using Apache Spark and Scala.Develop and support Big Data applications and data pipelines utilizing Hadoop, Hive, and Impala.Write complex SQL queries for data extraction, transformation, reconciliation, analysis, and performance optimization.Develop Python sc

Full-time

USD 50.00 - 60.00 per hour

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Kafka/Spark Developer

Pittsburgh, Pennsylvania

•

6d ago

Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full-Time Work Model: Onsite onsite Overview System One is looking for mid level Kafka and Spark Software Developers to join our Applications Development and Maintenance team, supporting our client which is a large US Bank, working in an advanced technology environment. This role will require someone at our client site 5 days a week in Pittsburgh, PA. Responsibilities Develop and maintain scalable big data s

Easy Apply

Full-time

$156700

Kafka/Spark Developer

Pittsburgh, Pennsylvania

•

6d ago

Easy Apply

Full-time

$156700

Kafka/Spark Developer

Pittsburgh, Pennsylvania

•

5d ago

Easy Apply

Full-time

Depends on Experience

Lead Software Engineer- Data Engineer with Databricks and AWS -Pyspark

Houston, Texas

•

Today

Job Description Job Description As a Lead Solutions Analyst at JPMorganChase within the Corporate Technology, you review business requirements and ensure that the complete scope of business needs is articulated. Your deep understanding of applications, platforms, and products will position you as a key bridge between product owners, business, operations, and software developers. Utilizing advanced analytical reasoning and technical fluency, you will translate complex business requirements into

Full-time

Lead Software Engineer-Data Engineer, Pyspark, Databricks

Houston, Texas

•

Today

Job Description Job Description As a Lead Software Engineer at JPMorganChase within the Corporate Technology Sector, you provide expertise and engineering excellence as an integral part of an agile data engineering team. To enhance, build, and deliver a trusted market leading Global Know Your Customer (KYC) and Risk Assessment Data Platform in a secure, stable, and scalable way. Leverage your advanced technical capabilities and collaborate with colleagues across the organization to drive best-

Full-time

Data Infrastructure Engineer (Hadoop)

New York, New York

•

Today

Data Infrastructure Engineer (Hadoop) New York City, NY Hybrid Schedule (M/F remote, T/W/TH in-office) At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we're looking for people to help us tackle that responsibility with creativity and focus. Magnite (NASDAQ: MGNI) is the world's largest independent sell-side advertising platform. Publishers use our technology to monetize their content across all

Full-time

USD 170,000.00 - 180,000.00 per year

Lead Software Engineer- Financial Services Data Engineering: Pyspark / Java / BigData / Datalake / AI

Jersey City, New Jersey

•

Today

Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer- Financial Service Data Engineering: Pyspark / Java / BigData / Datalake / AI, at JPMorganChase within the Asset and Wealth Management- Global Prime Brokerage Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As

Full-time

USD 156,750.00 - 215,000.00 per year

Data Pipeline Engineer, Senior

Hawaii

•

Today

Job Title: Data Pipeline Engineer, Senior Job Category: Information Technology Time Type: Full time Minimum Clearance Required to Start: Secret Employee Type: Regular-Long Term Assignment Percentage of Travel Required: Up to 10% Type of Travel: Continental US * * * The Opportunity: CACI is seeking an experienced Data Pipeline Engineer, Senior to support enterprise data integration and logistics information management across the Indo-Pacific. The Data Pipeline Engineer, Senior serves as C

Full-time

USD 75,200.00 - 158,100.00 per year

Cloud Pipeline Data Engineer

Remote or Arlington, Virginia

•

Today

Job Title: Cloud Pipeline Data Engineer Job Category: Engineering Time Type: Full time Minimum Clearance Required to Start: Secret Employee Type: Regular Percentage of Travel Required: None Type of Travel: None * * * The Opportunity: The Cloud Pipeline Engineer will support data ingest and transformation for a government financial reporting system. You will support cloud-based data intake and storage, data ingestion automation, and ensuring the reliability of processes responsible for d

Full-time

USD 98,500.00 - 206,800.00 per year

Principal Data Engineer - Data Ingestion Pipeline (Prisma AIRS)

California

•

Today

Our Mission At Palo Alto Networks , we're united by a shared mission-to protect our digital way of life. We thrive at the intersection of innovation and impact, solving real-world problems with cutting-edge technology and bold thinking. Here, everyone has a voice, and every idea counts. If you're ready to do the most meaningful work of your career alongside people who are just as passionate as you are, you're in the right place. Who We Are In order to be the cybersecurity partner of choice, w

Full-time

USD 156,400.00 - 253,000.00 per year

Data Engineer / Enterprise Telemetry & Data Pipeline SME

No location provided

•

Today

GovCIO is seeking a Senior Data Engineer / Enterprise Telemetry & Data Pipeline SME to design, optimize, automate, and sustain large-scale data collection and streaming pipelines supporting Air Force Intelligence Community missions. The environment includes a global Elastic deployment with distributed endpoint collectors, syslog and telemetry from Cisco and other network devices, Cribl-based routing and normalization of native and non-native sources, Splunk engineering and integration, and AWS-

Full-time

USD 170,000.00 - 200,000.00 per year

Data Loop Pipeline Engineer

Boston, Massachusetts

•

Today

About Merlin: Merlin (NASDAQ: MRLN) is a publicly traded aerospace and defense company building a non-human pilot to deliver full-stack autonomy for any aircraft from takeoff to touchdown. The Merlin Pilot autonomy system powers a growing range of aircraft and mission profiles and has been proven through hundreds of autonomous flights from Merlin's global flight test facilities, including Kerikeri, New Zealand; Quonset Point, Rhode Island; and soon, Bedford, Massachusetts. Headquartered in Bosto

Full-time

USD 125,000.00 - 220,000.00 per year

Data Engineer Senior, Analytics Pipeline (FWA)

Remote

•

Today

Type of Requisition: Regular Clearance Level Must Currently Possess: None Clearance Level Must Be Able to Obtain: None Public Trust/Other Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills: Analytics, Big Data Engineering, Data Management Certifications: None Experience: 4 + years of related experience ship Required: No Job Description: DATA ENGINEER SENIOR Own your opportunity to turn data into measurable outcomes for our customers' most complex cha

Full-time

USD 110,500.00 - 149,500.00 per year