Hadoop PySpark Data Pipeline Build Engineer jobs

Senior AWS Python Developer / Pyspark Data Engineer

Hybrid in Knoxville, Tennessee

•

8d ago

Job Title: Senior AWS Python Developer / PySpark Data Engineer Location: Lafayette, LA Knoxville, TN Columbia, SC Birmingham, AL Type: Direct Hire Work Model: Hybrid Overview We are looking for a Senior Python + PySpark Data Engineer with strong AWS big data experience ideally someone who has worked in cybersecurity or security data environments. This is primarily a hands-on data engineering role, not a traditional Python application developer role. Responsibilities Developing scalable Pyt

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

Hybrid in Birmingham, Alabama

•

8d ago

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

Hybrid in Knoxville, Tennessee

•

4d ago

Easy Apply

Full-time

Depends on Experience

Senior AWS Python Developer / Pyspark Data Engineer

Hybrid in Columbia, South Carolina

•

8d ago

Easy Apply

Full-time

Depends on Experience

Senior Data Engineer (Informatica & PySpark)

Hybrid in Pittsburgh, Pennsylvania

•

3d ago

Senior Data Engineer (Informatica & PySpark) Position Title: Senior Data Engineer Experience: 810 years in Data Engineering and Data Analysis.Informatica Expertise: Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization.PySpark Development: Advanced skills in PySpark for large-scale data processing, transformation, and analytics.Hadoop Ecosystem: Solid working knowledge of Hadoop technologies (HDFS, Hive, Sqoop, MapReduce).Programming Skills: Pro

Easy Apply

Full-time

130,000 - 140,000

Data Engineer - Python, PySpark & AWS

Plano, Texas

•

Today

Job Title: Data Engineer - Python, PySpark & AWS Location: Plano, TX Duration: Contract to Hire - 6 months RTH Pay Range: $65 to 70$/hr (W2) Job ID: 411040 About BCforward BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we tak

Easy Apply

Contract

$65 - $6670 per hour

Python/PySpark Data Engineer

Charlotte, North Carolina

•

2d ago

Role Summary We are looking for a strong Python/PySpark Data Engineer to build scalable data ingestion and integration pipelines across enterprise data sources and metadata platforms. The engineer will work with metadata catalogs, databases, APIs, and batch/Realtime integration patterns while contributing to enterprise data management and data warehousing initiatives. Key Responsibilities Develop robust data engineering solutions using Python, PySpark and Apache Spark. Consume and integrate me

Easy Apply

Contract, Third Party

Depends on Experience

Hadoop Data Engineer

Scottsdale, Arizona

•

Today

Role : Hadoop Data Engineer Location : Scottsdale AZ (100% Onsite) Please note: Once the candidate is selected, Day 1 onboarding will be conducted in person at the designated location. All travel expenses which include only to-and-fro travel tickets will be booked by Persistent. Candidates are encouraged to plan accordingly and can be assured that the onboarding experience will be supported from the outset Key Responsibilities Design, develop, and maintain scalable data processing application

Easy Apply

Contract, Third Party

60 - 65

Kafka/Spark Developer

Hybrid in Pittsburgh, Pennsylvania

•

30+d ago

Job Title: Kafka/Spark Developer Location: Pittsburgh, Pennsylvania Type: Permanent Full Time Work Model: Hybrid onsite and remote Responsibilities Develop and maintain scalable big data solutions using Hadoop, Spark, Kafka, and Impala to support enterprise data processing and analytics initiatives.Design, build, and optimize batch and real-time data pipelines for ingesting, processing, transforming, and delivering large volumes of structured and unstructured data.Develop Spark applications usi

Easy Apply

Full-time

Depends on Experience

Senior Data Engineer/ Databricks, PySpark, Python

Remote

•

Today

We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including

Full-time

Data Engineer - Google Cloud Platform / PySpark

No location provided

•

Today

Job Description Data Engineer - Google Cloud Platform / PySpark Job Summary We are looking for an experienced Data Engineer with strong hands-on expertise in Google Cloud Platform (Google Cloud Platform), Apache Kafka, Apache Airflow, PySpark, and Hive. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, processing large volumes of data, and supporting batch and real-time data processing requirements. Key Responsibilities Design, devel

Full-time

Senior Data Engineer - PySpark / ETL

Greenwood Village, Colorado

•

Today

RESPONSIBILITIES: Kforce has a client that is seeking a Senior Data Engineer - PySpark/ETL in Greenwood Village, CO. Summary: We're looking for a Senior Data Engineer to join a highly technical Data Engineering team supporting Data Science initiatives. This role will focus on building and maintaining large-scale data pipelines, implementing ETL processes, and making sure data is accurate, reliable, and ready for analytics and machine learning. The ideal candidate is comfortable working with Py

Contract

$65 - $75 hourly

Lead Software Engineer- Data Engineer/Pyspark/Databricks

Houston, Texas

•

Today

Job Description If you are looking for a game-changing career, working for one of the world's leading financial institutions, you've come to the right place. As a Lead Software Engineer at JPMorgan Chase within the Corporate Sector, you provide expertise and engineering excellence as an integral part of an agile data engineering team. To enhance, build, and deliver a trusted market leading Global Know Your Customer (KYC) and Risk Assessment Data Platform in a secure, stable, and scalable way.

Full-time

Data Scientist and Pipeline Engineer

Fort Belvoir, Virginia

•

Today

Job Number: R0250572 Data Scientist and Pipeline Engineer The Opportunity: As a data scientist, you're excited at the prospect of unlocking the secrets held by a data set, and you're fascinated by the possibilities presented by IoT, machine learning (ML), and artificial intelligence (AI). In an increasingly connected world, massive amounts of structured and unstructured data open new opportunities. As a data scientist at Booz Allen, you can help turn these complex data sets into useful informati

Full-time

USD 99,000.00 - 225,000.00 per year

Lead Software Engineer - Python/Data/PySpark/AWS

Plano, Texas

•

Today

Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within the Consumer & Community Banking, JPMWM Tech, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions a

Full-time

Data Pipeline Engineer

Washington, District of Columbia

•

Today

M9 Solutions is dedicated to providing IT services and solutions to the Federal Government by mobilizing the right people, skills, clearance levels, and technologies to help organizations that desire improved performance and modern, sustainable change. M9 has provided quality IT services and support to more than 30 Federal Agencies and multiple commercial customers nationwide. Our capabilities include IT Talent Solutions, Data Delivery & Analytics, Cyber Security, Cloud Migration, Applications a

Full-time

USD 220,000.00 - 230,000.00 per year

Data Pipeline Engineer

Washington, District of Columbia

•

Today

Full-time

USD 175,000.00 - 190,000.00 per year

Data Engineer and Data Pipeline Specialist

Hybrid in Lexington, Massachusetts

•

Today

Job Number: R0251853 Data Engineer and Data Pipeline Specialist The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like you to help our clients find answers in their data to impact important missions, from fraud d

Full-time

USD 61,900.00 - 141,000.00 per year

Platform Data Engineer - (DataBricks, PySpark, AWS)

West Chester, Pennsylvania

•

9d ago

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou

Full-time

Databricks Senior Data Engineer -Pyspark

New York, New York

•

25d ago

Hiring: Senior Data Engineer Databricks/PySpark Location: New York, NY Onsite Requirements: 7+ years of Data Engineering experience 4+ years hands-on with Databricks & Spark/PySpark Strong Python, SQL, Delta Lake Experience with AWS (S3, Glue) and Google Cloud Platform (BigQuery, GCS) Strong ETL/ELT, Spark optimization & data pipeline development Experience with CI/CD, Git, pytest Excellent communication and technical documentation skills Consulting/project delivery experience

Easy Apply

Third Party, Contract

Depends on Experience