Hadoop PySpark Data Pipeline Build Engineer Jobs

Refine Results
1 - 20 of 1,149 Jobs

Data Pipeline Engineer

Codeforce 360

Sunnyvale, CA, USA

Contract

Career Opportunity: Job Title: Data Pipeline Engineer About CodeForce 360 Making a career choice is amongst the most critical choices one can make, and it's important for the choice to be calculated with factors such as a company's run of success since its inception and more. But, when you come across a company that has reputation proven with nothing but an illustrious run of success since the day it began, you don't need to think of anything else. That's precisely what some of our employees

Lead Data Engineer with Strong PySpark

Hexaware Technologies, Inc

Charlotte, NC, USA

Full-time

Lead Data Engineer with PySpark– Day 1 onsite Locations – Mt Laurel, NJ & Charlotte, NC Duration: Fulltime Experience: 12+ Years Primary Tech skills – Pyspark Secondary Tech skills – Azure, SAS, Synapse, Databricks Techno-Managerial covers the entire life cycle of data warehouse and data cloud environment with experience in building data platforms development.Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, and QE Team for the assigned

VWGAJP00013676 - "ROS engineer" or "Data Pipeline Engineer".

Modis

Belmont, CA, USA

Full-time

Pay Rate: $ Location - Belmont, CA Worker Type - Fixed Weekly Enhanced PTO/Holidays Experience: • 3+ years of professional experience in software development. • 3+ years of experience working in Python or C++ in ROS. • Autonomous driving experience preferred. Education: • Bachelor degree in Engineering • Masters degree desired Must have: • Proven experience writing production quality software. • Experience with Python and/or C++. • Experience with ROS. • Experience with different types of se

Need only Local W2 candidates :: Data Engineer - 3 openings (ETL, Hadoop, Spark with Java or Scala or Python programming (any one programming language is a must) :: Wilmington, DE (Hybrid Model) Local candidate only

SnS Global Corp

Wilmington, DE, USA

Contract

Data Engineer - 3 openings (ETL, Hadoop, Spark with Java or Scala or Python programming (any one programming language is a must) Location: Wilmington, DE (Hybrid Model) Local candidate only Duration: 6+ Months Contact to Hire (Full Time) Job Description: In short, we need strong data engineers who can migrate existing data pipelines and create new data pipelines in cloud environment.Must have an ETL background.Must have Java background, Scala or python may work if not Java, but is a must.Must ha

Big Data Engineer

EdgeAll

Plano, TX, USA

Contract

We need Big Data Engineer / Hadoop developer Location: Plano, TX (Hybrid -3 days Onsite, 2 days WFH) Duration: 12M Contract with possible extension Ideally looking for applicants with a solid financial services background. Job Description: To create and modify blueprints that define the current state of business capabilities and the technology landscape that supports it. - To create a target state architecture that meets the business requirements and evaluate the new and existing business cap

Lead Data Engineer with Strong PySpark

Hexaware Technologies, Inc

Mount Laurel Township, NJ, USA

Full-time

Lead Data Engineer with strong PySpark– Day 1 onsite Locations – Mt Laurel, NJ & Charlotte, NC Client: Hexaware Duration: Fulltime Experience: 12+ Years Primary Tech skills – Pyspark Secondary Tech skills – Azure, SAS, Synapse, Databricks Techno-Managerial covers the entire life cycle of data warehouse and data cloud environment with experience in building data platforms development.Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, an

Lead Data Engineer with PySpark

LiveMindz

Charlotte, NC, USA

Contract

Job Description - Primary Tech skills – Pyspark, Databricks (Handson experience mandatory) Secondary Tech skills – Azure, SAS, Synapse, Databricks Techno-Managerial covers the entire life cycle of data warehouse and data cloud environment with experience in building data platforms development. Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, and QE Team for the assigned projects.Ability to drive more than one project in parallel.Experienc

Snowflake / Pyspark - Data Engineer - Must be on Our w2

Cogent IBS, Inc

Remote

Contract

Positions: 5 Client: Startup Remote We need Very Strong Snowflake / Pyspark Data engineer . Coding test will be there in the interview Note : Must be willing to work on our W2

Azure Data Engineer with strong Python / PySpark experience (NO C2C )

Yashco Systems, Inc.

Seattle, WA, USA

Contract

Job Description: Independently design and develop programs and tools to support data pipelines including ingestion, curation, and provisioning of data for analytics, reporting and data science. Deliver key, complex business capabilities and platform features. Deliver high quality software using Agile/Scrum development methodologies. Identify and drive operational improvements for the team's data platform services. Summary of Key Responsibilities Should have experience with Azure Databricks,

Lead Software Engineer Data Platform and Pipeline

Motion Recruitment

Boston, MA, USA

Full-time

We are working with an impressive client that is revolutionizing the SMB SaaS platform industry by delivering unmatched experiences for our customers. We are in an exciting phase, entirely rebuilding our data platform and infrastructure. We don't just use tech - we build it. The Role: We are looking for a Lead Data Engineer with hands-on experience and deep expertise in Python, Kubernetes, and Kafka. We need an innovator, a problem-solver, an engineer who can build systems akin to Databricks, no

Sr. Data Engineer

STIAOS Technologies Inc

Remote

Contract, Third Party

Responsibilities: Designing and implementing large-scale, distributed data processing systems using technologies such as Apache Hadoop, Apache Spark, or Apache Flink. Developing and optimizing data pipelines and workflows for ingesting, storing, processing, and analyzing large volumes of structured and unstructured data. Collaborating with data scientists, data analysts, and other stakeholders to understand data requirements and translate them into technical solutions. Building and maintaining d

Senior Data Engineer/ PySpark/ AWS

Motion Recruitment

Philadelphia, PA, USA

Full-time

One of the largest and most innovative digital media and entertainment companies in North America is looking to add a new member to their close knit team. Their offices are in the heart of center city Philadelphia, open to candidates who need to work remotely but have great preference to those in the Greater Philadelphia area. Looking for someone with a strong background working as a data engineer pulling and extracting data, as well as building pipelines & distributed systems. The ideal candida

Remote - Sr. AWS Data Engineer - heavy AWS, PYTHON, Big Data, Data Wrangler, Data Pipeline Builder

LingaTech, Inc

Remote

Contract, Third Party

Urgent Job Opening – Sr. AWS Data Engineer / Data Wrangler / Data Pipeline Builder (heavy AWS, PYTHON & BIG DATA) needed Long Term Contract (5 years) – Immediate Interview and Start Date – 100% REMOTE Candidate should be located in East Coast or within 3 to 5 hours drive to Harrisburg, PA JOB DESCRIPTION / REQUIRED SKILLS:- Urgent Job Opening – Sr. AWS Data Engineer / Data Wrangler / Data Pipeline Builder (heavy AWS, PYTHON & BIG DATA) needed Long Term Contract (5 years) – Immediate I

ETL Data Pipeline Engineer

Moorecroft Systems Inc.

Santa Monica, CA, USA

Contract

ETL Data Pipeline Engineer We do not work with 3rd party employers. Visa Sponsorship NOT available. We are seeking a ETL DATA Pipeline Engineer for a consulting engagement with a major entertainment and media company. This person will be hands-on-date engineering development across multiple projects. Required Skills: 10+ years of experience as Data Engineer with Large Data PipelinesStrong SQL skillsDistributed Systems (Spark, Hadoop)Cloud experienceSTRONG ETL ExperiencePython/BashAgile/Scrum ABO

Data Pipeline Engineer (ETL/Glue) Developer

Datanomics

Remote

Contract

Our client is looking to hire Data Pipeline Engineer (ETL/Glue) developer to build and deploy modular data pipeline components such as Apache Airflow DAGs, AWS Glue jobs, AWS Glue crawlers through a CI/CD process. You will join a growing Data Engineering team and participate in design and build of data ingestion and transformation pipelines based on the specific needs driven by Product Owners and Analytics consumers. You must possess strong knowledge and interest in data processing and have a b

AWS-Glue Data Pipeline Engineer

Corporate Systems Associates

Hartford, CT, USA

Contract, Third Party

Job ID: T5421 - AWS-Glue Data Pipeline Engineer This is a 6 month contract to hire opening. must be local to Hartford, CT or St. Paul, MN and will work a hybrid schedule of 3 days in office and 2 remote. Description: Expertise in creating and maintaining Data Pipelines using AWS Glue, Snowflake, & Python is a MUST. Required skills in BI tools like Qlik Sense, Microstrategy, SSIS.Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire

Cloud Data Engineer - Hadoop / Snowflake / Azure

M&T Tech

Buffalo, NY, USA

Full-time

This role follows a hybrid work schedule; offering the flexibility to work remotely two days a week, while providing the opportunity for onsite and in person collaboration the other three days. **This position is available in either Buffalo, NY or Wilmington, DE** About the Team Our team is on a mission of unleashing the power of data to support decision making. Our team builds enduring data products, provides platforms to access & derive insights from data, enables confidence in decision making

Sr. Data Engineer

MHK TECH INC

Remote or Houston, TX, USA

Contract

Responsibilities:Designing and implementing large-scale, distributed data processing systems using technologies such as Apache Hadoop, Apache Spark, or Apache Flink. Developing and optimizing data pipelines and workflows for ingesting, storing, processing, and analyzing large volumes of structured and unstructured data. Collaborating with data scientists, data analysts, and other stakeholders to understand data requirements and translate them into technical solutions. Building and maintaining da

Data Engineer

Sumeru

New York, NY, USA

Full-time

Job Title: Data Engineer Location: NYC, NY & Sunrise, FL (Onsite) Mode: Full Time Job Description: Skills: Data Warehouse, Google Cloud Platform Cloud, Pyspark, SQL, Hive, BigQuery, Airflow, Hadoop, Docker, Kubernetes Hands-on experience with Google Cloud Platform, google composer, airflow, bigQuery and bigTable 3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing jo

Sr Data Engineer - Phoenix, AZ

Georgia IT

Phoenix, AZ, USA

Contract

Sr Data Engineer Location: Phoenix, AZ Top Skills' Details 5 years prior experience working as a Senior Data Engineer Advanced/expert level with ETL and or Airflow Able to use PySpark and or Glue (cloud equivalent) Python - v3+ Web frameworks like Flask and Django AWS cloud Professional, excellent organizational and communication skills, desire to serve and help others.