hadoop pyspark data pipeline build engineer Jobs in philadephia, pa

Refine Results
1 - 20 of 118 Jobs

Lead Software Engineer (Pyspark/Data/Snowflake/AWS Lead)

JPMorgan Chase & Co.

•

Wilmington, Delaware, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Home Lending and Auto Technology , you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technica
Posted 58 days ago | Updated 10 hours ago

Pyspark Data Engineer / Pyspark Developer

KPI Partners, Inc.

•

Remote

Contract

8-10 Years of total experience collaborating with cross-functional teams, including machine learning engineers, software developers, analytics engineers, and product managers to translate business requirements into highly available data solutions3+ years of experience developing and implementing data pipelines using PySpark.Proven experience with SQLProven experience with SQLBe an independent self-learner with the let s get this done approach and ability to work in Fast paced and Dynamic envir
Easy Apply
Posted 7 days ago | Updated 18 hours ago

Manager 1, Software Development & Engineering - 2455

Comcast Corporation

•

Philadelphia, Pennsylvania, USA

Full-time

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou
Posted 1 day ago | Updated 8 hours ago

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

•

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin
Easy Apply
Posted 60+ days ago | Updated 2 days ago

Data Engineer

Hectadata LLC

•

Remote

Third Party, Contract

Greetings from Hectadata, LLC. We are hiring for the position of Data Engineer Please find the below Job Description. If you are interested in this position, kindly submit your applications via Dice. Job Title: Data Engineer Location: Remote Job Description: Need mandatory experience in Databricks, Pyspark, Python, SQL, Snowflake
Easy Apply
Posted 1 day ago

Data Engineer

Kforce Technology Staffing

•

Remote or Blue Ash, Ohio, USA

Contract, Third Party

RESPONSIBILITIES: Kforce has a client in Blue Ash, OH that is seeking a Data Engineer. Summary: We develop strategies and solutions to ingest, store, and distribute our big data. Our developers use Big Data technologies including (but not limited to) Hadoop, Pyspark, Hive, JSON, and SQL to develop products, tools and software features. REQUIREMENTS: * Bachelor's degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM) * 4+ years of professional Data D
Posted 7 days ago | Updated 6 hours ago

Azure Data Engineer

Golden Resources. Inc.

•

Remote

Contract

Position Summary Accountable for developing and delivering technological responses to targeted business outcomes. Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. Understand and follow reusable standards, design patterns, guidelines, and configurations to deliver valuable data and information across the enterprise, including direct collaboration , where needed. Demonstrate the company's core values of respect,
Easy Apply
Posted 60+ days ago | Updated 29 days ago

Azure Big Data Lead

Quadratic Systems, Inc.

•

Philadelphia, Pennsylvania, USA

Contract

Role: Azure Big Data Lead Location: Philadelphia, PA (Hybrid work) Type: Full Time and 12+ Contract Job Description Primary Skill : 1 Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark Build Data Transformation in ADB Convert Scala Pgms to Py Spark Pgms Understand the SCALA program in DataBricks 2 ADF Secondary Skills 1 Azure data lake gen 2 2. Synapse analytics (dedicated SQL pool) 3. Exp in delta Lake 4. Pyspark Nice to Have : Tidal Scheduler , Exp in Healthcare Domai
Easy Apply
Posted 17 days ago | Updated 13 days ago

Google Cloud Platform Developer @REMOTE (PST)

C9xperts Corp.

•

Remote

Full-time

ROLE: Google Cloud Platform Developer LOCATION: REMOTE (PST) Description: At least 7+ years of Industry work experience At least 3 years of hands-on experience in Google Cloud Platform development/migration Very strong on BigQuery, looker, and Google Cloud Platform technologies Very strong in SQL and must have Excellent Data Analysis skills. Experience with querying and analyzing large amounts of data on Hadoop HDFS using Hive and PySpark is a BIG PLUS Google Cloud Platform certifications prefe
Easy Apply
Posted 1 day ago

Sr Data Engineer

The Connors Group, Inc.

•

Remote

Full-time

The Senior Engineer is responsible for the design, development, implementation and support of ELT processes for Data Platform. Works as part of a team to develop data pipelines, data transformation logic in ADF, python or Scala and other technologies to move data from a variety of operational platforms into Azure cloud. Conduct performance tuning of ELT processes for large and medium volumes of data, develop and oversee monitoring systems to ensure data loads complete on schedule and data is acc
Easy Apply
Posted 9 days ago

Data Engineer | Database Developer | Very Strong with SQL and Python "ONLY W2"

NearObjects

•

Remote or Ewing Township, New Jersey, USA

Contract

This is a W2 Role so, NO THIRD PARTY CANDIDATES PLEASE.Position: Data Engineer | Database Developer | Very Strong with SQL and PythonJD:Should have 8+ Years of IT Exp with Data Engineering and DWH, ETL Data Bases.5+ years' experience working with data bases like - Oracle/ SQL, and Very Strong with SQL Queries.Should have exp with Python. Should know some Data modelling practices.(Good to have) Understanding and Experience with PostgreSQL, PySpark, AWS, AWS Glue, EMR etc.
Easy Apply
Posted 13 days ago | Updated 19 hours ago

Sr. Software Engineer (MarTech)

Comcast Corporation

•

Philadelphia, Pennsylvania, USA

Full-time

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou
Posted 4 days ago | Updated 8 hours ago

Lead Data Engineer, (Python, Java or Scala)

Capital One

•

Philadelphia, Pennsylvania, USA

Full-time

802 Delaware Avenue (18052), United States of America, Wilmington, Delaware Lead Data Engineer, (Python, Java or Scala) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate
Posted 4 days ago | Updated 9 hours ago

Senior Manager, Data Engineer

Capital One

•

Philadelphia, Pennsylvania, USA

Full-time

802 Delaware Avenue (18052), United States of America, Wilmington, Delaware Senior Manager, Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marryin
Posted 4 days ago | Updated 9 hours ago

Lead Data Engineer

Capital One

•

Philadelphia, Pennsylvania, USA

Full-time

802 Delaware Avenue (18052), United States of America, Wilmington, Delaware Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with
Posted 4 days ago | Updated 9 hours ago

Databricks Architect

ScrumLink, Inc.

•

Remote

Contract

Job Title : Databricks Architect Location : Remote ,candidate must be in PST/MST ONLY Duration : 12+ Months Job Description:- Mandatory Skills: Databricks, Spark, PySpark, Spark internals, Spark tuning, Delta Lake internals Must Have Certification: Databricks Certified Data Engineer Professional 10+ years of consulting experience and 7+ years experience in data engineering, data platforms & analytics, Completed Databricks Data Engineering Professional certification & required classes Minimum 6
Easy Apply
Posted 2 days ago | Updated 14 hours ago

AWS Software Engineer III

JPMorgan Chase & Co.

•

Wilmington, Delaware, USA

Full-time

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a AWS Software Engineer at JPMorgan Chase within the Consumer and Community Bank, Data Governance, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business function
Posted 21 days ago | Updated 10 hours ago

Senior Data Engineer - Principal Associate

Capital One

•

Philadelphia, Pennsylvania, USA

Full-time

802 Delaware Avenue (18052), United States of America, Wilmington, Delaware Senior Data Engineer - Principal Associate Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate
Posted 4 days ago | Updated 9 hours ago

Senior Data Engineer - Principal Associate

Capital One

•

Philadelphia, Pennsylvania, USA

Full-time

802 Delaware Avenue (18052), United States of America, Wilmington, Delaware Senior Data Engineer - Principal Associate Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate a
Posted 4 days ago | Updated 9 hours ago

Big Data Engineer

Diamond Pick

•

Remote

Contract

POSITION SUMMARY: The Big Data Engineer is responsible for designing and developing data pipelines, ensuring efficient data processing, and maintaining data infrastructure. They work with large-scale data sets, implement ETL (Extract, Transform, Load) processes, and collaborate with cross-functional teams to meet business needs. RESPONSIBILITIES: Designing and Building Data Pipelines Develop and maintain data processing pipelines using Python, PySpark, and Big Data technologies (e.g., Dataproc
Easy Apply
Posted 12 hours ago | Updated 12 hours ago