PySpark jobs in Conshohocken, PA

Senior Data Software Engineer/ AWS, Databricks, PySpark

Remote

•

Today

We are looking for a Senior Data Software Engineer to join a team that builds and maintains data infrastructure and platform tooling for a large engineering organization. The work spans cross-region data exchange solutions, Databricks-based data sharing infrastructure, and backend integrations used daily by engineers across multiple regions. Responsibilities Design and implement solutions for cross-region data exchange in environments with strict regulatory and security requirements Build and ma

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Engineer/ Databricks, PySpark, Python

Remote

•

Today

We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including

Full-time

IT Engineer (Python, PySpark, AWS, RestAPI)

Remote

•

7d ago

Systems Engineering Services is seeking a IT Engineer based in the Washington DC area to work on site 3-4 Days a week in the Reston Town Center Area. Top 5 Technical Skills: PythonPysparkRest APIAWSGenerative AI and LLMSQLJob Description: Description: Local candidates preferred, with an expectation to be in RTC 3-5 days per weekExcellent communication and written skillsAbility to work independentlyHands-on Generative AI and LLM expertise, including AI agents, Retrieval-Augmented Generation (RAG)

Easy Apply

Full-time

Depends on Experience

Platform Data Engineer - (DataBricks, PySpark, AWS)

West Chester, Pennsylvania

•

Yesterday

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou

Full-time

AWS Data Engineer - W2 only

Hybrid in Malvern, Pennsylvania

•

2d ago

Hi, Hope you are doing well AWS Data Engineer Mode: Contract Location: Onsite in Malvern, PA, 3 days a week Responsibilities: Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark, SQL, and cloud-native , optimize, and support ETL/ELT processes, ensuring high-quality, reliable, and performant data solutions that meet business requirements.Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubl

Easy Apply

Contract

30 - 40

Senior AWS Engineer- "AWS Glue", ETL, Node.Js, Microservices

Malvern, Pennsylvania

•

Today

We are looking for a Senior AWS Engineer to extend our event-driven, serverless financial platform. The platform combines Python-based AWS Glue ETL pipelines with Node.js Lambda microservices.Job Description: Design, build, and maintain independently deployable microservices (single-purpose AWS Lambda functions) within an event-driven architectureDevelop and maintain Node.js (ES6+/async-await) Lambda microservices for file intake, validation, transformation, submission and acknowledgement handl

Easy Apply

Contract, Third Party

55 - 60

Technical Delivery Manager - Data

King of Prussia, Pennsylvania

•

Today

Key Responsibilities Deliver Databricks Projects: Lead end-to-end delivery of Delta Lake pipelines, PySpark workloads, and Azure Data Factory flows on time and budget.Support Optimize Costs & Performance: Enforce DBU cost controls, cluster auto-scaling, and Delta Lake optimizationsGovern & Secure Data: Implement Unity Catalog for data quality, lineage, and access governance.Support Unblocking Technical Teams: Help Resolve architecture bottlenecks, manage dependencies, and clear daily blockers fo

Easy Apply

Contract, Third Party

Depends on Experience

Data QA

Philadelphia, Pennsylvania

•

Today

Job description Job Title - Data QA Location - Hybrid (Candidate should be able to work from the Philly office thrice a week) Experience - MIN 8+ years - As a Data QA, you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards. Responsibilities: - 8+ years in data QA/testing, with at least 3 years in a Healthcare Payer Domain Strong expertise in Azure Databricks (Workflows, Delta Lake, Delta Live Tabl

Easy Apply

Third Party

Sr. Databricks Engineer

Wilmington, Delaware

•

Today

Job Title: Sr. Databricks Engineer Location: Wilmington, DE Work Mode: Onsite 5 Days a Week Exp - 15+ Years only Banking Exp is must Client Interview Process: Round 1: zoom interview with 2-3 people panel Round 2: In-Person at any client location Skillset Must Have Deep knowledge in Databricks & AWS eco-systems Delta Lake + Lake house architecture (Lake flow, Lake Base) PySpark/Scala Spark High volume Production-grade Databricks ELT/ETL engineering Nice to have Streaming/DLT experience ML

Easy Apply

Third Party, Contract

Depends on Experience

Azure Databricks Engineer

Newtown Square, Pennsylvania

•

6d ago

Azure Databricks Engineer Location: Newtown Sqaure, PA W2 POSITION Job Summary We are looking for an experienced Azure Databricks Engineer to design, develop, and maintain scalable data engineering solutions on Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Databricks, Apache Spark, Python/SQL, and modern data lake architectures. Key Responsibilities: Design and develop scalable data pipelines using Azure Databricks, Apache Spark, Python, and SQL. Build

Easy Apply

Contract

Consultant I (Contractor)

Remote or Philadelphia, Pennsylvania

•

Today

Empower our team as a Senior Machine Learning Engineer, where you'll build and deploy reliable machine learning models that drive real results. We're seeking someone with deep hands-on experience in traditional ML techniques and Python, your work will be central to our success. This role is focused on practical model development, not just AI buzzwords. Join us to collaborate with a small, skilled team, sharpen your skills with large-scale data, and contribute directly to production solutions. Re

Easy Apply

Contract

AI/ML Engineer

King of Prussia, Pennsylvania

•

Today

Job Title: AI/ML Engineer Job Category: Science Time Type: Full time Minimum Clearance Required to Start: TS/SCI Employee Type: Regular Percentage of Travel Required: Up to 10% Type of Travel: Continental US Anticipated Posting End: 1/1/2027 The Opportunity: We are looking for an AI/ML Engineer looking for new and challenging problems. You will support the development of AI/ML algorithms in a multitude of disciplines from large language models, natural language processing, and time-serie

Full-time

USD 69,100.00 - 141,500.00 per year

Senior AI/ML Engineer

King of Prussia, Pennsylvania

•

Today

Job Title: Senior AI/ML Engineer Job Category: Science Time Type: Full time Minimum Clearance Required to Start: TS/SCI Employee Type: Regular Percentage of Travel Required: Up to 10% Type of Travel: Continental US Anticipated Posting End: 1/1/2027 The Opportunity: We are looking for a Senior AI/ML Engineer looking for new and challenging problems. You will support the development of AI/ML algorithms in a multitude of disciplines from large language models, natural language processing, a

Full-time

USD 82,100.00 - 172,400.00 per year

Data Engineer Role

Remote

•

11d ago

Role- Data Engineer Location- New York Job Description We are seeking an experienced Data Engineerto join our team and build robust, scalable data pipelines. In this role, you will: Design and implement scalable PySpark data pipelines for batch and streaming workloads Optimize Spark jobs and queries for performance and cost efficiency Build and maintain ETL/ELT processes following data engineering best practices Troubleshoot and resolve complex data pipeline and processing issues Collaborate wi

Easy Apply

Full-time

Depends on Experience

Senior Data Scientist

Newtown Square, Pennsylvania

•

28d ago

Requisition ID: 459782 Work Area: Software-Development Operations Expected Travel: 0% Career Status: Professional Employment Type: Regular Full Time Career Level: T3-1 Additional Locations: Original Posting Date: 08/31/26 Job Title: Senior Data Scientist Location: Newtown Square, PA Work Model: Hybrid work model Purpose and Objective: SAP America, Inc. seeks a Senior Data Scientist at our Newtown Square, PA location to contribute to the nurturing of a data-centric culture within the Product and

Full-time

USD 144,685.00 - 195,976.00 per year

Data Engineering Career Opportunity

Remote

•

28d ago

Hi, Are you looking to start a career in Data Engineering, transition from another IT role, or strengthen your existing data skills? Explore a structured, industry-focused Data Engineering careerdesigned around the technologies and skills commonly used in modern cloud data environments. What Youll Explore Programming & Databases Python programming Advanced SQL Data structures and data processing concepts Relational databases and query optimization Cloud & Data Platforms Microsoft Azure

Easy Apply

Full-time, Third Party

Depends on Experience

Databricks Engineer

Remote

•

7d ago

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Full-time, Third Party

$70 - $80

Data Architect

Remote

•

7d ago

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

Easy Apply

Full-time

Depends on Experience

Databricks Consultant ---- 12+ year experience required

Remote

•

16d ago

Need W2 independent candidate'sJob Overview: Seeking an experienced Databricks Consultant with 12+ years of data engineering and analytics experience. The ideal candidate will have strong expertise in Databricks, SQL, Apache Spark, and modern data platforms, with experience designing and implementing scalable data solutions.Key Skills:12+ years of IT/Data Engineering experienceStrong hands-on experience with Databricks, Spark & SQLExpertise in PySpark and data pipeline developmentExperience with

Easy Apply

Contract

Depends on Experience

PySpark jobs in Conshohocken, PA 19428, USA