PySpark jobs in Pennsylvania

Senior Data Software Engineer with AWS, LLM, PySpark

Remote

•

Today

We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications. Responsibilities Design and implement scalable ETL/ELT pipelines Build and optimize data ingestion frameworks from APIs,

Full-time

Sr Data Engineer - Onsite in Reading PA, Must have strong experience with Talend, Kafka, PySpark, Python, EMR. Glue, Athena, Flink, API''''s, Microservices, Data Pipelines , Data Streams, Data warehouse, Data Lake, Lakehouse , Data Modeling

Reading, Pennsylvania

•

16d ago

Sr Data Engineer- with Talend, Kafka, PySpark, Python, EMR. Glue, Athena, Flink, APIs, Microservices, Data Pipelines , Data Streams, Data warehouse, Data Lake, Lakehouse , Data Modeling - ONSITE - Reading PA Senior Data Engineer 12 plus years of experience across Experience with Talend, Kafka, PySpark, Python, EMR. Glue, Athena, Flink Experience with APIs, Microservices, Data Pipelines , Data Streams Experience in Data warehouse, Data Lake, Lakehouse , Data Modeling across all these platforms E

Easy Apply

Third Party, Contract

Depends on Experience

Senior Data Engineer | Reading, PA (Day 1 Onsite)| F2F Client Interview | 12+ Yrs | Talend, Kafka, PySpark, Python, EMR, AWS Glue, Athena, Flink, APIs, Microservices, Data Pipelines, Data Streams, Data Warehouse, Data Lake, Lakehouse, Data Modeling, Data Quality, Data Observability, Data Governance, On-Prem & Cloud Architecture

Reading, Pennsylvania

•

19d ago

Senior Data Engineer -Reading PA- location - F2F interview for client round H1B 12 plus years of experience across Experience with Talend, Kafka, PySpark, Python, EMR. Glue, Athena, Flink Experience with API''s, Microservices, Data Pipelines , Data Streams Experience in Data warehouse, Data Lake, Lakehouse , Data Modeling across all these platforms Experience in Data Quality, Data Observability and Data Governance Experience in OnPrem and OnCloud architectures

Easy Apply

Contract, Third Party

Depends on Experience

Platform Data Engineer - (DataBricks, PySpark, AWS)

West Chester, Pennsylvania

•

Today

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou

Full-time

Data Platform Engineer

Remote or Toronto, Ontario

•

Today

Job Title: Data Platform Engineer Location: Remote (Canada) Employment Type: Full-Time Contract Job Summary We are seeking an experienced Data Platform Engineer to design, build, and enhance a cloud-native data platform on AWS and Snowflake. The ideal candidate will have strong expertise in data ingestion, transformation, orchestration, metadata management, and data quality, while building scalable and reliable data pipelines that support enterprise analytics and reporting. Key Responsibiliti

Easy Apply

Third Party, Contract

Azure Data Architect

Remote

•

4d ago

Sr. Data Architect- Remote- US, Canada, LATAM location are all ok We are seeking a highly skilled and experienced Sr Data Architect to join our team. As a Sr Data Architect, you will be responsible for designing, implementing, and managing data architecture on cloud platforms for our clients. Your expertise will play a critical role for our clients in shaping data strategy, ensuring efficient data integration, storage, and accessibility while maintaining data security and compliance. Key Respons

Easy Apply

Full-time

$180,000 - $190,000

Palantir Forward Deployed Engineer

Remote

•

2d ago

JOB DETAILS: Job Title: Palantir Forward Deployed Engineer Location: 100% Remote Contract Duration: 06 plus months contract with extensions (long -term contract) Job Description: Key Responsibilities Technical Leadership & Architecture Design, build, and deploy end-to-end data integration pipelines using Palantir Foundry, including complex transforms, incremental pipelines, and multi-source data connectorsArchitect and maintain the Ontology layer defining object types, link types, action typ

Easy Apply

Contract

$90 - $114

System Development Engineer

Remote

•

5d ago

Position: System Development EngineerLocation: RemoteThe common nature of the work:Every one is a System Development Engineer (Contractor) position, Seattle-based, L5L6 equivalent, 1 opening each, sitting on the Region Flexibility Migration (RFM) team inside the clients Intelligent Cloud Hosting (ICON) organization. They all serve a single 2026 initiative: DRAM (memory) footprint reduction across the clients production service fleet essentially cost/efficiency and performance engineering, not n

Easy Apply

Contract

Depends on Experience

Databricks Engineer (W2 only)

Remote

•

2d ago

Role: Databricks Engineer Duration: 6+ months contract Location:100% Remote Position details Required Skills: Proficiency in PySpark and SQL, experience with Medallion architecture, and performance tuning within the Databricks Lakehouse platform. Set up row/column-level security and manage data lineage and sharing in Unity Catalog. Utilize CI/CD and testing processes like Databricks. Utilize CI/CD and testing processes like Databricks. Preferred Skills: SAS, SQL, Unix, Linux Education: Bachel

Easy Apply

Contract

Depends on Experience

Data Engineer

Hybrid in Malvern, Pennsylvania

•

9d ago

Data EngineerLocation:Malvern PAOpenings: 3Duration: Contract Job SummaryWe are seeking an experienced Data Engineer with strong expertise in Python, PySpark, AWS Glue, and AWS data services to build and support scalable ETL/ELT pipelines for enterprise financial and data platforms. The ideal candidate will have hands-on experience with cloud-based data lakes, distributed data processing, CI/CD, and production support. Key ResponsibilitiesDesign, develop, and optimize ETL/ELT pipelines using Pyt

Easy Apply

Contract

$50 - $60

Senior Fabric ETL Developer

Remote

•

23d ago

Title: Senior Fabric ETL Developer Location: Remote Contract SUMMARY:Our client would like us to provide them with a Senior Developer with extensive experience in Microsoft Fabric, specializing in Lakehouse-based data processing and Fabric Notebooks utilizing PySpark. This role focuses on transforming curated Lakehouse data into standardized and custom text file extracts (e.g., CSV, TXT, pipe-delimited) for secure delivery to external vendors and partners. Additionally, the Developer will part

Easy Apply

Contract, Third Party

Depends on Experience

Databricks developer

Remote

•

2d ago

Required Skills 10+ years of experience with Databricks. Strong experience in PySpark, Spark SQL, and Python. Hands-on experience with Delta Lake and Databricks Workflows. Strong SQL and data modeling skills. Experience with Azure Databricks or AWS Databricks. Knowledge of Azure Data Factory (ADF), ADLS Gen2, or AWS S3. Experience with Git, Azure DevOps, or Jenkins. Understanding of data warehousing concepts and ETL best practices. Preferred Skills Experience with Unity Catalog, MLflow, and Delt

Easy Apply

Contract

50+

Lead Microsoft Fabric Architect & Administrator

Remote

•

11d ago

Job Title: Lead Microsoft Fabric Architect & Administrator Work Location: 100% Remote Long Term Contract If you find this opportunity suitable, kindly share your updated resume. Also, please let me know a good time to connect with you for a quick discussion. Looking forward to hearing from you! Job Description We are seeking a visionary Microsoft Fabric Architect & Administrator to lead our transition into a unified, AI-ready data ecosystem. In this role, you will be the primary owner of our Mi

Easy Apply

Full-time

Depends on Experience

Lead Data Engineer (Azure, Snowflake, DB) !!! Remote

Remote

•

4d ago

Role: Lead Data Engineer (Azure, Snowflake, DB) Location: Remote Duration: Long Term Skill Focus Azure , Snowflake, DB, ETL, Python, Pyspark, SnowSQL Key Responsibilities: Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT. Build and maintain data integration workflows from various data sources to Snowflake. Write efficient and optimized SQL queries for data extraction and transformation. Work with stakeholders to understand business requirements and translate t

Easy Apply

Contract

Depends on Experience

Multiple Databricks Positions

Remote

•

4d ago

Location: Nationwide United States Employment Type: W2 Only C2C: Not Available Job Description CodeForce 360 is hiring Databricks professionals for multiple positions with our Fortune 1000, system integrator, and enterprise clients across the United States. Opportunities may be available onsite, hybrid, or remote, depending on client requirements. We are seeking candidates with knowledge or experience across various Databricks technologies, modules, and cloud environments. Posit

Easy Apply

Full-time, Third Party

$50 - $150

Data Analytics Technical Lead with Power BI

Remote

•

23d ago

Holds Databricks Certified Data Engineer Professional certification along with strong expertise across modern analytics ecosystems and cloud-native data platforms. Data Analytics Technical Lead with extensive hands-on experience in Databricks, including advanced data engineering, lakehouse architecture, and performance optimization, supported by relevant Databricks certifications. Proven expertise leading enterprise-scale analytics initiatives across modern cloud and big data platforms. Well-rou

Easy Apply

Full-time

Depends on Experience

Senior Databricks Solution Architect

Remote

•

6d ago

Senior Databricks Solution Architect 100% RemoteLong Term Contract Overview: We are seeking an experienced and dedicated Senior Solutions Architect to lead technical engagements and provide strategic guidance for our strategic client accounts. This high-impact role requires deep expertise in the Databricks Platform, acting as the client's primary technical advisor for complex data, analytics, and AI initiatives. You will bridge business objectives with technical execution, designing and deliver

Easy Apply

Third Party, Contract

$70 - $80

Senior Forward Deployed Engineer (Palantir Foundry Delta)

Remote

•

2d ago

Senior Forward Deployed Engineer (Palantir Foundry Delta) Location: Remote (U.S.) Job Type: 12-month Contract (Potential Extensions) Openings: 2 Applicants must be authorized to work in the U.S. without current or future employer sponsorship. Important Requirement Candidates must have hands-on, real project experience with Palantir Foundry. Profiles without genuine Palantir experience will not be considered. About the Role We are hiring a Senior Forward Deployed Engineer (Delta) to act as a

Easy Apply

Contract

Depends on Experience

Data Engineer with Palantir Experience

Remote

•

2d ago

1+ years hands-on in Foundry, focused on a supply chain use case. 7+ in enterprise data engineering. Proficient in Pipeline Builder, Ontology, OSDK & Code Repo. Includes knowledge in Python, Pyspark, SQL. Has some full stack capability with React. Master''s in computer science.Palantir Foundry Aware Professional certification.RegardsRohit

Easy Apply

Contract

60,000 - 70,000

Junior Python AI / Data Engineer

Remote

•

3d ago

Core Focus: Building robust data pipelines, feature stores, and model-serving infrastructure using Python and SQL. Build, and optimize scalable ETL/ELT data workflows using Python, PySpark Pipeline Development: Design, build, and optimize scalable ETL/ELT data workflows using Python, PySpark

Easy Apply

Contract

60 - 70

PySpark jobs in Pennsylvania, USA