apache spark jobs in philadephia, pa

Senior Databricks Solution Engineer (EDP & CDP)

Hybrid in Philadelphia, Pennsylvania

•

5d ago

Senior Databricks Solution Engineer Enterprise Data Platform (EDP) & Customer Data Platform (CDP) Azure Databricks | Lakeflow | Delta Live Tables | ADF | Kafka | MongoDB This role blends solution architecture, handson data engineering, and enterprise enablement, with a strong focus on retail, customer, marketing, and digital data. You will define and enforce enterprise data standards, build reusable frameworks, and deliver secure, governed data pipelines that support analytics, personalization,

Easy Apply

Contract

Depends on Experience

Data Engineer (Spark + HBase + Java)- 100% Remote- Only w2

Remote

•

2d ago

Key ResponsibilitiesDevelop and maintain data pipelines using Spark (PySpark/Scala/Java)Work with HBase and Hadoop ecosystem tools (Hive, Impala, Hue)Process large datasets in distributed environmentsCollaborate with backend teams for data integrationOptimize performance of data processing jobsSupport data ingestion, transformation, and storage solutionsParticipate in testing and performance tuningRequired SkillsStrong experience with Apache Spark (must-have)Hands-on with HBase (must-have)Good p

Easy Apply

Contract, Third Party

Depends on Experience

Hybrid Senior Software Engineer - Data & BI

Camden, New Jersey

•

4d ago

ROLE SUMMARY The Sr. Software Engineer Data & BI is responsible for designing, developing, and optimizing scalable cloud based data pipelines and analytics solutions using Azure Data Factory, Databricks, and Lakehouse architecture. This role works extensively with business partners across to understand their business processes, data needs, and operational challenges, and to translate those into high quality, secure, and scalable data solutions. Although this position is primarily focused on dat

Easy Apply

Full-time

Depends on Experience

Data Architect

Philadelphia, Pennsylvania

•

18d ago

About the Role We are seeking ahands-on Data Architectto support a high-impactAdvertising & Media Sales Data Platformwithin the Demand Generation (Sales & Marketing) organization. This role requires deep technical expertise in modern cloud data platforms, combined with strong architectural design capabilities. Key Responsibilities Design and implementend-to-end cloud data architectureon AWSDevelop and maintain:Dimensional data models (star schema, fact/dimension design)Semantic data layersArchit

Easy Apply

Contract, Third Party

Depends on Experience

Engineer, AI/ML Operations

Philadelphia, Pennsylvania

•

Today

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can prou

Full-time

Senior Data Architect

Hybrid in Philadelphia, Pennsylvania

•

11d ago

Data Architecture Lead Overview This role is responsible for leading the design, governance, and evolution of enterprise data ecosystems. The Data Architecture Lead will define data strategies, establish standards, and guide the organization in building scalable, secure, and high-impact data solutions. This individual partners closely with leadership to translate complex business needs into actionable data frameworks that support decision-making and innovation. Key Responsibilities Design and i

Easy Apply

Contract

$55

Software Engineer II

Wilmington, Delaware

•

Today

Title: Software Engineer II Job Location: 1100 North Market Street, Wilmington, DE 19801. Position requires in-office work four (4) days every week. Job Description: Develop, design, and support ETL processes. Prepare and manage the technical components of project plans. Perform unit testing of the jobs and assist with SIT (System Integration Testing) and UAT (User Acceptance Testing). Create pipelines to deploy code to higher environments. Work closely with data stewards for data mapping and i

Full-time

USD 153,358.00 per year

Telecom ETL Data Architect (Contract W2)

Hybrid in West Chester, Pennsylvania

•

3d ago

Data Architecture & Engineering Design and architect scalable, high-performance ETL/ELT data pipelines using PySpark, Python, and Spark clusters.Develop data models and frameworks aligned with telecom processes such as buyflow, billing, usage, customer management, and order processing.Build, optimize, and monitor pipelines on Databricks (Delta Lake, Workflows, Cluster configuration).Define and enforce ETL standards, data quality rules, and engineering best practices.Domain & Business Integration

Easy Apply

Contract

Depends on Experience

Sr. Specialist - Data Engineering - Intelligence Platform

Philadelphia, Pennsylvania

•

2d ago

{"description": "As a Sr. Specialist of Data Engineering - Intelligence Platform, reporting to Assistant Vice President of Product Management, you'll play a critical role in building best-in-class data architectures that power next-generation analytics and AI-driven insights for Financial Market Infrastructures and global banks. You will design scalable data systems, develop robust data models, and collaborate across teams to transform complex data into intelligent, actionable structures. You'll

Full-time

Compensation information provided in the description

Java J2EE Developer

Wilmington, Delaware

•

Today

Location: Wilmington, DE Salary: Depends on Experience Description: Java Developer (Contract to Hire) Location: Wilmington, DE Engagement Type: Contract to Hire Pay Rate: $50 - 65/hour Minimum Qualifications Bachelor's degree or equivalent practical experience.Strong experience developing applications using Java and Spring Boot.Experience designing and building RESTful APIs and backend services.Hands-on experience with cloud-native application development (e.g., AWS).Experience working with

Contract

USD 50.00 - 65.00 per hour

AI/ML Cloud Engineer

Philadelphia, Pennsylvania

•

2d ago

A client of Innova Solutions is immediately hiring for an AI/ML Cloud Engineer. Position type: Contract / Full Time Duration: 12 Months Location: Bloomfield, CT (Hybrid) AI/ML Cloud Engineer, you will: Work closely with data science, DevOps, and engineering teams to support AI/ML infrastructure, deployments, and cloud-based initiatives. Day to Day Responsibilities Design, deploy, and manage cloud infrastructure supporting AI/ML workloads on AWS and Azure Manage compute resources including EC2

Easy Apply

Contract

Depends on Experience

Cloudera Platform Engineer

Remote or California

•

9d ago

Technical Skills Primary Minimum 5 years of experience on Cloudera Platform management configuration Handson experience with Cloudera on prem platform components HDFS Hive Yarn Spark Kafka HBase Experience with Cloudera Data Platform including installation configuration patching scaling performance tuning Good at cluster capacity planning and file system management Hands on experience with Kerberos RangerSentry and HDFS encryption Backup and recovery strategies for HDFS and Metadata services Des

Easy Apply

Contract, Third Party

$DOE

Databricks Data Engineer

Remote

•

26d ago

Job Title:Databricks Data EngineerLocation:Remote with Quarterly travel to Gaithersburg, MDDuration: 6 monthsPR: $68.50/hr on W2Security Clearance Required: PUBLIC TRUSTGreater DC Area preferredJob Description:Client is seeking a Databricks Data Engineer to develop/support new/existing data pipelines, and data analytics environments in Azure cloud-based data lake. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft A

Easy Apply

Contract

65 - 68

Senior Data Architect

Remote or Hybrid in Texas City, Texas

•

16d ago

Contract description Key Responsibilities Database & System ArchitectureDesign and implement scalable, secure database architectures for transactional and analytical use cases. Define data models, partitioning strategies, indexing, and normalization standards. Ensure data integrity, reliability, and maintainability across enterprise systems. Support architectural decisions for high-availability and fault-tolerant systems. Performance Tuning & OptimizationAnalyze and optimize complex SQL queries

Easy Apply

Contract

80 - 85

Microsoft Fabric Technical Architect

Remote

•

18d ago

Title: Microsoft Fabric Technical Architect Location: Denver, CO.(Remote) Contract: 12 Months Job Description: 12+ years overall experience in data engineering / data platform roles.2+ years of hands-on experience architecting and implementing on Microsoft Fabric.Strong proficiency in SQL (performance tuning, complex transformations, analytics-ready modeling).Hands-on expertise with Azure Data Factory (or Fabric pipelines), including orchestration patterns and parameterized pipelines.Strong hand

Easy Apply

Third Party, Contract

Depends on Experience

Sr. Embedded Software Engineer

Horsham, Pennsylvania

•

Today

Build your best future with the Johnson Controls team! As a global leader in smart, healthy, and sustainable buildings, our mission is to reimagine the performance of buildings to serve people, places, and the planet. Join a winning team that enables you to build your best future! Our teams are uniquely positioned to support a multitude of industries across the globe. You will have the opportunity to develop yourself through meaningful work projects and learning opportunities. We strive to provi

Full-time

USD 95,000.00 - 140,000.00 per year

Databricks Data Engineer

Remote

•

25d ago

Job Title: Databricks Data Engineer Location: Washington, DC Type: Contract Compensation: $62.00 - $75.00 per hour Contractor Work Model: Remote Hours: 40.0 hours per week Security Clearance: Must have an active Public Trust clearance Responsibilities Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture. Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously, where each project may have multip

Easy Apply

Contract, Third Party

$62

Principal Software Engineer

Wilmington, Delaware

•

Today

Job Description If you are looking for a game-changing career, working for one of the world's leading financial institutions, you've come to the right place. As a Principal Software Engineer at JPMorgan Chase within the Corporate Technology, you will provide expertise and engineering excellence as an integral part of an agile team to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Leverage your advanced technical capabilities and co

Full-time

Azure Data Engineer

Remote

•

3d ago

Role Senior azure Engineer Location: Remote (United States)Employment Type: Contract (W2) Duration: 6+ Months (Possible Extension)Key ResponsibilitiesDesign, build, and orchestrate scalabledata pipelinesusing Azure-native services.Develop and optimizebatch and near real-time data processing solutionsusing Spark and Databricks.Implement and manageenterprise-grade Lakehouse architectures(Medallion architecture).Performdata processing, validation, and automationusing Python (PySpark, Pandas, NumPy)

Easy Apply

Contract

50 - 55

AI Data Scientist

Remote

•

5d ago

Role OverviewAn AI Data Scientist is responsible for analyzing complex datasets and building AI/ML models to generate insights and drive intelligent decision-making. This role combines data science, machine learning, and AI techniques to solve business problems and develop predictive and generative solutions. Key ResponsibilitiesAnalyze structured and unstructured data to identify trends and patternsBuild, train, and evaluate machine learning and AI modelsDevelop predictive models, recommendatio

Easy Apply

Full-time

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

apache spark jobs in Philadelphia, PA, USA