Apache Spark Jobs in Philadephia, PA

Refine Results
21 - 40 of 327 Jobs

BI Manager

KPI Partners, Inc.

•

Philadelphia, Pennsylvania, USA

Full-time

KPI Partners, A global consulting firm focused on strategy, technology, and digital transformation. We help companies tackle their most ambitious projects and build new capabilities. We provide solutions in Cloud, Data, Application Development & BI spaces. We enable your growth At KPI, you can become who you want to be and learn skills that will take you further in your career Continuously upgrade yourself Develop as a future leader Drive cloud enablement around the world Engineering Excellence
Easy Apply
Posted 7 days ago

Data Engineer

Innova Solutions, Inc

•

Remote

Contract

Let Volt help move you forward Volt is immediately hiring for Data Engineer in Remote As a Data Engineer, you will: Key responsibilities: Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.Develop, implement, and deploy ETL solutions.Preprocess and analyze large datasets to identify patterns, trends, and insights.Evaluate, validate, and optimize data models to ensure efficiency, and generaliza
Easy Apply
Posted 7 days ago

Databricks Architect

Amiseq Inc.

•

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg
Easy Apply
Posted 15 days ago

Data Engineer Hybrid- multiple locations (DFW area, Central Florida, King of Prussia, PA, Stratford, CT, Denver, Marietta, GA)

Calance

•

King of Prussia, Pennsylvania, USA

Contract

Description:Your Mission: As a Data Engineer, you will be responsible for the development, optimization, and management of data ingestion, transformation, and storage processes using modern frameworks. The successful candidate will implement infrastructure-as-code and automation solutions to streamline and build resiliency into data processing workflows. You will work closely with our data science and analytics teams to create and optimize data and machine learning models that support stakehold
Posted 2 days ago | Updated 6 hours ago

Data Architect V

Aditi Consulting

•

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d
Easy Apply
Posted 21 days ago | Updated 4 hours ago

Talend HVR Consultant

Unicorn Technologies LLC

•

Remote

Full-time, Third Party

Tittle : Talend HVR Consultant (AWS is must) Location: Across USA any Location Remote Experience : 6+ Years Job Details 6+ years of Experience in Data Integrations, ETL, DWH.Hands on 3 Yrs experience on FiveTran/HVR.Hands on 3Yrs experience on Talend.Knowledge on AWS and Data pipelines .Knowledge on AWS Redshift & S3.Knowledge on python and spark would help.
Easy Apply
Posted 12 hours ago

Data Migration Engineer

Kforce Technology Staffing

•

Wilmington, Delaware, USA

Contract

RESPONSIBILITIES: Kforce's client is seeking multiple candidates for a Data Migration Engineer role in Delaware, Eastern Maryland and near Philadelphia. Roles and Responsibilities * Configure and set up the AWS platform environment to meet organizational requirements and stage for eGain migration * Ensure that the platform is optimized for performance, security, and scalability * Provide technical support, write python widgets and troubleshooting during the setup phase to address any issues tha
Posted 60+ days ago | Updated 2 hours ago

Microsoft Fabric

Dyota Tech Solutions

•

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities
Easy Apply
Posted 27 days ago

Pre-Sales Technical Architect

MSquare Systems Inc.

•

Remote

Full-time

Position: Remote & Full-Time Key Responsibilities: Solution Architecture & Implementation Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure)Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc.Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGapsOptimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environm
Easy Apply
Posted 8 days ago | Updated 2 days ago

Databricks Architect

Showman Staffing

•

Remote

Contract

Databricks Architect Location: Remote US Job Type: Contract 6+ Months Experience Level: 10+ Years About the Role:-We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure arch
Easy Apply
Posted 1 day ago

Data Engineer

Veeva Systems

•

Philadelphia, Pennsylvania, USA

Full-time

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth potential ahead. At the heart of Veeva are our values: Do the Right Thing, Customer Success, Employee Success, and Speed. We're not just any public company - we made history in 2021 by becoming a public benefit corporation
Posted 60+ days ago | Updated 9 hours ago

Database ETL Test Engineer

Federal Reserve Bank of Philadelphia

•

Philadelphia, Pennsylvania, USA

Full-time

Company Federal Reserve Bank of Philadelphia The Federal Reserve Bank of Philadelphia is one of the 12 regional Reserve Banks that, together with the Board of Governors in Washington, D.C., make up the Federal Reserve System. It helps formulate and implement monetary policy, supervises banks and bank and savings and loan holding companies, and provides financial services to depository institutions and the federal government. The Federal Reserve Bank of Philadelphia serves eastern and central P
Posted 7 days ago | Updated 6 hours ago

Senior Machine Learning Engineer - W2 - Remote in CST hours (SAM)

Global Force USA

•

Remote

Contract

Required Skills: ML & Deep Learning: PyTorch, TensorFlow, distributed training, LLM fine-tuning, transformer architectures, model optimizationCloud & Infrastructure: AWS services (EC2, EKS, S3, SageMaker, Terraform/CloudFormation, Docker, KubernetesData & Processing: Python, Apache SparkDatabricks
Easy Apply
Posted 10 hours ago

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

•

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut
Easy Apply
Posted 15 days ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Contract, Third Party

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 21 days ago

Senior/Lead Data Engineer , Remote, $63/HR

FASTRA LLC

•

Remote

Contract

Job Title: Senior/Lead Data Engineer Location: Remote Duration: 12 Months Responsibilities: Collaborate with cross-functional stakeholders (including data scientists, analysts, and business teams) to define data requirements, processing needs, and analytics solutions.Create and sustain scalable data models and efficient extraction processes.Establish and monitor data quality checks and validation systems.Construct and enhance business intelligence dashboards.Produce comprehensive documentation f
Easy Apply
Posted 11 hours ago | Updated 6 hours ago

Site Reliability Engineer

Judge Group, Inc.

•

Wilmington, Delaware, USA

Contract

Location: Wilmington, DE Salary: $55.00 USD Hourly - $65.00 USD Hourly Description: Job Title: Site Reliability Engineer Location: Wilmington, DE (Onsite) Job Type: Contract to Hire (W2 only) Job Description: Client is seeking a Site Reliability Engineer for an onsite contract-to-hire position in Wilmington, DE. The ideal candidate will have extensive experience with AWS, Spark, PySpark, Python, and SQL. Must-Have Qualifications: Minimum 5 years of experience with AWS, Big Data, Spark, and S
Posted 60+ days ago | Updated 5 hours ago

Druid Engineer

Biztec Global LLC

•

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in
Easy Apply
Posted 14 days ago

Machine Learning Engineer | Only W2

TekDallas

•

Remote

Contract

Position: Machine Learning Engineer Location: 100% Remote (EST time zone) Duration: 12 Month Contract Only W2 Qualifications: 10+ years of IT experience and at least 5+ years working as a Machine Learning EngineerMust have strong programming skills in PythonExperience with both RDBMS and NoSQL databases (e.g., MongoDB, BigQuery)Hands-on experience with data preprocessing, feature engineering, and model evaluationExperience working with cloud platforms, especially Google Cloud Platform (Googl
Easy Apply
Posted 8 days ago | Updated 1 day ago

Data Engineer III - Cybersecurity Technology Resiliency

JPMorgan Chase & Co.

•

Wilmington, Delaware, USA

Full-time

Job Description Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team. As a Data Engineer at JPMorgan Chase within the Cybersecurity Technology Resilience department, you serve as a seasoned member of an agile team to design and deliver trusted data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. You are responsible for developing, testing, and maintaining critical data pipelines and architectures acro
Posted 60+ days ago | Updated 9 hours ago