Apache Spark Jobs in Pennsylvania

Refine Results
1 - 20 of 327 Jobs

Senior Data bricks Developer with Java and Spark Experience

Trail Blazer Consulting LLC

Remote

Contract, Third Party

TITLE- Senior Data bricks Developer with Java and Spark Experience LOCATION- remote DURATION- long term INTERVIEW- video We need candidates with Active IRS Mbi clearance. Required Skills & Qualifications: Bachelor s degree in Computer Science, Information Systems, or a related field.8+ years of professional experience demonstrating the required technical skills and responsibilities listed: Programming Language Proficiency Strong expertise in Java 8 or higherExperience with functional programmin

Databricks Developer: Java Spark

Zolon Tech Solutions Inc

Remote

Contract

Databricks Developer: Java Spark Location: Remote Duration: Long Term Task Description: The Databricks Developer will be responsible for designing, developing, and maintaining scalable data processing solutions on the Databricks platform, with a focus on integrating and transforming IRS datasets such as the Information Returns Master File (IRMF), Business Master File (BMF), and Individual Master File (IMF). This role requires advanced proficiency in Java and Apache Spark, and a deep understandi

Jr. Data Engineer (Langchain, Spark) - Remote

ConsultNet, LLC

Remote or South Jordan, Utah, USA

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur

Senior Big Data/ Spark Engineer - C13

Citi

Remote or Irving, Texas, USA

Full-time

The Senior Big Data engineering lead will play a pivotal role in designing, implementing, and optimizing large-scale data processing and analytics solutions. This role requires a visionary leader who can drive innovation, define architecture strategy, and ensure the scalability and efficiency of our big data infrastructure. Key ResponsibilitiesLead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and re

Java Spark Developer - AVP

Citi

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an

Java Spark Senior Developer AVP C12 (Irving)

Citi

Remote or Irving, Texas, USA

Full-time

We are looking for a seasoned Developer who is passionate in writing clean and efficient code, building scalable systems, driving engineering excellence in a fast-paced, Agile environment. This role is ideal for developers with deep hands-on experience in Java and Apache Spark, combined with a strong foundation in object-oriented design principles. Responsibilities: Perform detailed impact analysis for code changes with understanding of dependencies across the application componentsDesign and

Senior java developer with Spark - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi

Data Engineer - Scala

Exl Service

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des

Data Engineer

Innova Solutions, Inc

Remote

Contract

Let Volt help move you forward Volt is immediately hiring for Data Engineer in Remote As a Data Engineer, you will: Key responsibilities: Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.Develop, implement, and deploy ETL solutions.Preprocess and analyze large datasets to identify patterns, trends, and insights.Evaluate, validate, and optimize data models to ensure efficiency, and generaliza

Databricks Architect

Amiseq Inc.

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg

Data Architect V

Aditi Consulting

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d

Talend HVR Consultant

Unicorn Technologies LLC

Remote

Full-time, Third Party

Tittle : Talend HVR Consultant (AWS is must) Location: Across USA any Location Remote Experience : 6+ Years Job Details 6+ years of Experience in Data Integrations, ETL, DWH.Hands on 3 Yrs experience on FiveTran/HVR.Hands on 3Yrs experience on Talend.Knowledge on AWS and Data pipelines .Knowledge on AWS Redshift & S3.Knowledge on python and spark would help.

Microsoft Fabric

Dyota Tech Solutions

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities

Pre-Sales Technical Architect

MSquare Systems Inc.

Remote

Full-time

Position: Remote & Full-Time Key Responsibilities: Solution Architecture & Implementation Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure)Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc.Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGapsOptimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environm

Databricks Architect

Showman Staffing

Remote

Contract

Databricks Architect Location: Remote US Job Type: Contract 6+ Months Experience Level: 10+ Years About the Role:-We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure arch

Data Engineer

TechNix LLC

Pittsburgh, Pennsylvania, USA

Contract

Position: Data Engineer Duration: Full Time Location Pittsburgh, PA and Cleveland, OH Job Description: 8+ Years' experience working in Data Analysis . Hands on Experience in Hadoop Stack of Technologies ( Hadoop ,Spark, HBase, Hive , Pig , Sqoop, Scala ,Flume, HDFS , Map Reduce). Hands on experience with Python & Kafka . Good understanding of Database concepts , Data Design , Data Modeling and ETL. Hands on in analyzing, designing, and coding ETL programs which involves Data pre-processing , D

Senior Machine Learning Engineer - W2 - Remote in CST hours (SAM)

Global Force USA

Remote

Contract

Required Skills: ML & Deep Learning: PyTorch, TensorFlow, distributed training, LLM fine-tuning, transformer architectures, model optimizationCloud & Infrastructure: AWS services (EC2, EKS, S3, SageMaker, Terraform/CloudFormation, Docker, KubernetesData & Processing: Python, Apache SparkDatabricks

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut

Google Cloud Platform Data Engineer

Intellect Quest LLC

Remote

Contract, Third Party

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur

Senior/Lead Data Engineer , Remote, $63/HR

FASTRA LLC

Remote

Contract

Job Title: Senior/Lead Data Engineer Location: Remote Duration: 12 Months Responsibilities: Collaborate with cross-functional stakeholders (including data scientists, analysts, and business teams) to define data requirements, processing needs, and analytics solutions.Create and sustain scalable data models and efficient extraction processes.Establish and monitor data quality checks and validation systems.Construct and enhance business intelligence dashboards.Produce comprehensive documentation f