apache spark Jobs in pennsylvania

Refine Results
1 - 20 of 328 Jobs

Remote Sr. Spark/Scala Developer

Software Guidance & Assistance

•

Remote or Jacksonville, Florida, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Sr. Spark/Scala Developer for a CONTRACT assignment with one of our premier Healthcare Services clients for a Remote position. Responsibilities: A Hadoop developer is responsible for the design, development and operations of systems that store and manage large amounts of data. Most Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science, or ma
Posted 29 days ago | Updated 5 hours ago

Jr. Data Engineer (Healthcare, Spark, Scala) - Remote

ConsultNet, LLC

•

Remote

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur
Easy Apply
Posted 18 days ago | Updated 6 hours ago

Java Spark Developer - AVP

Citi

•

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an
Posted 8 days ago | Updated 6 hours ago

Senior java developer with Spark - VP - TAMPA

Citi

•

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi
Posted 60+ days ago | Updated 6 hours ago

Data Engineer - Scala

Exl Service

•

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des
Easy Apply
Posted 19 days ago | Updated 19 days ago

Data Engineer - Malvern, PA.

TechniPros, LLC

•

Malvern, Pennsylvania, USA

Contract

Job Role: Data Engineer Location: Malvern, PA. Long Term Contract Only W2, No C2C Core Responsibilities: Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions. Translates business specifications into design s
Easy Apply
Posted 23 hours ago

Databricks Architect

Amiseq Inc.

•

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg
Easy Apply
Posted 7 days ago

Agentic Data Engineer(AI Engineer)-EST Candidates Only

Silver Xis, Inc.

•

Remote

Full-time

Artificial Intelligence Engineer - Agentic Data Engineer Richmond, VA REMOTE Resource will need to be in Richmond, VA quarterly. The Information Technology Division is seeking a highly skilled Artificial Intelligence Engineer 4- Agentic Data Engineer to design, develop, train and deploy data models that leverage agentic AI that solve real-world problems. Responsibilities: Gather business needs and translate them to analytics.Produce code that is clearly documented and maintain a version-contro
Easy Apply
Posted 1 hour ago

Data Architect V

Aditi Consulting

•

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d
Easy Apply
Posted 13 days ago | Updated moments ago

Microsoft Fabric

Dyota Tech Solutions

•

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities
Easy Apply
Posted 20 days ago

Pre-Sales Technical Architect

MSquare Systems Inc.

•

Remote

Full-time

Position: Remote & Full-Time Key Responsibilities: Solution Architecture & Implementation Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure)Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc.Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGapsOptimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environm
Easy Apply
Posted 19 hours ago

Big Data Hadoop Engineer

Harvey Nash Inc.

•

Remote

Contract

We are seeking a Big Data Hadoop Engineer for one of our direct client & its a 100% remote opportunity, needing to work in PST time zone. Looking for candidates who can work only on W2 Must Haves Strong experience in Big Data, Cloudera Distribution 7.x, RDBMS development4-5 years of programming experience in Python, Java, Scala, and SQL is must.Strong experience building data pipelines using Hadoop components Sqoop, Hive, SOLR, MR, Impala, Spark, Spark SQL, HBase.Strong experience with REST API
Easy Apply
Posted 36 days ago | Updated 28 days ago

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

•

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut
Easy Apply
Posted 7 days ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Third Party, Contract

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 14 days ago

Data Engineer

Vaco by Highspring

•

Remote

Contract

Vaco is on the search for a key client as they build out their data engineering team. In this role,as a Data Engineer, your primary responsibility will be to lead the design, development, and implementation of data solutions while driving strategic initiatives across the enterprise. We are looking for a strong background with Azure Data Factory, Kafka, Snowflake, SQL and ETL processes. You will assist with data warehousing architecture design and strategies for data replication, governance, obse
Easy Apply
Posted 13 days ago | Updated 5 days ago

Druid Engineer

Biztec Global LLC

•

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in
Easy Apply
Posted 6 days ago

Machine Learning Engineer | Only W2

TekDallas

•

Remote

Contract

Position: Machine Learning Engineer Location: 100% Remote (EST time zone) Duration: 12 Month Contract Only W2 Qualifications: 10+ years of IT experience and at least 5+ years working as a Machine Learning EngineerMust have strong programming skills in PythonExperience with both RDBMS and NoSQL databases (e.g., MongoDB, BigQuery)Hands-on experience with data preprocessing, feature engineering, and model evaluationExperience working with cloud platforms, especially Google Cloud Platform (Googl
Easy Apply
Posted 19 hours ago

Data Engineering Manager - Security

Netflix, Inc.

•

Remote

Full-time

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Securing our members' data and accounts appropriately is key to maintaining a high level of trust with our customers. In addition, securing our technology infrastructur
Posted 4 days ago | Updated 7 hours ago

Databricks Solution Architect

Innova Solutions, Inc

•

Remote

Full-time

A client of Innova Solutions is looking for a Databricks Solution Architect Position Type: Full-Time Location: Remote Industry: Healthcare As a Databricks Solution Architect, you will: Minimum Qualifications: We are looking for an experienced Databricks Solution Architect to join our team and lead the design, development, and optimization of scalable data and analytics solutions on the Databricks platform. You will play a key role in architecting cloud-native data pipelines, enabling advanced an
Easy Apply
Posted 53 days ago | Updated 22 days ago

Data Engineer

Eliassen Group

•

Anywhere, US

Contract

Description: We're looking for two skilled Senior Data Engineers to join a high-impact project migrating workloads from a Hadoop On-Prem cluster to Google Cloud Platform (Google Cloud Platform). We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $65 - $75 / hr. w2 Responsibilities: Build Spark/BigQuery data pipelines on Google Clo
Posted 1 day ago | Updated 7 hours ago