apache spark Jobs in pennsylvania

Refine Results
1 - 20 of 315 Jobs

Senior Python Engineer with Spark

EPAM Systems

•

Remote

Full-time

We are looking for a talented Senior Python Engineer with Spark to join our team working on financial data and analytics. You'll be a crucial player in a team accountable for data integration and transformation, developing models and managing a vast array of structured financial data. You'll design and build robust software that efficiently processes data through our medallion architecture. We make use of cutting-edge technology with Databricks on Microsoft Azure. This position offers remote se
Posted 60+ days ago | Updated 9 days ago

Data Engineer - Spark

Exl Service

•

Remote or Fremont, California, USA

Full-time

Company Overview: EXL Service is a global technology and analytics company specializing in delivering innovative, scalable, and high-quality technology solutions. Our global team consists of experienced professionals in design, software engineering, analytics, and data science, committed to solving complex business problems and enabling our clients to achieve their strategic goals. We focus on solving customer business problems by delivering products designed with best-in-class engineering pract
Easy Apply
Posted 60+ days ago | Updated 10 days ago

Senior Big Data/ Spark Engineer - C13

Citi

•

Remote or Irving, Texas, USA

Full-time

The Senior Big Data engineering lead will play a pivotal role in designing, implementing, and optimizing large-scale data processing and analytics solutions. This role requires a visionary leader who can drive innovation, define architecture strategy, and ensure the scalability and efficiency of our big data infrastructure. Key ResponsibilitiesLead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and re
Posted 17 days ago | Updated 3 hours ago

Java Spark Senior Developer AVP C12 (Irving)

Citi

•

Remote or Irving, Texas, USA

Full-time

We are looking for a seasoned Developer who is passionate in writing clean and efficient code, building scalable systems, driving engineering excellence in a fast-paced, Agile environment. This role is ideal for developers with deep hands-on experience in Java and Apache Spark, combined with a strong foundation in object-oriented design principles. Responsibilities: Perform detailed impact analysis for code changes with understanding of dependencies across the application componentsDesign and
Posted 60+ days ago | Updated 3 hours ago

Senior java developer with Spark - VP - TAMPA

Citi

•

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi
Posted 60+ days ago | Updated 3 hours ago

Data Engineer

Innova Solutions, Inc

•

Remote

Contract

Let Volt help move you forward Volt is immediately hiring for Data Engineer in Remote As a Data Engineer, you will: Key responsibilities: Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.Develop, implement, and deploy ETL solutions.Preprocess and analyze large datasets to identify patterns, trends, and insights.Evaluate, validate, and optimize data models to ensure efficiency, and generaliza
Easy Apply
Posted 23 days ago

Neo4j Architect

Exl Service

•

Remote

Contract

Hi, We have urgent requirements for our direct client, please go through the below Job Description. If you are interested please send me your updated word format resume to and reach me @ . Job Title: Neo4j Architect Location: Remote Duration : Full Time Role and Responsibilities: Model complex data sets in Graph technology (Neo4j)Work collaboratively with team to plan and solve complex problems like fraud investigations across different products and transactions.Expertise in graph modeling ba
Easy Apply
Posted 4 days ago | Updated 10 hours ago

Databricks Architect

Amiseq Inc.

•

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg
Easy Apply
Posted 31 days ago

API Developer - Local to Hoover, AL - C2H on W2 - Posted by Tauqeer

Global Force USA

•

Remote

Contract

Required Skills: Needing a strong API Developer/administration (must have API Gateway and API Security experience) Also must have strong java/spring boot experience OAuth2 security automation framework Job Description API Gateway (no specific product, but Kong Konnect or Apigee would be a plus) OAuth2 security automation frameworkJava/Spring boot for REST API development Experience mentoring developers, conducting code reviews, and leading architecture discussions with Architect and work closely
Easy Apply
Posted 9 hours ago

Azure Data Architect

HR Pundits

•

Philadelphia, Pennsylvania, USA

Full-time, Part-time, Third Party, Contract

Job Title: Azure Data Architect Location: Collegeville or Philadelphia, PA Overview Seeking a hands-on Azure Data Architect with recent delivery of at least two Azure projects. You'll design scalable cloud data solutions, guide teams, and ensure performance and cost-efficiency across platforms. Key Requirements 10+ years in data engineering, cloud architecture, or governance Azure Certified (must-have) Deep expertise in Databricks, Delta Lake, Unity Catalog, and Medallion architecture Strong
Easy Apply
Posted 10 hours ago

Senior AI/ML Engineer with Pyspark (12+ Years only)

KONNECTINGTREE INC

•

Remote

Contract

W2 Role - if Own Corp we can do C2CPosition: Senior AI/ML Engineer with Pyspark (12+ Years only)Location: RemoteDuration: Longterm (Contract) Required Skills and Experience:Proven expertise in feature engineering and model development for NLP, anomaly detection, or security domains.Strong programming skills in Python with hands-on experience in PyTorch for model development.Experience with Apache Spark (PySpark) for distributed data processing.Deep understanding of MLflow for model tracking, ver
Easy Apply
Posted 7 days ago

Sr.DataEngineerWith strongGoogle Cloud PlatformBackground (12+ yrs minimum experience required)

Aroha Technologies

•

Philadelphia, Pennsylvania, USA

Contract, Third Party

Title: Sr. Data Engineer With strong Google Cloud Platform Background Experience: 12+ Years Location: Onsite- From Philadelphia PA (Need only Locals to PA) Candidate has to be from PA Primary Skills- PySpark, Spark, Python, Big Data, Google Cloud Platform, Apache Beam, Dataflow, Airflow, Kafka and BigQuery Good to Have: GFO, Google Analytics Javascript is Must Job Description: 12+ years experience as a data warehouse engineer/architect designing and deploying data systems in a sta
Easy Apply
Posted 1 day ago | Updated 7 hours ago

Sr Machine Learning Engineer

MMD Services, Inc

•

Remote

Full-time

About the Company Our client is a prominent Global leader dedicated to delivering exceptional experiences with over 1,000 subsidiaries and affiliated brands. With a commitment to innovation and personalized service, they are seeking a Senior Machine Learning Engineer to join their team immediately. This Machine Learning Engineer will be joining a high-impact, high-visibility team that s just getting started. This is your chance to help lay the groundwork for ML powers this global company s futur
Easy Apply
Posted 9 days ago

Software Engineer Sr

V2Soft

•

Pittsburgh, Pennsylvania, USA

Contract

Location: Pittsburgh, PA (Preferred) or Strongsville, OHRequired Skills (4-6 years): Spark3, Python, Shell scripting Hadoop/Cloudera (admin + table/file processing) Data & System Architecture experience Erwin for data modeling Alation or equivalent tools
Easy Apply
Posted 1 day ago | Updated moments ago

Technical Architect

MSquare Systems Inc.

•

Remote

Full-time

Position: Remote & Full-TimeKey Responsibilities: Solution Architecture & Implementation Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure)Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc.Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGapsOptimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environme
Easy Apply
Posted 24 days ago | Updated 10 days ago

Senior Java Backend Developer(Pig,Oozie,Hadoop)

GlobalLogic Inc.

•

Remote

Full-time

Job Description: 6+ years of experience in web, Data processing, Hadoop/data processing, distributed systems, and/or large-scale databases.Knowledge on pig, oozie, spark, python, SQL queryStrong background in full-stack web application development, Java, Microservices,Experience with container and cloud technologies such as Kubernetes, Dockerknowledge of Google Cloud Platform /AWS, Airflow, and Data Batch processingVery good at problem-solving and DSExcellent verbal and written communication ski
Easy Apply
Posted 4 days ago | Updated 2 days ago

Data Engineer

Judge Group, Inc.

•

Malvern, Pennsylvania, USA

Contract

Location: Malvern, PA Description: Our client in Malvern, PA is currently seeking an AWS Data Engineer. Qualifications & Requirements: Troubleshoot and optimize new and existing ETL packagesExperience with AWS EMR, AWS Glue, AWS Athena. AWS Cloudformation, AWS IAM, S3, AWS SNS, Tableau, Hive Experience building Spark data processing applications (Python, Pyspark)Experience with SQL development By providing your phone number, you consent to: (1) receive automated text messages and calls from
Posted 11 days ago | Updated moments ago

AWS & Snowflake Architect

Exl Service

•

Remote

Full-time

Hi, We have urgent requirements for our direct client, please go through the below Job Description. If you are interested, please send me your updated word format resume to and reach me @ . Job Title: AWS & Snowflake Architect Location: Remote Duration: Full Time Job Description Role Overview The AWS & Snowflake Architect will design and develop enterprise-scale data solutions using Snowflake, focusing on AWS-native frameworks for data ingestion, transformation, and governance. This role require
Easy Apply
Posted 7 days ago | Updated 10 hours ago

Java Full stack Developer

Meta Soft Inc.

•

Remote

Full-time

Full-Stack Engineer (Mid-Level)Job Type: Full-timeScheduled Weekly Hours: 40Location: RemoteClearance: Public Trust or Higher levels Work StatusPosition Overview:We are seeking a Mid-Level Full-Stack Engineer with strong experience in modern software development and cloud environments. The ideal candidate will be proficient in both front-end and back-end technologies, cloud-native development (particularly AWS), and DevSecOps practices.Required Skills & Experience:U.S. Citizenship required5+ yea
Easy Apply
Posted 3 days ago | Updated 3 days ago

Data Engineer

Vaco by Highspring

•

Remote

Contract

Vaco is on the search for a key client as they build out their data engineering team. In this role,as a Data Engineer, your primary responsibility will be to lead the design, development, and implementation of data solutions while driving strategic initiatives across the enterprise. We are looking for a strong background with Azure Data Factory, Kafka, Snowflake, SQL and ETL processes. You will assist with data warehousing architecture design and strategies for data replication, governance, obse
Easy Apply
Posted 36 days ago | Updated 8 hours ago