Apache Spark jobs in Pennsylvania

PYTHON / SPARK QUALITY ASSURANCE- HYBRID IN SEVERAL LOCATIONS

Hybrid in Pittsburgh, Pennsylvania

•

7d ago

Coordinate other QE's and collect evidences and make sure it gets complied based on standard testing formatsPyramid Consulting Group Inc has a banking client with an immediate need for an experienced PYTHON SPARK QA with the following background and skills: Python Spark Testing / Test Automation background Documentation Big Data Hadoop Jira Xray Flex Skills/Nice to Have: Background in Agile methodology. Education/Certifications: Anything related to testing space as far as certification plus, a

Contract

Depends on Experience

Software Development Manager, Java and Spark, Senior Vice President

Remote or Irving, Texas

•

Today

The Software Development Manager, Java and Spark, Senior Vice President is a senior management level position responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology Team. The overall objective of this role is to drive applications systems analysis and programming activities. Responsibilities: Manage multiple teams of professionals to accomplis

Full-time

USD 156,160.00 - 234,240.00 per year

Databricks Data Engineer || 14+ years experience || LinkedIn Must || Remote in Texas(Locals only)

Remote

•

22d ago

Role: Databricks Data EngineerDuration: Long-term contractLocation: RemoteExperience: 14+ years required Local to Texas Only Responsibilities: Design & develop scalable data pipelines using Apache Spark on Databricks Implement ETL/ELT workflows for structured & unstructured data Optimize Spark jobs for performance and cost Integrate with Azure Data Factory and other Azure services Automate deployments via CI/CD pipelines Ensure data quality, governance (Unity Catalog, Delta Lake), and security C

Easy Apply

Contract

Up to $65

Data Engineer Python & Iceberg Specialist

Remote

•

Today

We are currently looking to hire a [Data Engineer Python & Iceberg Specialist] and we believe your skills and expertise are a better match for this role. We have an exciting career opportunity for you with one of our esteemed clients at [Remote] NJTECH is a globally managed IT services, IT consulting and business solutions partner. Our "High Performance Business" strategy builds our expertise in technology and consulting. We play a major role in helping our clients to achieve their objectives a

Easy Apply

Contract

$0 - $0

Platform Architect : Databricks

Remote

•

Yesterday

Role - Platform Architect : Databricks Location - KY / Remote Option possible Tentative Duration - 6 months Rate - All-invlusive Deep understanding of Databricks architecture, including clusters, notebooks, jobs, and the underlying compute and storage layers Experience building Databricks as a global platform across multiple regions Proficiency in Apache Spark, including its core components (Spark SQL, Spark Streaming, and MLlib) Knowledge of Delta Lake and its features (ACID transactions, time

Easy Apply

Contract, Third Party

SCALA Developer

Remote

•

Today

Role: SCALA Developer Location: Remote - Anywhere in USA Required Skills: Apache Spark with Scala is Must Drools experience is requiredMust have experience in Hadoop Distributed File System (HDFS) SQL experience is needed in Advanced levelJava Enterprise Edition (Java EE / J2EE) experience.

Easy Apply

Full-time

$100,000 - $120,000

Big Data Architect - INDIA

Remote

•

25d ago

Remoe work requirement for 6m-1 year = India based = Big Data Architect Hadoop. We need your help in getting a Big Data Architect (Hadoop) for our banking client - that is a one-man armyWork to be split between India (base) and Singapore (visiting) preferably.6 month to 1 yearSome travel between india and Singapore neededAbility to hold initial consultative type conversations with client initially (on solution and proposal) and then implement the architecture you will recommend in Hadoop. We're

Easy Apply

Contract

Depends on Experience

Data Engineer

Remote or Hybrid in Blue Ash, Ohio

•

Today

Payrate: $65.00 - $76.45/hr. Summary: The team is looking for a Data Engineer experienced in implementing data solutions in Azure. The Data Engineer will analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. The Data Engineer will also support the implementation of Infrastructure as Code (IaC) by working with teams to help engineer scalable, reliable, and resilient software running in the cloud. Accountable for dev

Easy Apply

Contract

$65 - $76.45 hr

Cloud DevOps Administrator Expert

Remote

•

3d ago

Job Summary- 100% Remote We are seeking a Cloudera Data Engineer to support the migration of a Medicaid Data Warehouse Implementation in AWS environment. The resource will support the migration and continued operations of an existing Cloudera/Hive/Scala-based data pipeline environment from one AWS account to another. This position is responsible for ensuring a seamless transition, validating data integrity and job performance, and maintaining reliable daily operations post-migration. The role wi

Easy Apply

Contract, Third Party

Depends on Experience

C# Developer

Remote

•

3d ago

We are Looking for C# Developer in Redmond,WA- Open for Remote ( Need to work in EST timezone) Please make sure candidates have experience for all the below skills. Skillset: C#, Spark SQL Server Synapse AKS Azure MS Experience

Easy Apply

Full-time

50 - 52

Databricks Solutions Architect

Remote

•

Today

Databricks Solutions Architect Fully Remote 8-12 months to another 12 months extension 7+ years of experience in data engineering, data platforms & analytics, 10+ years of consulting experience. Completed Data Engineering Professional certifications and & required classes Minimum 6-8+ projects delivered with hands-on experience in development on databricks Working knowledge of two or more common cloud ecosystems (AWS, Azure, Google Cloud Platform) with deep expertise in at least one Deep experie

Easy Apply

Contract

Depends on Experience

Sr Data Platform Software Engineer

Remote

•

Today

Job Description: We are seeking a skilled Senior Data Platform Software Engineer to join our Data Platform team in Kansas City, MO. In this role, you will be instrumental in designing, coding, implementing, and optimizing a cloud-native data stack that leverages best-in-class open-source tools. The ideal candidate will design, build, and maintain an opinionated, resilient, and scalable data platform in a private cloud environmentenabling data-driven decision-making, analytics, and machine learni

Easy Apply

Full-time

$160000

Cloud Data Engineer V

Remote or Hybrid

•

Today

Job Description: The Cloud Data Engineer V works with business and IT stakeholders to develop modern, scalable data solutions that align with organizational strategy and architectural standards. This role is both autonomous and collaborative, requiring advanced technical expertise and leadership in supporting both existing data environments and new platform development. The engineer also acts as a subject matter expert and technical lead for the Cloud Data Engineering team. Key Responsibilities:

Easy Apply

Full-time

BASED ON EXPERIENCE

Pre-Sales Technical Architect

Remote

•

4d ago

Position: Remote & Full-Time Key Responsibilities: Solution Architecture & Implementation Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure)Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc.Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGapsOptimize pipeline performance, cost-efficiency, and data governance frameworks across diverse enviro

Easy Apply

Full-time

140,000 - 160,000

Applied ML Scientist

Remote

•

22d ago

A globally leading technology company is looking for an Applied ML Scientist to design and evaluate next-generation machine learning and GenAI systems that power real-world applications. In this role, you ll develop advanced LLM-based evaluation frameworks, prototype AI-driven solutions, and collaborate closely with cross-functional teams to bring cutting-edge research into production. If you re passionate about building impactful ML systems and driving innovation at scale, we invite you to appl

Easy Apply

Contract

$100 - $120

AI Specialist - Franctional/Gig Opportunity

Remote

•

16d ago

AI Gig/Fractional Opportunities Premium Projects with Dice.com Work smarter, not harder. Dice.com is building a premier roster of AI professionals engineers, researchers, and data scientists ready to take on flexible, high-value projects with the world s leading tech and enterprise clients. This is your chance to join a curated community of experts trusted by startups and Fortune 500s alike. Each project is designed around your skills and schedule whether it s a one-week sprint, a model evaluati

Easy Apply

Contract

$60 - $200

Senior Full Stack Developer

Remote

•

10d ago

Job Title: Senior Full Stack Developer Fully Remote Contract: 12 Months Responsibilities Design, develop, and deploy high-quality software using React and Python.Apply Prompt Engineering techniques to enhance AI model interactions and performance.Build and optimize large-scale data pipelines using Spark and AIFSD.Leverage AWS services and DevOps practices to ensure reliability, scalability, and security.Advocate for clean code, TDD, CI/CD, and modern architectural approaches (microservices, clou

Easy Apply

Contract

$50 - $60

Cloud Data Engineer

Remote

•

2d ago

Habemco is a shared services company wholly owned and operated by the Habematolel Pomo of Upper Lake, a federally recognized Native American tribe located in Northern California. Habemco s support services such as product development and technology which are needed for business growth, ultimately power the Tribe s economy, and enable the delivery of education, health care and elder support programs for the Tribal community. Our talented team provides cross-functional support services to various

Easy Apply

Full-time

Depends on Experience

Databricks Data Engineer

Remote

•

Today

Databricks Data EngineerOur client is seeking a Databricks Data Engineer to develop/support new/existing data pipelines, and data analytics environments in Azure cloud-based data lake. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise-scale Microsoft Azure-based data analytics platform. You will support continued maintenance of ETL operations and development of new pipelines, ensuring data quality and data management. The ideal c

Easy Apply

Contract

$80 - $85

Senior Data Architect / Cloud Data Engineer (AWS & Snowflake)

Remote

•

Today

W2 Only, C2C is not accepting. Job Title: Senior Data Architect / Cloud Data Engineer (AWS & Snowflake) Location: Onshore preferred; offshore candidates are acceptable if they can work flexible EST hours Reports To: Information Systems Officer/Enterprise Architect Essential Requirement: The candidate should be capable of covering for the client's Information Systems Officer/Enterprise Architect during their absence, taking ownership of architectural reviews, technical decision-making. Role Over

Easy Apply

Contract

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Employer type

Work authorization

Apache Spark jobs in Pennsylvania, USA