Apache spark jobs in cupertino, ca

Databricks Azure Consultant with Apache Spark- Onsite NJ- and - no corps

Remote or Jersey City, New Jersey

•

Today

Please contact Renu Goel Location: NJ - No corps Must Haves: -Azure -Databricks -Apache Spark -CI/CD Databricks / Azure Consultant Job Summary Seeking two experienced Databricks / Azure Consultants to support the design, implementation, and ongoing development of the Databricks data platform. The consultants will work with technology and data teams to build and enhance scalable data solutions using Databricks and Microsoft Azure, with a strong focus on data engineering, integration, securit

Easy Apply

Full-time

Competitive

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Lead AI Engineer with Spark, AWS Services

Remote

•

Today

We're looking for a Lead AI Engineer skilled in Spark and AWS Services to become part of the RBQM Production Pod within the program. In this position, you'll construct and sustain data pipelines that drive AI/GenAI applications supporting Risk-Based Quality Management for clinical trials. The primary focus of this role includes RAG document ingestion, vector indexing, and developing data APIs for AI applications. Responsibilities Architect and construct RAG document ingestion pipelines (chunking

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Software Engineer/ AI Agents, Azure, Spark

Remote

•

Today

We are looking for an experienced Senior Data Software Engineer with strong hands-on expertise in Azure and the Spark ecosystem , primarily focused on building and maintaining data transformation pipelines. The candidate should be comfortable with any Spark-adjacent technology (PySpark, Spark SQL, Scala Spark, Databricks, Synapse, etc.) rather than being locked into one specific flavor. Experience with Microsoft Fabric is a strong plus but not a requirement. The ideal candidate combines great te

Full-time

Senior AI Engineer with Spark, AWS Services

Remote

•

Today

We are seeking a Senior AI Engineer with Spark and AWS Services expertise to join the RBQM Production Pod within the program. You will build and maintain data pipelines that power AI/GenAI applications for Risk-Based Quality Management in clinical trials. This role focuses on RAG document ingestion, vector indexing, and building data APIs for AI applications. Responsibilities Design and build RAG document ingestion pipelines (chunking, embedding, vector indexing) for clinical trial quality data

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Data Lead Engineer

Fremont, California

•

7d ago

Job Title: Data Engineer (Lead/Sr.) Location: Fremont, CA (Onsite) Core Skills: Databricks, Apache Spark, PySpark, SQL, Spark SQL, ETL, ELT, API Integration, Data Warehousing, Schema Design, Dimensional Modeling, Medallion Architecture. Lead Data Engineer with strong expertise in Databricks, Apache Spark, PySpark, SQL, and ETL/ELT development. The ideal candidate will lead the design and development of scalable data pipelines, work with structured and unstructured data, and implement robust dat

Easy Apply

Contract

Depends on Experience

Data Engineer III

Menlo Park, California

•

3d ago

Title: Data Engineer Duration: 6-month contract with possible extension Location: Menlo Park, CA - Onsite Pay rate: $95-$97.90/hr. on W2 We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and analytics-ready datasets that support business operations and decision-making. This role requires expertise in large-scale data processing, ETL/ELT development, data warehousing, and workflow orchestration. Key ResponsibilitiesDesign, develop, and maintain

Easy Apply

Contract

$0.01 - $0.01

Senior Software Engineer, Apple Data Platform

Cupertino, California

•

Today

We are seeking extraordinary software engineers to work on Apache DataFusion Comet, the open-source accelerator for Apache Spark that Apple created and donated to the Apache Software Foundation. You are passionate about pushing distributed query engines to their limits and getting every ounce of performance out of them, while matching Spark's results exactly. We are looking for engineers with in-depth knowledge of Spark internals and of related technologies such as Apache Iceberg, Parquet, Arrow

Full-time

Data Engineer: Data Ops

Hybrid in Cupertino, California

•

7d ago

Mindsource is seeking a Data Engineerforone of our Direct Clients based in Silicon Valley. If interested, please drop your resume to Title: Data Engineer Hybrid in Cupertino, CA Long Term Contract Job Summary We are seeking a Data Engineer with a strong DataOps background to build, maintain, and support large-scale data pipelines powering Sales and Finance analytics. The ideal candidate will have expertise in SQL, Python, Airflow, Spark, and modern data platforms, along with hands-on experience

Easy Apply

Contract, Third Party

$80 - $90

Software Engineer – DevOps (Java Developer)

Hybrid in Cupertino, California

•

Today

Software Engineer- DevOpsLocation: Cupertino, CA (Onsite)Key Skills: JAVA, Python, Microservices, Springboot, Kubernetes, AWSWhat You Will Do:Design, develop, and maintain highly scalable backend services and microservices.Build robust APIs and distributed systems capable of supporting large-scale workloads.Develop, deploy, and optimize cloud-native applications utilizing AWS services.Implement and support CI/CD pipelines to enable rapid and reliable software releases.Collaborate with product ma

Easy Apply

Contract

50 - 55

Data Platform Lead

Santa Clara, California

•

3d ago

Databricks | Data Engineering and Analysis | Cloud Security | Governance | Encryption | Multi-Tenant Platforms Required Qualifications Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or a related field, or equivalent practical experience. Strong experience leading the design and implementation of enterprise cloud data platforms, with substantial hands-on Databricks experience. Strong working knowledge of Apache Spark, Delta Lake, Databricks Workflows, Unity

Easy Apply

Contract, Third Party

$70 - $100

Software Engineering Manager - Analytics Platform

Cupertino, California

•

Today

Great insights require a robust platform that enables easy and fast access to and analysis of large amounts of data. The Core Telemetry Platform team is responsible for providing state-of-the-art platforms and tools to support the complete lifecycle of data, from creation to analytics and insight discovery. A key component of this is our Analytics Platform team, which focuses on developing client-facing analytics tools & technologies. This team is seeking a visionary leader to spearhead the adva

Full-time

Senior Product Designer, Core Experience

Menlo Park, California

•

2d ago

Join us in building the future of finance. Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations in the next two decades. The largest transfer of wealth in human history. If you're ready to be at the epicenter of this historic cultural and financial shift, keep reading. About the team + role We are building an elite team, applying frontier technologies to the world's biggest financial problems. We're looking for bold thinker

Full-time

USD 166,000.00 - 195,000.00 per year

IP Litigation Mid-Level Associate

Palo Alto, California

•

Today

Urgently hiring IP Litigation Mid-Level Associate! This Jobot Job is hosted by: Kendall Kaing Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $260,000 - $310,000 per year A bit about us: My client is dedicated to delivering novel solutions to legal challenges, enabling clients to achieve their business goals. We are known for our innovative and creative approach in guiding clients through their most complex transactions, litigation/controve

Full-time

USD 260,000.00 - 310,000.00 per year

Senior Applications Engineer, Corporate Infrastructure

Menlo Park, California

•

18d ago

Full-time

USD 161,500.00 - 190,000.00 per year

Senior Applications Engineer, Corporate Infrastructure

Menlo Park, California

•

Today

Full-time

USD 161,500.00 - 190,000.00 per year

Apache spark jobs in Cupertino, CA, USA