Apache Spark jobs in Berkeley, CA

Databricks Azure Consultant with Apache Spark- Onsite NJ- and - no corps

Remote or Jersey City, New Jersey

•

Today

Please contact Renu Goel Location: NJ - No corps Must Haves: -Azure -Databricks -Apache Spark -CI/CD Databricks / Azure Consultant Job Summary Seeking two experienced Databricks / Azure Consultants to support the design, implementation, and ongoing development of the Databricks data platform. The consultants will work with technology and data teams to build and enhance scalable data solutions using Databricks and Microsoft Azure, with a strong focus on data engineering, integration, securit

Easy Apply

Full-time

Competitive

Senior AI Engineer, Databricks, ML, Spark ML

Remote

•

Today

We are looking for a Senior AI Engineer to build, test, and deploy ML and GenAI components for asset onboarding, industrial diagnostics, and device analytics on Databricks. This specialist will create predictive models, anomaly-detection algorithms, RAG pipelines, document extraction, and AI agent capabilities. Responsibilities Construct, test, and deploy ML and GenAI components on Databricks Create predictive models for asset onboarding and device analytics Architect and implement anomaly-detec

Full-time

Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes

Remote

•

Today

We are looking for a Lead Data Software Engineer to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises. Responsibilities Implement streaming and batch Spark pipelines running on Kubernetes Lead the implementation of objects within the data generator framework Oversee deployment and testing across local and development environments Drive impr

Full-time

Lead AI Engineer with Spark, AWS Services

Remote

•

Today

We're looking for a Lead AI Engineer skilled in Spark and AWS Services to become part of the RBQM Production Pod within the program. In this position, you'll construct and sustain data pipelines that drive AI/GenAI applications supporting Risk-Based Quality Management for clinical trials. The primary focus of this role includes RAG document ingestion, vector indexing, and developing data APIs for AI applications. Responsibilities Architect and construct RAG document ingestion pipelines (chunking

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Software Engineer/ AI Agents, Azure, Spark

Remote

•

Today

We are looking for an experienced Senior Data Software Engineer with strong hands-on expertise in Azure and the Spark ecosystem , primarily focused on building and maintaining data transformation pipelines. The candidate should be comfortable with any Spark-adjacent technology (PySpark, Spark SQL, Scala Spark, Databricks, Synapse, etc.) rather than being locked into one specific flavor. Experience with Microsoft Fabric is a strong plus but not a requirement. The ideal candidate combines great te

Full-time

Senior AI Engineer with Spark, AWS Services

Remote

•

Today

We are seeking a Senior AI Engineer with Spark and AWS Services expertise to join the RBQM Production Pod within the program. You will build and maintain data pipelines that power AI/GenAI applications for Risk-Based Quality Management in clinical trials. This role focuses on RAG document ingestion, vector indexing, and building data APIs for AI applications. Responsibilities Design and build RAG document ingestion pipelines (chunking, embedding, vector indexing) for clinical trial quality data

Full-time

Remote Data Engineer (Snowflake, Spark/Scala)

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Data Engineer (Snowflake and Spark/Scala) for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Skills Needed: Snowflake Spark/Scala Responsibilities : Development, programming, coding of Information Technology solutions. Documenting detailed system specifications, participation in unit testing and maintenance of planned and unplanned internally dev

Contract

USD 50.00 - 55.00 per hour

Remote Sr. IT Developer with Hadoop & Spark

Remote or Jacksonville, Florida

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. IT Developer with Hadoop & Spark for a contract assignment with one of our premier Healthcare Services clients in Jacksonville, FL . This role will be remote. Top Experience Needed: -HBASE/Scala/Spark development required (all three) -Experience using Hadoop Distributed File System (HDFS) required -Development experience with Kafka required -Data warehousing experience required Responsibilities : Responsible for the design, d

Contract

USD 62.86 - 67.86 per hour

Databricks Architect / Resident Solution Architect

Remote or Hybrid in San Francisco, California

•

23d ago

Job Title: Databricks Architect / Resident Solution Architect Openings: 2 Location: San Francisco, CA Local preferred; Remote considered Work Hours: Must be able to work PST hours Duration: 812 Months Visa: Any Rate: flexible Industry: Banking / Financial Services Experience: 1215+ Years Job DescriptionWe are looking for a highly experienced Databricks Architect / Resident Solution Architect with strong hands-on Data Engineering and Databricks architecture experience. The ideal candidate should

Easy Apply

Contract

Depends on Experience

Data Lead Engineer

Fremont, California

•

6d ago

Job Title: Data Engineer (Lead/Sr.) Location: Fremont, CA (Onsite) Core Skills: Databricks, Apache Spark, PySpark, SQL, Spark SQL, ETL, ELT, API Integration, Data Warehousing, Schema Design, Dimensional Modeling, Medallion Architecture. Lead Data Engineer with strong expertise in Databricks, Apache Spark, PySpark, SQL, and ETL/ELT development. The ideal candidate will lead the design and development of scalable data pipelines, work with structured and unstructured data, and implement robust dat

Easy Apply

Contract

Depends on Experience

Machine Learning Engineer II

Remote or San Francisco, California

•

Today

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we're on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other's unique experiences and embrace the flexibility

Full-time

USD 215,250.00 - 285,982.00 per year

Senior Software Engineer, Apple Services Engineering

San Francisco, California

•

Today

We're building the next generation of Apple's cloud services observability infrastructure. Join us to design and build the applications and services that give us deep insight into the operational health and efficiency of CloudKit, Apple's foundational privacy-focused database platform, and many other iCloud services. Description We're looking for engineers with a strong track record of building fault-tolerant, distributed systems, and the judgment to operate confidently in a complex, high-scal

Full-time

Research Engineer, Data Infrastructure (Language Modeling)

San Francisco, California

•

Today

About Cartesia Our mission is to architect AI that learns from and interacts with the world like humans do. We're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models. Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship

Full-time

USD 200,000.00 - 350,000.00 per year

Data Engineer III

Menlo Park, California

•

2d ago

Title: Data Engineer Duration: 6-month contract with possible extension Location: Menlo Park, CA - Onsite Pay rate: $95-$97.90/hr. on W2 We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and analytics-ready datasets that support business operations and decision-making. This role requires expertise in large-scale data processing, ETL/ELT development, data warehousing, and workflow orchestration. Key ResponsibilitiesDesign, develop, and maintain

Easy Apply

Contract

$0.01 - $0.01

Sr. Machine Learning Engineer

Remote or San Francisco, California

•

Today

Full-time

USD 277,000.00 - 332,012.00 per year

Watsonx.data Consultant with Spark and scala experience

Remote

•

28d ago

Hi, Watsonx.data Consultant with Spark and scala experience Remote 6 months Required Skills: databricks or watsonx.data Spark Scala Sincerely, Sr. Manager nFolks Data Solutions LLC Phone: Email:

Easy Apply

Third Party, Contract

Depends on Experience

Staff Software Engineer, Machine Learning (Consumer Revenue)

Remote or San Francisco, California

•

Today

Discord has a highly engaged community of millions of daily active users who use the platform for many different reasons, but there's one thing that nearly everyone does: play video games. Discord plays a uniquely important role in the future of gaming, and we are focused on making it easier and more fun for people to hang out before, during, and after playing games. We're looking to hire a Staff Machine Learning Engineer on our Consumer Revenue ML team. This team applies Machine Learning acros

Full-time

USD 272,000.00 - 340,000.00 per year

Senior Full Stack Engineer

San Francisco, California

•

Today

Senior Software Engineer Dealpath is the AI-powered operating system for institutional real estate investing - purpose-built to help the world's leading firms capture more opportunities, make faster decisions, and execute with precision. As a Senior Software Engineer here, you'll ship features that go directly into the workflows of firms managing trillions in real assets, using AI coding tools as a core part of how you build every day. We're looking for engineers who take ownership end-to-end, t

Full-time

USD 161,000.00 - 210,000.00 per year

Senior/Staff Machine Learning Engineer - Content Discovery

San Francisco, California

•

Today

About Suno We're building the world's first creative entertainment platform, where the entire world can feel the joy and fulfillment of making music. Music is for everyone: Our users include everyone from grandmothers creating songs for their loved ones, to Grammy winners using Suno Studio, our power tool, to make the most popular hits in the world. Building the future of entertainment requires ambition. The pace is fast, the problems are hard, and the work demands ownership and intensity. For

Full-time

USD 241,200.00 - 382,935.00 per year

Apache Spark jobs in Berkeley, CA, USA