Apache Spark Jobs in San Francisco, CA

Refine Results
1 - 20 of 341 Jobs

Software Engineer-Spark

Veear

•

Remote

Contract

Title: Software Engineer (Spark) Duration: 03+ months contract (possible extension) Location: Cupertino, CA(Remote) Job Summary: Strong understanding of distributed systems and cloud computing principles.Demonstrated experience with Apache Spark.Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud.Extensive experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and networking (VPC, N
Easy Apply
Posted 6 days ago | Updated 12 hours ago

Databricks Developer ( Spark , PySpark ) | Remote

Bramkas Inc.

•

Remote

Contract

Title: Databricks Developer Experience: 7 + yrs exp Position Type : Contract Location : Remote Must Have Skill : Spark , Pyspark ,Python ,Data BricksWe are seeking a skilled Databricks Developer to join our team . As a Databricks Developer, you will be responsible for designing, building, and maintaining data pipelines and analytics solutions using the Databricks platform. You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement solutions
Easy Apply
Posted 8 days ago | Updated 7 days ago

Data Architect ( Spark, PySpark, and Python) | Full Time Position | Remote

Bramkas Inc.

•

Remote

Full-time

Data Architect Location: RemoteEmployment Type: Full-time PositionExperience: 9+ yrs expMust have : Data Architect , Spark , Pyspark , PythonWe are currently seeking a skilled and experienced Data Architect to join our team. The ideal candidate will have a strong background in data architecture, along with expertise in Spark, PySpark, and Python. As a Data Architect, you will play a critical role in designing and implementing data solutions to support our organization's objectives. Responsibili
Easy Apply
Posted 15 days ago | Updated 7 days ago

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

•

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa
Easy Apply
Posted 5 days ago | Updated moments ago

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

•

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data
Easy Apply
Posted 60+ days ago | Updated 1 day ago

Spark Scala Developer

Infosys Technologies Ltd

•

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i
Easy Apply
Posted 8 days ago

Mulesoft Lead

DynPro Inc.

•

On-site in San Francisco, California, USA

Contract, Third Party

Mulesoft Lead Consultant Long Term SFO, CA Start: ASAP 4+ years of demonstrated expertise implementing creative enterprise application integration solutions and meeting requirements2+ years of experience with MulesoftProgramming experience with Python is highly prefferedExperience deploying APIs using SOAP and RESTExperience working with business and application partners and product managers to gather data integration requirements and to translate into good technical data designsExperience deve
Easy Apply
Posted 35 days ago | Updated 6 days ago

Sr. Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

•

On-site in San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated moments ago

Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

•

On-site in San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated moments ago

Manager II, Engineering - Big Data Query Platform

Pinterest, Inc.

•

Hybrid in San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated moments ago

Data Infrastructure Engineer

OpenAI

•

On-site in San Francisco, California, USA

Full-time

About the Team You'll join the team that's behind OpenAI's data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The systems we support include our data warehouse, batch compute infrastructure, streaming infrastructure, data orchestration system, data lake, vector databases, critical integrations, and more. About the Role The Applied Data Platform team designs, builds, and operates the foundational data infrastructure that ena
Posted 48 days ago | Updated moments ago

Data Engineer II

Strava, Inc.

•

On-site in San Francisco, California, USA

Full-time

About this role Strava is the leading digital community for active people with more than 120 million athletes, in more than 190 countries. The platform offers a holistic view of your active lifestyle, no matter where you live, which sport you love and/or what device you use. Everyone belongs on Strava when they are pursuing an active life. We are seeking data engineers to join our Data Platform team. Our vision is that key decisions and product at Strava can be greatly enriched with data to ben
Posted 5 days ago | Updated moments ago

Senior Staff Software Engineer - IAM

Databricks Inc

•

On-site in San Francisco, California, USA

Full-time

P-1126 Summary At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high-value challenges that are central to their missions. Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, CA to a global organization wi
Posted 7 days ago | Updated moments ago

Senior Staff Software Engineer - Cryptography

Databricks Inc

•

On-site in San Francisco, California, USA

Full-time

P-1124 Summary At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high-value challenges that are central to their missions. Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, CA to a global organization wi
Posted 7 days ago | Updated moments ago

Senior Staff Software Engineer - Privacy

Databricks Inc

•

On-site in San Francisco, California, USA

Full-time

P-1125 Summary At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high-value challenges that are central to their missions. Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, CA to a global organization wi
Posted 7 days ago | Updated moments ago

Software Engineer, Analytics Platform

OpenAI

•

On-site in San Francisco, California, USA

Full-time

About the Team The Research Platform Analytics team designs, builds, and operates the critical foundational data and analytics infrastructure that enables research at OpenAI. Our goal is one, and one only: accelerate the progress of research towards AGI. We do this by owning critical components of the research training stack, starting from key data processing pipelines and complex libraries that directly feed into our distributed training, followed by a variety of observability and analytics s
Posted 6 days ago | Updated moments ago

Staff Machine Learning Engineer

Tubi

•

On-site in San Francisco, California, USA

Full-time

Join Tubi ( ), Fox Corporation's premium ad-supported video-on-demand (AVOD) streaming service leading the charge in making entertainment accessible to all. With over 200,000 movies and television shows, including a growing library of Tubi Originals, 200+ local and live news and sports channels, and 455 entertainment partners featuring content from every major Hollywood studio, Tubi gives entertainment fans an easy way to discover new content that is available completely free. Tubi's library ha
Posted 60+ days ago | Updated moments ago

Staff Software Engineer, Ads Serving Platform

Pinterest, Inc.

•

Hybrid in San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated moments ago

Sr. Product Manager, PySpark

Databricks Inc

•

On-site in San Francisco, California, USA

Full-time

You will be the Product Manager for PySpark. PySpark is the Python API for , the world's most popular data and ML framework! The PySpark team works at the intersection of Open Source Spark and the Databricks Runtime. As the Product Manager of PySpark, you will develop a deep understanding of PySpark and gather requirements from customers. You will launch features and will engage with the Spark community and our Developer Relations team. You will impact how Open Source Spark users and Databricks
Posted 42 days ago | Updated moments ago

Sr Software Engineer

Disney Entertainment & ESPN Technology

•

On-site in San Francisco, California, USA

Full-time

Disney Entertainment & ESPN Technology On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also redefining Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to improve flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content,
Posted 2 days ago | Updated 1 hour ago