spark Jobs in San Francisco, CA

Refine Results
1 - 20 of 359 Jobs

Spark Developer

Nityo Infotech Corporation

•

San Francisco, California, USA

Contract, Third Party

JD: Advanced level of Java/Scala/Python development experience.Intermediate level of SQL and NoSQL experience (handling structured and unstructured data).Extensive experience with Spark Processing engine.Experience with Big data tools/technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka)Experience analyzing data to discover opportunities and address gaps.Experience working with cloud or on-prem Big Data platforms (i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data W
Easy Apply
Posted 6 hours ago

Software Engineer-Spark

Veear

•

Remote

Contract

Title: Software Engineer (Spark) Duration: 03+ months contract (possible extension) Location: Cupertino, CA(Remote) Job Summary: Strong understanding of distributed systems and cloud computing principles.Demonstrated experience with Apache Spark.Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud.Extensive experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and networking (VPC, N
Easy Apply
Posted 7 days ago | Updated 2 hours ago

Databricks Developer ( Spark , PySpark ) | Remote

Bramkas Inc.

•

Remote

Contract

Title: Databricks Developer Experience: 7 + yrs exp Position Type : Contract Location : Remote Must Have Skill : Spark , Pyspark ,Python ,Data BricksWe are seeking a skilled Databricks Developer to join our team . As a Databricks Developer, you will be responsible for designing, building, and maintaining data pipelines and analytics solutions using the Databricks platform. You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement solutions
Easy Apply
Posted 9 days ago | Updated 8 days ago

Data Architect ( Spark, PySpark, and Python) | Full Time Position | Remote

Bramkas Inc.

•

Remote

Full-time

Data Architect Location: RemoteEmployment Type: Full-time PositionExperience: 9+ yrs expMust have : Data Architect , Spark , Pyspark , PythonWe are currently seeking a skilled and experienced Data Architect to join our team. The ideal candidate will have a strong background in data architecture, along with expertise in Spark, PySpark, and Python. As a Data Architect, you will play a critical role in designing and implementing data solutions to support our organization's objectives. Responsibili
Easy Apply
Posted 16 days ago | Updated 8 days ago

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

•

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa
Easy Apply
Posted 6 days ago | Updated moments ago

Senior Spark Data Engineer

Randstad Digital

•

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe
Posted 5 hours ago | Updated 2 hours ago

Software Engineer (Spark)

Bayside Solutions

•

Remote or

Contract

Software Engineer (Spark) W2 Contract Salary Range: $145,600 - $166,400 per year Location: Seattle, WA - Remote Role Requirements and Qualifications: Strong understanding of distributed systems and cloud computing principles Demonstrated experience with Apache Spark Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud Experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and net
Easy Apply
Posted 7 days ago | Updated 2 hours ago

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

•

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data
Easy Apply
Posted 60+ days ago | Updated 2 days ago

Spark Scala Developer

Infosys Technologies Ltd

•

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i
Easy Apply
Posted 9 days ago

Mulesoft Lead

DynPro Inc.

•

San Francisco, California, USA

Contract, Third Party

Mulesoft Lead Consultant Long Term SFO, CA Start: ASAP 4+ years of demonstrated expertise implementing creative enterprise application integration solutions and meeting requirements2+ years of experience with MulesoftProgramming experience with Python is highly prefferedExperience deploying APIs using SOAP and RESTExperience working with business and application partners and product managers to gather data integration requirements and to translate into good technical data designsExperience deve
Easy Apply
Posted 36 days ago | Updated 7 days ago

Sr. Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated 2 hours ago

Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated 2 hours ago

Manager II, Engineering - Big Data Query Platform

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated 2 hours ago

Data Infrastructure Engineer

OpenAI

•

San Francisco, California, USA

Full-time

About the Team You'll join the team that's behind OpenAI's data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The systems we support include our data warehouse, batch compute infrastructure, streaming infrastructure, data orchestration system, data lake, vector databases, critical integrations, and more. About the Role The Applied Data Platform team designs, builds, and operates the foundational data infrastructure that ena
Posted 49 days ago | Updated 2 hours ago

Data Engineer II

Strava, Inc.

•

San Francisco, California, USA

Full-time

About this role Strava is the leading digital community for active people with more than 120 million athletes, in more than 190 countries. The platform offers a holistic view of your active lifestyle, no matter where you live, which sport you love and/or what device you use. Everyone belongs on Strava when they are pursuing an active life. We are seeking data engineers to join our Data Platform team. Our vision is that key decisions and product at Strava can be greatly enriched with data to ben
Posted 5 days ago | Updated 2 hours ago

Software Engineer, Analytics Platform

OpenAI

•

San Francisco, California, USA

Full-time

About the Team The Research Platform Analytics team designs, builds, and operates the critical foundational data and analytics infrastructure that enables research at OpenAI. Our goal is one, and one only: accelerate the progress of research towards AGI. We do this by owning critical components of the research training stack, starting from key data processing pipelines and complex libraries that directly feed into our distributed training, followed by a variety of observability and analytics s
Posted 7 days ago | Updated 2 hours ago

Staff Software Engineer, Ads Serving Platform

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated 2 hours ago

Staff Machine Learning Engineer

Tubi

•

San Francisco, California, USA

Full-time

Join Tubi ( ), Fox Corporation's premium ad-supported video-on-demand (AVOD) streaming service leading the charge in making entertainment accessible to all. With over 200,000 movies and television shows, including a growing library of Tubi Originals, 200+ local and live news and sports channels, and 455 entertainment partners featuring content from every major Hollywood studio, Tubi gives entertainment fans an easy way to discover new content that is available completely free. Tubi's library ha
Posted 60+ days ago | Updated 2 hours ago

Sr Software Engineer

Disney Entertainment & ESPN Technology

•

San Francisco, California, USA

Full-time

Disney Entertainment & ESPN Technology On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also redefining Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to improve flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content,
Posted 2 days ago | Updated 15 hours ago

Sr Software Engineer

The Walt Disney Company

•

San Francisco, California, USA

Full-time

Disney Entertainment & ESPN Technology On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also redefining Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to improve flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content,
Posted 9 days ago | Updated 2 hours ago