Apache Spark Jobs in Bay Area, CA

Refine Results
21 - 40 of 303 Jobs

Staff Software Engineer, Ads Serving Platform

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 19 days ago | Updated 5 hours ago

Senior Data Engineer -Advertising

Discord Inc.

•

San Francisco, California, USA

Full-time

Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. Discord, an inclusive community for all, invites an experienced data engineer to join our Data
Posted 9 days ago | Updated 6 hours ago

Sr Software Engineer

The Walt Disney Company

•

San Francisco, California, USA

Full-time

Disney Entertainment & ESPN Technology On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also redefining Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to improve flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content,
Posted 21 days ago | Updated 6 hours ago

Data Platform Engineer

Motion Recruitment Partners, LLC

•

San Francisco, California, USA

Full-time

Our large crypto company is looking for a contract Data Platform Engineer. This is a remote contract position. Contract Duration: 12-Months Required Skills & Experience 4+ years of relevant work experience. Fluent SQL skills for ETL/ELT, data quality, and reporting. Strong Python or Spark backend development skills. General experience working with Snowflake, Databricks or Trino. Experience with core AWS services and concepts (S3, IAM, ASG, RDS). Leverage your Python, Airflow, and Looker/Sup
Easy Apply
Posted 55 days ago | Updated 5 hours ago

Senior Software Engineer - Database Engine Internals

Databricks Inc

•

San Francisco, California, USA

Full-time

P-97 Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pattern, Lakehouse (), open platforms that unify data warehousing and advanced analytics. The new architecture will help address several major challenges, including data staleness, reliability, total cost of owner
Posted 60+ days ago | Updated 6 hours ago

Staff Software Engineer - Database Engine Internals

Databricks Inc

•

San Francisco, California, USA

Full-time

P-188 Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pattern, Lakehouse (), open platforms that unify data warehousing and advanced analytics. The new architecture will help address several major challenges, including data staleness, reliability, total cost of owne
Posted 60+ days ago | Updated 6 hours ago

Sr. Applied Scientist - Delivery Pricing

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role Have you ever ordered food on Uber and when your order arrived wondered how it got to you so fast? Wondered where it came from and how much it would have cost Uber? If so, the Uber marketplace team is for you. We build systems to look into the future and estimate the distribution of millions of orders worldwide and manage the demand on Uber Delivery marketplace. We build solutions that decide which restaurant is available at what distance at the right price. The tools we create
Posted 60+ days ago | Updated 6 hours ago

Sr. Data Scientist

Abbott Laboratories

•

Alameda, California, USA

Full-time

Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 114,000 colleagues serve people in more than 160 countries. WORKING AT ABBOTT At Abbott, you can do work that matters, grow, and learn, care for yourself and family, be your true self and live a full life. Yo
Posted 3 days ago | Updated 3 hours ago

Senior Staff Machine Learning Engineer - Marketplace Matching & Driver Pricing

Uber Corporate

•

San Francisco, California, USA

Full-time

About the role: This is a key role as a thought leader and key contributor to Machine Learning efforts across several key domains in Marketplace - Job-Driver Matching system, Driver offer pricing, and Driver Surge pricing. The ML models in these domains vary from causal ML models, reinforcement learning models, and forecast models. Some of the challenges in these domains is dealing with data sparsity and delay in realizing the impact of actions given the physical nature of Uber business, network
Posted 60+ days ago | Updated 6 hours ago

Senior Applied Scientist - Marketplace Pricing/Incentives

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role Have you ever ordered food on Uber and when your order arrived wondered how it got to you so fast? Wondered where it came from and how much it would have cost Uber? If so, the Uber marketplace team is for you. We build systems to look into the future and estimate the distribution of millions of orders worldwide and manage the demand on Uber Delivery marketplace. We build solutions that decide which restaurant is available at what distance at the right price. The tools we create
Posted 60+ days ago | Updated 6 hours ago

Azure Data Architect

Intraedge

•

Remote

Contract, Third Party

Job Title: : Azure Data Architect Location: REMOTE Duration: Long Term Contract Responsibilities: Engineer Azure-based solutions with a focus on cost-efficiency, performance, and operational effectiveness. Craft and enforce a framework to quantify data quality across various customer and prospect sources, ensuring data accuracy, completeness, consistency, and timeliness. Scrutinize first-party customer data sources to establish the most reliable ones and formulate ingestion strategies for both
Easy Apply
Posted 5 days ago | Updated moments ago

Staff Machine Learning Engineer, Applied ML Accelerator

Stripe

•

San Francisco, California, USA

Full-time

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important
Posted 60+ days ago | Updated 6 hours ago

Scala Developer (Remote)

eTek IT Services, Inc.

•

Remote

Contract

Scala Developer Remote role 12+ months contract 1. 8-10+ years of experience with hands on development with Scala and Spark. This role is 100% hands on development. Scala is the top programming requirement for this role. Need someone strong in Scala. Bulk of the work is with Apache Spark/Scala programming language. This person will be writing Scala code that will run on Apache Spark. Looking for true software development not data engineering. 2. This person must have strong knowledge of Databa
Easy Apply
Posted 4 days ago | Updated 4 days ago

Sr. Data Analyst - (Databricks)

IntelliSavvy

•

Remote

Full-time, Part-time, Contract, Third Party

Note: Work visa sponsorship is not supported for this position Key Responsibilities 6-10 years of experience with 2+ using Databricks Conduct data discovery, document data sources, and definitions to ensure data accuracy and consistency. Analyze data using SQL queries and other analytical tools and use visual tools like Tableau or Power BI. Collaborate with data engineers, product management and support business stakeholders as needed. Document user stories, requirements, and acceptance criteria
Easy Apply
Posted 5 days ago | Updated moments ago

Machine Learning Engineer, Fraud Discovery

Stripe

•

San Francisco, California, USA

Full-time

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important
Posted 60+ days ago | Updated 6 hours ago

Sr Applied Scientist, Delivery Experience

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Team The Delivery Experience team works to improve Uber's delivery experience under the Grocery and Retail segments. The team is working on various impactful initiatives, such as improving shopper efficiency, building the capability of accurately predicting inventory and the overall selection and replacement of items, and optimizing the delivery core experience from both the shopper and consumer side. About the Role We are looking for applied scientists with a passion for solving new a
Posted 60+ days ago | Updated 6 hours ago

Analytics Data Engineer, Applied Engineering

OpenAI

•

San Francisco, California, USA

Full-time

About the team The Applied team works across research, engineering, product, and design to bring OpenAI's technology to consumers and businesses. We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth. About the role: We're seeking a Data Engineer to take the lead in building our data pipelines and core tables for OpenAI. These pipelines are crucial for po
Posted 60+ days ago | Updated 5 days ago

Data Engineer II Machine Learning

SOHO Square Solutions

•

Remote

Third Party

Job description: Manage data engineering projects through the full cycle. Create, maintain, improve, automate, test and deploy efficient data pipelines and systems that process large amounts of data used for ML models using industry best practices. Thorough testing, instrumentation and monitoring of data pipelines. Proactively testing existing systems and proposing improvements and bug fixes. Building dashboards. Regularly sharing progress with the team and occasionally presenting findings. Ab
Easy Apply
Posted 3 days ago | Updated 2 hours ago

Remote Opportunity || Data Analytics with Python || Full time

IT First Source

•

Remote

Full-time

Remote Opportunity || Data Analytics with Python || Full time Qualifications Expertise in using SQL with some experience in Python/R or Data AnalysisExperience in manipulating data and drawing insights from large data setsExperience in designing and implementing ETL process (defining, gathering, transforming) dataHands-on Development experience in Big Data technology stack Panda, NumPy, Hive, Impala, Spark, CDSWExperience in Git/ BitBucketExperience in Orchestration tools like Control M and AirF
Easy Apply
Posted 7 days ago | Updated 4 hours ago

Sr Applied Scientist - Maps

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Team The Uber Maps team is at the forefront of advancing Uber's geospatial technologies, crucial for driving the efficiency and reliability of Uber services. We work across a diverse array of problem domains, including: curating and improving precision of location (i.e. 'Places') data, developing cutting-edge location search algorithms for each Rides pickup/dropoff and Eats delivery, building base maps and correcting map errors, as well as optimizing routes and travel time predictions,
Posted 60+ days ago | Updated 6 hours ago