apache spark Jobs in bay area, ca

Refine Results
21 - 40 of 287 Jobs

Sr. Applied Scientist - Delivery Pricing

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role Have you ever ordered food on Uber and when your order arrived wondered how it got to you so fast? Wondered where it came from and how much it would have cost Uber? If so, the Uber marketplace team is for you. We build systems to look into the future and estimate the distribution of millions of orders worldwide and manage the demand on Uber Delivery marketplace. We build solutions that decide which restaurant is available at what distance at the right price. The tools we create
Posted 60+ days ago | Updated moments ago

Scala Developer :: 100% Remote :: W2 Only

Aorton Inc

•

Remote

Contract

Role : Scala Developer Location: 100% Remote Job Description: Requirements - 4+ years' Scala programming experience - Apache Spark/Spark SQL - Terraform - Data lakes knowledge/experience - Strong communicator; can communicate requirements between cross-functional teams - Troubleshooting experience Plusses: - Apache Kafka - Akka Streams data library experience - Core Java development background - SQL database experience - Python - Lambda Day to Day/Project: - Deepthi's team is responsible for p
Easy Apply
Posted 5 days ago | Updated 5 days ago

Senior Data Engineer -Advertising

Discord Inc.

•

San Francisco, California, USA

Full-time

Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. Discord, an inclusive community for all, invites an experienced data engineer to join our Data
Posted 31 days ago | Updated moments ago

Senior Data Scientist, ML and Algorithms (Remote)

AllTrails

•

Remote or San Francisco, California, USA

Full-time

About AllTrails AllTrails is the most trusted and used outdoors platform in the world. We help people explore the outdoors with hand-curated trail maps along with photos, reviews, and user recordings crowdsourced from our community of millions of registered hikers, mountain bikers, and trail runners in 150 countries. AllTrails is frequently ranked as a top-5 Health and Fitness app and has been downloaded by over 50 million people worldwide. AllTrails was selected as Apple's App of the Year in 2
Posted 9 days ago | Updated 4 hours ago

Scala Developer - Only on W2

Reliable Software Resources

•

Remote

Contract

Job Title: Scala Developer Location: 100% Remote Duration: 12+ Months Top Skills' Details 8-10+ years of experience with hands on development with Scala and Spark. This role is 100% hands on development. Scala is the top programming requirement for this role. Need someone strong in Scala. Bulk of the work is with Apache Spark/Scala programming language. This person will be writing Scala code that will run on Apache Spark 2. This person must have strong knowledge of Database/SQL fundamental conce
Easy Apply
Posted 7 days ago | Updated 5 days ago

Senior Staff Machine Learning Engineer - Marketplace Matching & Driver Pricing

Uber Corporate

•

San Francisco, California, USA

Full-time

About the role: This is a key role as a thought leader and key contributor to Machine Learning efforts across several key domains in Marketplace - Job-Driver Matching system, Driver offer pricing, and Driver Surge pricing. The ML models in these domains vary from causal ML models, reinforcement learning models, and forecast models. Some of the challenges in these domains is dealing with data sparsity and delay in realizing the impact of actions given the physical nature of Uber business, network
Posted 60+ days ago | Updated moments ago

Senior Applied Scientist - Marketplace Pricing/Incentives

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role Have you ever ordered food on Uber and when your order arrived wondered how it got to you so fast? Wondered where it came from and how much it would have cost Uber? If so, the Uber marketplace team is for you. We build systems to look into the future and estimate the distribution of millions of orders worldwide and manage the demand on Uber Delivery marketplace. We build solutions that decide which restaurant is available at what distance at the right price. The tools we create
Posted 60+ days ago | Updated moments ago

Sr. AWS Data Engineer | 3+ months Contract @Remote | W2 Only

iPivot, LLC

•

Remote

Contract

Role: Data Engineer Location: Parsippany, NJ (Complete Remote) Job Details: Senior AWS Data Engineer (Python, Spark, DBT, FHIR required)A total of 10+ Years of experience is required.Healthcare(Claims) domain knowledge is preferred.Architect, Design, Develop and Deploy scalable, high-availability systems on AWS, leveraging serverless technologies and a variety of AWS services like Lambda, API Gateway, S3, DynamoDB, Cloud Formation, Event Bridge, Step Functions, and AWS Glue, Athena, Redshift.Big
Easy Apply
Posted 3 days ago

AWS Architect

Rivi Consulting Group

•

Remote

Contract

Title: AWS Architect Location: 100% remote Required Skills: 8-10+ years of experience with hands-on development with Scala and Spark. This role will require hands-on development with Scala and Spark. Scala is the top programming requirement for this role. Bulk of the work this AWS architect will support is with Apache Spark/Scala programming language.Strong knowledge of AWS architectureStrong engineer that writes code, knows framework and can review the architecture and help when they get stuck
Easy Apply
Posted 12 days ago | Updated 4 days ago

Senior Data Engineer

Refulgent Technologies Inc.

•

Remote

Contract

Senior Data Engineer REMOTE Lead end to end design and development of the data solutions.Provide guidance, mentorship, and technical expertise to the team members on the spark compute-based data engineering projects.Develop data pipelines to ingest and transform data using Scala and SQL on Spark.Setup orchestration of the pipelines using Azure Synapse pipeline.Source and version control code/configuration artifacts using GitHub.Create GitHub actions to deploy code/configuration artifacts.Create
Easy Apply
Posted 3 days ago

Big Data Lead - Remote

MethodHub

•

Remote

Contract

Looking only for independent candidates who can work directly with Method-hub.Job Description: Requirements:Degree preferably Computer Science, Engineering, or other quantitative fields.6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployments, technical guidance, syst
Easy Apply
Posted 12 days ago | Updated 12 days ago

Analytics Data Engineer, Applied Engineering

OpenAI

•

San Francisco, California, USA

Full-time

About the team The Applied team works across research, engineering, product, and design to bring OpenAI's technology to consumers and businesses. We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth. About the role: We're seeking a Data Engineer to take the lead in building our data pipelines and core tables for OpenAI. These pipelines are crucial for po
Posted 60+ days ago | Updated 26 days ago

Technical Project Manager / Engineering Project Manager (EPM) with advanced data analytics

ApTask

•

Remote

Contract

Position Title: Technical Project Manager / Engineering Project Manager (EPM) with advanced data analytics Job Location: Seattle, WA or Sunnyvale, CA (Remote) Job Type: FTE / Contract (C2C or W2) JOB DESCRIPTION: Strong Project Management skillsStrong communication skillsAble to handle fast paced and ambiguously defined projects with multiple customers and partners.Strong conceptual understanding of data and data analytics - Someone who understands and thinks about data and data analytics. Not
Easy Apply
Posted 12 days ago

Azure Data Architect

Intraedge

•

Remote

Contract, Third Party

Job Title: : Azure Data Architect Location: REMOTE Duration: Long Term Contract Responsibilities: Engineer Azure-based solutions with a focus on cost-efficiency, performance, and operational effectiveness. Craft and enforce a framework to quantify data quality across various customer and prospect sources, ensuring data accuracy, completeness, consistency, and timeliness. Scrutinize first-party customer data sources to establish the most reliable ones and formulate ingestion strategies for both
Easy Apply
Posted 27 days ago | Updated 18 days ago

AI/ML Architect

Savvyan Technologies

•

Remote

Contract

Greetings from Savvyan Technologies! We are looking for AI/ML Architect for one of our client. Please find the JD below and revert back if interested in. Job Description: We are seeking an experienced AI/ML Architect with a strong background in data to join our team. As an AI/ML Architect, you will play a crucial role in designing, implementing, and optimizing AI and machine learning solutions that leverage our vast data resources. You will collaborate closely with cross-functional teams to ensu
Easy Apply
Posted 5 days ago | Updated 5 days ago

Senior Data Engineer (Machine Learning)

W3Global

•

Remote or Jersey City, New Jersey, USA

Full-time

Senior Data Engineer (ML/ ETL) Full Time Remote Responsibilities: bold">Collaborate with machine learning practitioners to understand algorithm feature and data requirements bold">Work with Engineering teams to collect required data from internal and external systems bold">Develop and maintain production-grade batch and streaming pipelines bold">Setup orchestration and automation of ETL jobs using tools such as Airflow and Jenkins bold">Improve and extend existing data infrastructure servi
Posted 5 days ago | Updated 1 day ago

Manager II, Applied Science

Uber Corporate

•

San Francisco, California, USA

Full-time

About the role: You will be leading a hardworking team of data scientists to support safety initiatives to make rare safety events even rarer. The role will partner closely with Safety and Insurance product management, operations, engineering, and regional teams to conduct deep analysis, design and analyze experiments, and support development of machine learning models to make our platform as safe as possible for all users. You will play an influential role in helping drive critical product and
Posted 55 days ago | Updated moments ago

Sr. Data Analyst - (Databricks)

IntelliSavvy

•

Remote

Full-time, Part-time, Contract, Third Party

Note: Work visa sponsorship is not supported for this position Key Responsibilities 6-10 years of experience with 2+ using Databricks Conduct data discovery, document data sources, and definitions to ensure data accuracy and consistency. Analyze data using SQL queries and other analytical tools and use visual tools like Tableau or Power BI. Collaborate with data engineers, product management and support business stakeholders as needed. Document user stories, requirements, and acceptance criteria
Easy Apply
Posted 26 days ago | Updated moments ago

AWS Data Architect

Tech Rakers

•

Remote

Contract

Title: Sr.AWS Data Architect Top Skills' Details 8-10+ years of experience with hands on development with Scala and Spark. This role will require hands on development with Scala and Spark. Scala is the top programming requirement for this role. Bulk of the work this AWS architect will support is with Apache Spark/Scala programming language. 2. Strong knowledge of AWS architecture 3. Strong engineer that writes code, knows framework and can review the architecture and help when they get stuck 4.
Easy Apply
Posted 6 days ago

Healthcare Technical Lead

GoAhead Solutions

•

Remote or Detroit, Michigan, USA

Contract

GoAhead Solutions has a great opportunity in Detroit, MI (Onsite or Remote) for a Healthcare Technical Lead. This would be a Six to Twelve month contract to start out. Must be able to work EST or CST hours. Job Description: -Responsible for leading complex projects and independently executing analyses that support the healthcare value portfolio. -Translates technical results into answers for healthcare business needs and applies a strong understanding of healthcare industry when creating those
Easy Apply
Posted 5 days ago | Updated 3 days ago