hadoop big data spark engineer Jobs in san francisco, ca

Refine Results
1 - 20 of 245 Jobs

Senior Software Engineer, Big Data

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 32 days ago | Updated 5 hours ago

Bigdata Hadoop Engineer

Softsol Resources Inc

•

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S
Easy Apply
Posted 33 days ago | Updated 13 days ago

Direct Client:: W2 Position :: Need Sr. Hadoop Developer with Spark, Scala/Java, AI & Healthcare Exp.:: 100% Remote

Synergy Technologies, LLC

•

Remote

Contract

W2 Contract to Full Time position = Role: Senior Hadoop Developer Location: 100% Remote Job Description: Responsible for the design, development and operations of systems that store and manage large amounts of data. Essential Functions: Write code for moderately complex system designs.Write programs that span platforms.Code and/or create Application Programming Interfaces (APIs).Report missing elements found in system and functional requirements and explain impacts on subsystem to team members.
Easy Apply
Posted 3 days ago | Updated 14 hours ago

Staff Software Engineer, Batch & Stream Processing

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 7 days ago | Updated 5 hours ago

Senior Spark Data Engineer

Randstad Digital

•

Remote or Akron, Ohio, USA

Full-time

job summary: Job Description: As a Senior Spark Data Engineer, you will play a pivotal role in designing, developing, and optimizing data processing pipelines using Apache Spark. You will work closely with cross-functional teams to understand business requirements and translate them into scalable and efficient data solutions. Your expertise in SQL, Python, Databricks, and Spark will be critical in ensuring the seamless processing of large-scale imagery and big data sets. This role offers an exc
Posted 13 days ago | Updated 5 hours ago

Sr. Staff Software Engineer, Batch & Stream Processing

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 17 days ago | Updated 5 hours ago

Sr. Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 54 days ago | Updated 5 hours ago

Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 54 days ago | Updated 5 hours ago

Staff Software Engineer, Content Quality, Signal Lifecycle TL

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 5 days ago | Updated 5 hours ago

Big Data Developer (Spark, Scala, AWS, AWS Elastic MapReduce)

People Force Consulting Inc

•

Remote

Third Party, Contract

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: Spark frameworkScalaAWS Elastic MapReduce - Strong ExperienceAWSJob Description Requirements: Bachelors degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocki
Easy Apply
Posted 46 days ago | Updated 16 hours ago

Sr. Staff Machine Learning Engineer, Content Quality - Trust Engineering

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 10 days ago | Updated 5 hours ago

Staff Software Engineer - Driver Pricing

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role At Uber, we are revolutionizing the way people move through our cities. Our Driver Pricing team plays a critical role in this mission by developing and refining the algorithms that determine pricing for our drivers. As a Staff Software Engineer, you will be at the forefront of this innovation, leveraging your expertise in algorithms, optimization, and machine learning to create solutions that balance the needs of drivers, riders, and Uber's business objectives. This role offers
Posted 6 days ago | Updated 5 hours ago

Data Engineer

BayOne Solutions

•

San Bruno, California, USA

Contract

Job Title: Data Engineer Location: San Bruno, CA (Hybrid) Duration: 6+ months with possible ext. Description: Designs, develops, and implements Hadoop eco-system based applications to support business requirements.Follows approved life cycle methodologies, creates design documents, and performs program coding and testing.Resolves technical issues through debugging, research, and investigation. Experience/Skills Required: Bachelor s degree in Computer Science, Information Technology, or related
Easy Apply
Posted 60+ days ago | Updated 19 days ago

Senior Software Engineer - Data Engineering, Marketplace

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role The Global Intelligence Team focuses on making Uber take important marketplace decisions with better data and algorithms. The ambitious problems include modeling complex market-level dynamics, rider and driver choices, cross-service decisions across rides/eats, and fine-tuning Uber's pricing with data/algorithms from this team. The software engineers on the team use substantial amounts of data to address these challenges, building scalable engineering solutions. We are looking fo
Posted 12 days ago | Updated 5 hours ago

Senior Software Engineer 49)

Wells Fargo

•

San Leandro, California, USA

Full-time

At Wells Fargo, we want to satisfy our customers' financial needs and help them succeed financially. We're looking for talented people who will put our customers at the center of everything we do. Join our diverse and inclusive team where you'll feel valued and inspired to contribute your unique skills and experience. Help us build a better Wells Fargo. It all begins with outstanding talent. It all begins with you. Wells Fargo Technology sets IT strategy; enhances the design, development, and
Posted 11 days ago | Updated 2 hours ago

100% Remote Data Engineer / Software Developer background needed

Motion Recruitment Partners, LLC

•

Remote or San Francisco, California, USA

Full-time

If you're a person who wants to work for an marketing company that has multiple clients in different industries. Required Skills & Experience 3+ years of Data Engineering experience Software development background SQL NoSQL Database experience Python AWS (EMR, RDS, Redshift, Kinesis) Hadoop or Spark Desired Skills & Experience Masters degree or higher in Computer Science or related field. What You Will Be Doing Tech Breakdown 70% Data Engineering 20% Data Analytics 10% Machine Learning Dail
Easy Apply
Posted 6 days ago | Updated 5 hours ago

Software Engineer II - Maps Routing

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role The Maps Routing Engine & APIs Team owns a stack of technologies that produces the best route from point A to point B and predicts time (ETA) and distance between them. This includes sophisticated routing algorithms with a variety of cost functions, scalable systems to handle over a million QPS and secure and clean APIs for all of Uber to access the above said functionality. We power many Uber products ranging from pickup ETAs, marketplace matching, turn-by-turn navigation, fares
Posted 3 days ago | Updated 5 hours ago

Software Developer - Architect

Oracle Corporation

•

Redwood City, California, USA

Full-time

Job Description Business Intelligence (BI) is one of the fastest growing segments of the enterprise software industry. Business Intelligence Tools allow analysts, executives and other information consumers to get real-time, consistent information they need to make critical strategic decisions in a fast-paced, rapidly changing business world. BI adoption and insight from business operations is becoming increasingly responsible for stronger revenues, customer success, and competitive advantages a
Posted 10 days ago | Updated 5 hours ago

Senior Staff Software Engineer, Data and ML Platform

Discord Inc.

•

San Francisco, California, USA

Full-time

This position is US based only. Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. We are seeking an accomplished and experienced Senior Staff so
Posted 60+ days ago | Updated 5 hours ago