BigData Spark Developer Jobs in San Francisco, CA

Refine Results
1 - 20 of 162 Jobs

Big Data Developer (Spark, Scala, AWS, AWS Elastic MapReduce)

People Force Consulting Inc

•

Remote

Contract, Third Party

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: Spark frameworkScalaAWS Elastic MapReduce - Strong ExperienceAWSJob Description Requirements: Bachelors degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocki
Easy Apply
Posted 24 days ago | Updated 7 hours ago

Full-Time Only::remote::Spark Developer with Scala/Python

VeridianTech

•

Remote

Full-time

Position : Spark Developer with Scala/Python Location : Sunnyvale, CA or Ausin,TX Duration : Fulltime Job Description: Required Qualifications: Candidate must be located within commuting distance of Sunnyvale, CA or Ausin,TX be willing to relocate to Sunnyvale, CA or Austin, TX. This position may require travel within the US and Canada. Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty
Easy Apply
Posted 4 days ago | Updated 1 day ago

Python Developer with Spark Expertise

Optimuss Inc

•

Remote

Third Party, Contract

Position: Python Developer with Spark Expertise Position Overview: We are seeking a talented Python Developer with expertise in Apache Spark to join our growing team. The ideal candidate will have a strong background in Python development and hands-on experience with Spark for processing large-scale datasets. As a key member of our team, you will play a critical role in developing data pipelines, optimizing performance, and implementing robust solutions to meet our clients' evolving needs. Respo
Easy Apply
Posted 2 days ago

Spark Scala Developer (Remote Role)

Nityo Infotech Corporation

•

Remote

Full-time

Role - Spark Scala Developer Experience 5+ years of IT experience Location 100% Remote Role Employment Type Fulltime Job Description : Required Qualifications: Bachelors degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of educationAt least 4 years of experience in Information Technology.At least 3years of hands on experience with Hadoop distributed frameworks while handling l
Easy Apply
Posted 11 days ago | Updated 4 days ago

Abinitio Developer with Big data Hadoop experience

S3 Staffing USA

•

Remote or Maryland City, Maryland, USA

Contract, Third Party

Looking for Abinitio Developer with Big data Hadoop experience Job Description: PURPOSE: The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on developing solutions and helping transform the company's platforms deliver data-driven, meaningful ins
Easy Apply
Posted 5 days ago

Senior Software Engineer, Big Data

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 9 days ago | Updated 9 hours ago

Sr. Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 32 days ago | Updated 9 hours ago

Azure Data Architect/Engineer

Raas Infotek LLC

•

Fremont, California, USA

Contract

Azure Data Architect/Engineer Location-Fremont, CA / Remote Job Type-Long Term Must have Skills : Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms.10 + years of proven experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST.Solid knowledge of data warehouse best practices,
Easy Apply
Posted 3 days ago

Sr. Applied Scientist - Delivery Pricing

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role Have you ever ordered food on Uber and when your order arrived wondered how it got to you so fast? Wondered where it came from and how much it would have cost Uber? If so, the Uber marketplace team is for you. We build systems to look into the future and estimate the distribution of millions of orders worldwide and manage the demand on Uber Delivery marketplace. We build solutions that decide which restaurant is available at what distance at the right price. The tools we create
Posted 60+ days ago | Updated 9 hours ago

Senior Applied Scientist - Marketplace Pricing/Incentives

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Role Have you ever ordered food on Uber and when your order arrived wondered how it got to you so fast? Wondered where it came from and how much it would have cost Uber? If so, the Uber marketplace team is for you. We build systems to look into the future and estimate the distribution of millions of orders worldwide and manage the demand on Uber Delivery marketplace. We build solutions that decide which restaurant is available at what distance at the right price. The tools we create
Posted 60+ days ago | Updated 9 hours ago

Remote Opportunity || Data Analytics with Python || Full time

IT First Source

•

Remote

Full-time

Remote Opportunity || Data Analytics with Python || Full time Qualifications Expertise in using SQL with some experience in Python/R or Data AnalysisExperience in manipulating data and drawing insights from large data setsExperience in designing and implementing ETL process (defining, gathering, transforming) dataHands-on Development experience in Big Data technology stack Panda, NumPy, Hive, Impala, Spark, CDSWExperience in Git/ BitBucketExperience in Orchestration tools like Control M and AirF
Easy Apply
Posted 20 days ago | Updated 2 days ago

Scala Developers

People Force Consulting Inc

•

Remote

Contract

Role: Scala Developers Exp Required: 12+Years Location: Remote Duration: 7+ Months Interview Process: Test followed by two round of technical discussion. Mandatory Skills: Spark, Scala EMR and AWS Please submit candidate who have Hand-on experience only Job Description Bachelor s degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level
Easy Apply
Posted 20 days ago | Updated 7 hours ago

Senior Applied Scientist

Uber Corporate

•

San Francisco, California, USA

Full-time

About the role As an applied scientist in the Safety and Insurance team, you will have the opportunity to take on some of the hardest problems in all of Uber: improving the safety of cities and people all over the world. This applied scientist position focuses on algorithmic solutions to understanding and improving driving safety. This is an excellent opportunity for an experienced, intellectually-curious data scientist to make impact in one of Uber's most critical divisions. In this role, yo
Posted 60+ days ago | Updated 9 hours ago

Senior Staff Software Engineer, Data and ML Platform

Discord Inc.

•

San Francisco, California, USA

Full-time

Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. We are seeking an accomplished and experienced Senior Staff software Engineer to join our dynam
Posted 52 days ago | Updated 9 hours ago

Senior Software Engineer - Distributed Data Systems

Databricks Inc

•

San Francisco, California, USA

Full-time

P-59 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to solve technical challenges, from designing n
Posted 60+ days ago | Updated 9 hours ago

Staff Software Engineer - Backend

Databricks Inc

•

San Francisco, California, USA

Full-time

P-150 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark , Databricks has grown from a tiny corner office in Berkeley, California to a global organizati
Posted 60+ days ago | Updated 9 hours ago

Staff Software Engineer - Distributed Data Systems

Databricks Inc

•

San Francisco, California, USA

Full-time

P-186 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark , Databricks has grown from a tiny corner office in Berkeley, California to a global organizati
Posted 60+ days ago | Updated 9 hours ago

Lead Data Engineer (Security Focus)

Iceberg

•

Remote

Full-time

My client is a leading innovator in financial technology and trading, dedicated to pushing the boundaries of technology to create impactful solutions. We are currently seeking a talented Lead Data Engineer with a strong background in software engineering and experience in data engineering, particularly in the realm of security. As the Lead Data Engineer with a focus on security, you will play a pivotal role in leading the development and optimization of data pipelines, tools, and products to enh
Easy Apply
Posted 23 days ago

Database Engineer (100% Remote - W2 Only)

Performix Business Services, LLC

•

Remote or Chicago, Illinois, USA

Contract

Database Engineers administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistance to
Easy Apply
Posted 4 days ago | Updated 3 days ago

Bigdata Hadoop Engineer

Softsol Resources Inc

•

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S
Easy Apply
Posted 11 days ago | Updated 4 days ago