Bigdata Engineer Jobs in San Francisco, CA

Refine Results
41 - 60 of 256 Jobs

Senior Spark Data Engineer

Randstad Digital

•

Remote or Akron, Ohio, USA

Full-time

job summary: Job Description: As a Senior Spark Data Engineer, you will play a pivotal role in designing, developing, and optimizing data processing pipelines using Apache Spark. You will work closely with cross-functional teams to understand business requirements and translate them into scalable and efficient data solutions. Your expertise in SQL, Python, Databricks, and Spark will be critical in ensuring the seamless processing of large-scale imagery and big data sets. This role offers an exc
Posted 18 days ago | Updated moments ago

Senior Software Engineer - Storage Platform

Uber Corporate

•

San Francisco, California, USA

Full-time

At Uber, we ignite opportunity by setting the world in motion. We take on big problems to help drivers, riders, delivery partners, and eaters get moving in more than 600 cities around the world. We welcome people from all backgrounds who seek the opportunity to help build a future where everyone and everything can move independently. If you have the curiosity, passion, and collaborative spirit, work with us, and let's move the world forward together. About the role We are looking for talented e
Posted 60+ days ago | Updated moments ago

Senior Software Engineer - Backend

Databricks Inc

•

San Francisco, California, USA

Full-time

P-78 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to solve technical challenges, from designing n
Posted 60+ days ago | Updated moments ago

Project Manager-Remote

First Tek, Inc.

•

Remote

Full-time

My name is Gaurav and I'm a Technical Recruiter at First Tek. We are currently sourcing for candidates with the following skills. Kindly forward your resume if interested, do share with your friends and colleagues as well. Job Title: Project Manager Location: Remote Client: Major Entertainment Company Duration: 9 months contract As a Project Manager within the Technology Services organization, you will work horizontally across the different verticals of the business (product, support, data scie
Easy Apply
Posted 10 days ago

Data Scientist V

West Coast Consulting LLC

•

Menlo Park, California, USA

Contract

Job Description Onsite in Menlo Summary: The main function of the Data Scientist is to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets. Job Responsibilities: Partner with product managers and engineering managers to assess the ROI of product feature enhancements. Understand the impact to creators' ability to monetize, onboarding and payout funnels, as well as safety and compliance. Apply knowledge of statistics, machine learning, progr
Posted 43 days ago | Updated moments ago

Cloud Data Engineer

Stefanini

•

Remote or Richmond, Virginia, USA

Contract

Stefanini Group is hiring!Stefanini is looking for Cloud Data Engineer for 100% Remote work. For quick Apply, please reach out to Ravi Singh- call: email: for W2 Candidates only! Responsibilities:Understand technology vision and strategic direction of business needsUnderstand our current data model and infrastructure, proactively identify gaps, areas for improvement, and prescribe architectural recommendations with a focus on performance and accessibility.Partner across engineering teams to de
Easy Apply
Posted 60+ days ago | Updated moments ago

Senior Staff Engineer - Cyber Defense

Uber Corporate

•

San Francisco, California, USA

Full-time

About the Team: Our mission is to protect, defend, and secure Uber's products, infrastructure and data by building highly available, scalable and extensible security solutions and services. We are passionate about proactively identifying and remediating security risks as well as swiftly detecting and mitigating security incidents. In the ever-evolving landscape of cybersecurity, we continuously adapt and evolve our defenses in order to always stay one step ahead of potential threats. About the r
Posted 60+ days ago | Updated moments ago

Project Manager-Remote-Major Entertainment Company

First Tek, Inc.

•

Remote

Full-time

My name is Gaurav and I'm a Technical Recruiter at First Tek. We are currently sourcing for candidates with the following skills. Kindly forward your resume if interested, do share with your friends and colleagues as well. Job Title: Project Manager Location: Remote Client: Major Entertainment Company Duration: 9 months contract As a Project Manager within the Technology Services organization, you will work horizontally across the different verticals of the business (product, support, data scie
Easy Apply
Posted 10 days ago

DataStage Developer with Big Data Job Description

SecureKloud Technologies Inc.

•

Remote

Full-time

Role : DataStage Developer with Big Data Experience: 10+ Years Location : Remote Duration : Long-term Contract Job Description : Design, develop, and maintain DataStage ETL jobs according to specifications.Optimize existing DataStage jobs for performance.Reviewing job designs and code created by other DataStage developers.Troubleshoot DataStage job failures and provide root cause analysis.Work with the development team to ensure that all DataStage jobs adhere to company standards and best pract
Easy Apply
Posted 1 day ago

Databricks and AWS RDS Engineer

Xoriant Corporation

•

Remote or Boston, Massachusetts, USA

Contract

Job Title : Databricks and AWS RDS Engineer Client Location: Boston, MA (Hybrid / Remote / Occasional travel) Duration : Long term contract Contract: W2 / C2C IC (Own corp only) Job Description: Responsibilities Design, implement and maintain large-scale data pipelines using Python, DatabricksProvisioning, developing, maintaining and tuning Amazon Oracle RDSWork with cross-functional teams to integrate solutions that meet our data processing and analysis needsEnsure performance, reliability, se
Easy Apply
Posted 4 days ago | Updated 1 day ago

AIML - Sr Engineering Program Manager, Data

Apple, Inc.

•

San Francisco, California, USA

Full-time

Summary Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Do you love taking on challenges that create a positive impact? If so, then we want to speak with you! As a member of the AIML Data EPM group, you will be responsible for Apple's ability to use data to power its products for hundreds of millions of users around the world. You will work with the AIML Data organization to deliver on our vision
Posted 2 days ago | Updated 12 hours ago

Senior Data Engineer (Machine Learning)

W3Global

•

Remote or Jersey City, New Jersey, USA

Full-time

Senior Data Engineer (ML/ ETL) Full Time Remote Responsibilities: bold">Collaborate with machine learning practitioners to understand algorithm feature and data requirements bold">Work with Engineering teams to collect required data from internal and external systems bold">Develop and maintain production-grade batch and streaming pipelines bold">Setup orchestration and automation of ETL jobs using tools such as Airflow and Jenkins bold">Improve and extend existing data infrastructure servi
Posted 24 days ago | Updated 12 hours ago

Senior Software Engineer - Infrastructure and Tools

Databricks Inc

•

San Francisco, California, USA

Full-time

P-78 While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. F
Posted 60+ days ago | Updated moments ago

Project Manager-Remote

First Tek, Inc.

•

Remote

Full-time

My name is Gaurav and I'm a Technical Recruiter at First Tek. We are currently sourcing for candidates with the following skills. Kindly forward your resume if interested, do share with your friends and colleagues as well. Job Title: Project Manager Location: Remote Client: Major Entertainment Company Duration: 9 months contract As a Project Manager within the Technology Services organization, you will work horizontally across the different verticals of the business (product, support, data scie
Easy Apply
Posted 12 days ago

Google Cloud Platform Cloud Data Engineer

Trinity Technology Solutions LLC

•

Remote

Contract

Job Title: Google Cloud Platform Cloud Data Engineer Location: Remote Duration: Contract Job Description: 10 to 15 years of proven experience in modern cloud data engineering, broader data landscape experience and exposure and solid software engineering experience.Prior experience architecting and building successful self-service enterprise scale data platforms in a green field environment with microservices based architecture.Proficiency in building end to end data platforms and data services
Easy Apply
Posted 1 day ago

Senior Staff Software Engineer, Data and ML Platform

Discord Inc.

•

San Francisco, California, USA

Full-time

This position is US based only. Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. We are seeking an accomplished and experienced Senior Staff so
Posted 60+ days ago | Updated moments ago

Senior Software Engineer - Distributed Data Systems

Databricks Inc

•

San Francisco, California, USA

Full-time

P-59 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to solve technical challenges, from designing n
Posted 60+ days ago | Updated moments ago

Hbase Database Engineer (100% Remote)

Performix Business Services, LLC

•

Remote or Saint Paul, Minnesota, USA

Contract

Database Engineers administer, test, and implement databases, applying knowledge of database management systems. Database Engineer Responsibilities and Duties:Assist in design and development of distributed database systems.Optimize database systems for performance and reliability.Perform database maintenance and troubleshooting activities.Test database systems and perform bug fixes.Provide database solutions based on technical documents and business requirements.Provide technical assistance to
Easy Apply
Posted 4 days ago

Senior Java Backend Developer with Big data Experience

Symantrix Inc

•

Remote

Contract, Third Party

Minimum Qualifications:4+ years of experience programming in Java/J2EEHands on Experience with Spark Streaming, Flink, Hive and related Big Data Tech stacksExperience with distributed publish-subscribe messaging system like Kafka Experience with no-sql technologies like Cassandra and Elasticsearch Experience with REST microservices using Sprint BootPreferred Qualifications:Experience with Google cloud tech stacks such as BigQuery, GCS Experience with Jenkins, Kubernetes, OneOps and related DevOp
Easy Apply
Posted 10 days ago | Updated 5 days ago

Staff Software Engineer - Distributed Data Systems

Databricks Inc

•

San Francisco, California, USA

Full-time

P-186 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark , Databricks has grown from a tiny corner office in Berkeley, California to a global organizati
Posted 60+ days ago | Updated moments ago