Sr. Data Engineer Jobs in San Francisco, CA

Refine Results
1 - 20 of 3,009 Jobs

Senior Data Engineer

Disney Entertainment & ESPN Technology

San Francisco, California, USA

Full-time

Disney Entertainment & ESPN Technology On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports conten

Senior Data Engineer -Advertising

Discord Inc.

San Francisco, California, USA

Full-time

This position is US based only. Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. Discord, an inclusive community for all, invites an experience

Sr. Data Engineer/Java/React/Javascript/Springboot

BayOne Solutions

San Francisco, California, USA

Contract

Title: Sr. Data Engineer/Java/React/Javascript/Springboot Location: San Francisco, CA (Hybrid) Duration: 12 Month/Contract Skills Required: Big Data: Scala, Databricks, Spark SQL, Spark Streaming, Python, Pyspark Cloud: Azure, ADF System Design: API Design, Event driven architecture. Microservice: Core Java 8 or above, SpringBoot, Azure Functions Front end: JavaScripting, React

Senior BESS Engineer

Oscar Technology

San Francisco, California, USA

Full-time

The Senior BESS Engineer will will be the primary pre and post-sale technical support resource for the controls integration on all energy storage projects, with design, discovery, and technical analysis responsibility from origination through commissioning. This position reports to the Director of Engineering or another senior management personnel that the Vice President and/or President of the Company may designate. This position is expected to travel up to 30%. Essential Job Function & Respon

Sr Software Engineer

STAND 8

San Francisco, California, USA

Contract

STAND 8 is a global leader providing end-to-end IT Solutions. We solve business problems through PEOPLE, PROCESS, and TECHNOLOGY and are looking for individuals to help us scale software projects designed to change the world! We are looking for a Senior Software Engineer to become one of the core contributors that helps power the backend services. We're a team that values software that exemplifies simplicity of design, maintainability, extensibility, and foundational robustness. The right candid

Senior Data Engineer - REMOTE WORK - 55028

PRIMUS Global Services Inc.

Remote or Dallas, Texas, USA

Contract

Senior Data Engineer - REMOTE WORK - 55028 We have an immediate long-term opportunity with one of our prime clients for a position of Senior Data Engineer to work on Remote basis. Must Haves: Neo4j Need to have 2-3 Years of Recent. Cypher query language Extensive hands-on Data engineer/arch experience General Profile: Data Architect or Data Engineer with extensive Neo4j experience Data Modeling, ETL Process, data integration, data pipelining, performance tuning, etc. Project Overview: Work

Senior Data Engineer (Machine Learning)

W3Global

Remote or Jersey City, New Jersey, USA

Full-time

Senior Data Engineer (ML/ ETL) Full Time Remote Responsibilities: bold">Collaborate with machine learning practitioners to understand algorithm feature and data requirements bold">Work with Engineering teams to collect required data from internal and external systems bold">Develop and maintain production-grade batch and streaming pipelines bold">Setup orchestration and automation of ETL jobs using tools such as Airflow and Jenkins bold">Improve and extend existing data infrastructure servi

Senior Software Engineer - Data Engineering, Marketplace

Uber Corporate

San Francisco, California, USA

Full-time

About the Role The Global Intelligence Team focuses on making Uber take important marketplace decisions with better data and algorithms. The ambitious problems include modeling complex market-level dynamics, rider and driver choices, cross-service decisions across rides/eats, and fine-tuning Uber's pricing with data/algorithms from this team. The software engineers on the team use substantial amounts of data to address these challenges, building scalable engineering solutions. We are looking fo

Senior Data Engineer

Kforce Technology Staffing

Remote or Los Angeles, California, USA

Contract

RESPONSIBILITIES: Kforce has a client in Anaheim, CA looking for Senior Data Engineer. Responsibilities: * The Senior Data Engineer will lead on all aspects of a modern and flexible SDLC approach, applied to data engineering, analytics and data science efforts * Provide business guidance and steer efforts toward desired outcomes; Partner with internal stakeholders and external vendors to meet strategic data warehouse goals * Research, evaluate and formally recommend third party software and tec

Senior Data Engineer

Kforce Technology Staffing

Remote or Lehi, Utah, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a Senior Data Engineer in Lehi, UT. Summary: We are seeking an experienced Data Engineer proficient in AWS, Kafka streams, Python, and SQL. As part of our Data Engineering team, you will design and implement data pipelines using AWS and Kafka streams. Your role involves managing data connections, collaborating with stakeholders, and ensuring data accuracy and reliability. Primary Responsibilities: * Senior Data Engineer will implement and ma

Sr Data Engineer

Delviom LLC

Remote

Contract

. We are looking for someone who has strong technical skills and has prior experience building/managing data pipelines. This individual should be able to provide guidance to other members on best practices and provide direction/input on what a mature/target state data pipeline should look like. From a day-to-day I would expect them to play a solutions engineer role (occasional architecting and solutioning exercises) as well as executing on technical stories and providing thorough code reviews. .

Sr Dev Ops Engineer

STAND 8

Palo Alto, California, USA

Contract

STAND 8 provides end to end IT solutions to enterprise partners across the United States with offices in Los Angeles, New York, New Jersey, Atlanta and more, including internationally in Mexico, India and Japan. We are looking for a talented AWS DevOps Engineer to manage our AWS environment and support our development teams. This role involves overseeing the CI/CD pipeline, building internal tools, conducting code and architecture reviews, and enhancing our automation and availability using cutt

Senior Data Engineer

Heliogic LLC

Remote

Contract

Job Title : Senior Data Engineer Open for Canada and USA (Remote) The candidate will have coding rounds on SQL, Spark, and Airflow. All 3 are mandatory Required Experience: 5 - 10 Years Skills : Python, SQL, Airflow, Snowflake, Databricks Responsibilities: Assist in guiding customers on big data projects, including architectural design, data migration, data engineering, and model deployment. Participate in workload architecture, including performance, testing and optimization. Requirements: 5+ y

Senior Data Engineer

iPivot, LLC

Remote

Contract

Job Details: Senior Data Engineer (AWS/ AZURE, Python, Spark, Glue, Athena)A total of 10+ Years of experience is required.Healthcare(Claims) domain knowledge is preferred.Architect, Design, Develop and Deploy scalable, high-availability systems on AWS or Azure , leveraging serverless technologies and a variety of AWS or Azure services like Lambda, API Gateway, S3, DynamoDB, CloudFormation, Event Bridge, Step Functions, and AWS Glue, Athena, Redshift.Big Data Technologies: Utilize big data techno

Sr. Data Engineer - Contractor

Jade Biz Services

Remote

Contract

Summary: We are expanding our Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS and Kafka streams, and train other team members. As a Sr. Data Engineer on our Data Engineering team, you will also design, write, scale, and maintain complex data pipelines using Python within our development framework. You will contribute to the organization's success by partnering w

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Job Description: As a Senior Spark Data Engineer, you will play a pivotal role in designing, developing, and optimizing data processing pipelines using Apache Spark. You will work closely with cross-functional teams to understand business requirements and translate them into scalable and efficient data solutions. Your expertise in SQL, Python, Databricks, and Spark will be critical in ensuring the seamless processing of large-scale imagery and big data sets. This role offers an exc

Sr. Data Engineer

The Walt Disney Company

Remote or Burbank, California, USA

Full-time

This role is based out of the Burbank are and will require relocation if not local. This is not a remote role. The Disney Decision Science and Integration (DDSI) analytics consulting team is responsible for supporting clients across The Walt Disney Company including Disney Parks, Experiences and Products (e.g., Walt Disney World, Disneyland, Disney Cruise Line), Disney Media & Entertainment Distribution (e.g., Disney+, ESPN+, Hulu), Studios Content (e.g., The Walt Disney Studios, Disney Theatric

Senior Data Engineer (W2 Only - 100% Remote)

Performix Business Services, LLC

Remote or Saint Paul, Minnesota, USA

Contract

The Senior Data Engineer will fulfil an integral role in the Research Business Intelligence team, helping the team perform complex data modelling, implementing data management best practices, and contributing to the effective migration and implementation of data with Client Cloud.The role will collaborate with Information Analysts and a Data Management Specialist to review existing data infrastructures and build out future frameworks to ensure excellent data quality and reporting. Required: SQL

Sr. Data Engineer(Data Bricks Certified)

Amiseq Inc.

Remote

Contract

1. 4+ Years Data Engineering Experience, 5+ years of consulting experience 2. Completed Data Engineering Professional certification & required classes 3. Minimum 2-3 projects delivered with hands-on experience in Databricks 4. Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache SparkTM on Databricks 5. Experience in Spark and/or Hadoop, Flink, Presto, other popular big data engines 6. Familiarity with Databricks multi-hop pipeline architecture

Sr. Data Engineer (Local/Remote)

Irvine Technology Corporation (ITC)

Remote or Burbank, California, USA

Contract

Sr. Data Engineer (Local/Remote) We have an immediate need for a contract Sr. Data Engineer to join a global mass media and entertainment conglomerate. Location: Burbank, CA. Remote but MUST be local to Burbank. This job expects to pay about $100 - 125 per hour plus benefits. What You Will Do: Contribute to maintaining, updating, and expanding existing Core Data platform data pipelinesBuild tools and services to support data discovery, lineage, governance, and privacyCollaborate with other softw