sr. data engineer / big data Jobs in san francisco, ca

Refine Results
1 - 20 of 2,985 Jobs

Senior Software Engineer, Big Data

Pinterest, Inc.

•

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the
Posted 17 days ago | Updated 5 hours ago

Sr. data Engineer

JPMorgan Chase & Co.

•

Palo Alto, California, USA

Full-time

We are looking for an experienced Data Engineer to enhance our team's capabilities in managing complex data workflows and integrating machine learning operations into our systems. The successful candidate will be proficient in modern data engineering techniques and tools, particularly in managing and automating ML pipelines using MLOps practices. Job Responsibilities: * Design, build, and optimize data pipelines for data transformations, feature generation, and efficient data storage. * Pererfo
Posted 33 days ago | Updated 5 hours ago

Sr Software Engineer

STAND 8

•

San Francisco, California, USA

Contract

STAND 8 is a global leader providing end-to-end IT Solutions. We solve business problems through PEOPLE, PROCESS, and TECHNOLOGY and are looking for individuals to help us scale software projects designed to change the world! We are looking for a Senior Software Engineer to become one of the core contributors that helps power the backend services. We're a team that values software that exemplifies simplicity of design, maintainability, extensibility, and foundational robustness. The right candid
Easy Apply
Posted 3 days ago | Updated 1 hour ago

Senior Data Engineer -Advertising

Discord Inc.

•

San Francisco, California, USA

Full-time

Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. Discord, an inclusive community for all, invites an experienced data engineer to join our Data
Posted 30 days ago | Updated 5 hours ago

Sr. Data Engineer/Java/React/Javascript/Springboot

BayOne Solutions

•

San Francisco, California, USA

Contract

Title: Sr. Data Engineer/Java/React/Javascript/Springboot Location: San Francisco, CA (Hybrid) Duration: 12 Month/Contract Skills Required: Big Data: Scala, Databricks, Spark SQL, Spark Streaming, Python, Pyspark Cloud: Azure, ADF System Design: API Design, Event driven architecture. Microservice: Core Java 8 or above, SpringBoot, Azure Functions Front end: JavaScripting, React
Easy Apply
Posted 9 days ago | Updated 4 days ago

Senior Data Engineer

ServiceNow, Inc.

•

Remote or Santa Clara, California, USA

Full-time

Company Description At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can't wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make t
Posted 9 days ago | Updated 4 hours ago

Sr Data Engineer

The Connors Group, Inc.

•

Remote

Full-time

The Senior Engineer is responsible for the design, development, implementation and support of ELT processes for Data Platform. Works as part of a team to develop data pipelines, data transformation logic in ADF, python or Scala and other technologies to move data from a variety of operational platforms into Azure cloud. Conduct performance tuning of ELT processes for large and medium volumes of data, develop and oversee monitoring systems to ensure data loads complete on schedule and data is acc
Easy Apply
Posted 5 days ago

Sr SAS/SQL Data Analyst

Randstad Digital

•

San Francisco, California, USA

Contract

job summary: Advise experienced leadership to develop or influence statistical modeling, analytical strategies, and advanced data visualization for complex business and technical needs . Lead the strategy and resolution of highly complex and unique challenges requiring analytical application of industry techniques, advance data from multiple sources, and mathematics behind data analysis across the enterprise, delivering solutions that are long-term, large-scale, and require vision, creativity,
Posted 24 days ago | Updated 2 hours ago

Senior Data Engineer

Refulgent Technologies Inc.

•

Remote

Contract

Senior Data Engineer REMOTE Lead end to end design and development of the data solutions.Provide guidance, mentorship, and technical expertise to the team members on the spark compute-based data engineering projects.Develop data pipelines to ingest and transform data using Scala and SQL on Spark.Setup orchestration of the pipelines using Azure Synapse pipeline.Source and version control code/configuration artifacts using GitHub.Create GitHub actions to deploy code/configuration artifacts.Create
Easy Apply
Posted 2 days ago

Senior Data Engineer (Machine Learning)

W3Global

•

Remote or Jersey City, New Jersey, USA

Full-time

Senior Data Engineer (ML/ ETL) Full Time Remote Responsibilities: bold">Collaborate with machine learning practitioners to understand algorithm feature and data requirements bold">Work with Engineering teams to collect required data from internal and external systems bold">Develop and maintain production-grade batch and streaming pipelines bold">Setup orchestration and automation of ETL jobs using tools such as Airflow and Jenkins bold">Improve and extend existing data infrastructure servi
Posted 4 days ago | Updated 5 hours ago

Data Migration Engineer

Stefanini

•

San Francisco, California, USA

Contract

Stefanini Group is hiring!Stefanini is looking for Data Migration Engineer in San Francisco, CA(Hybrid)For quick Apply, please reach out to Ayush Dwivedi- call: / email: all or part of complex data warehouse applications, develops software from established requirements, builds reports and dashboards, plans and coordinates work with fellow programmers to meet delivery commitments, creates prototypes; offers insight on the feasibility of system designs.Contributes to the design of technology infr
Easy Apply
Posted 5 days ago | Updated 4 hours ago

Senior Data Engineer

Kforce Technology Staffing

•

Remote or Mooresville, North Carolina, USA

Contract

RESPONSIBILITIES: Kforce has a client in Mooresville, NC that is seeking a Senior Data Engineer. Responsibilities: * Translates complex cross-functional business requirements and functional specifications into logical program designs, code modules, stable application systems, and data solutions * Partners with Product Team to understand business needs and functional specifications * Collaborates with cross-functional teams to ensure specifications are converted into flexible, scalable, and main
Posted 2 days ago | Updated 1 day ago

Sr. Data Engineer

Robert Half

•

Remote or Plantation, Florida, USA

Full-time

Description We are in search of a Senior Data Engineer to join our team in the healthcare industry, based in Plantation, Florida. In this role, you will be developing and implementing robust data engineering solutions to support our organization's data-driven initiatives. Your expertise in DataBricks, dbt, and Python will be critical in this role. Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, dbt, and Python Collaborate with cross-fu
Easy Apply
Posted 1 day ago | Updated 5 hours ago

Sr. Data Engineer

The Walt Disney Company

•

Remote or Burbank, California, USA

Full-time

This role is based out of the Burbank are and will require relocation if not local. This is not a remote role. The Disney Decision Science and Integration (DDSI) analytics consulting team is responsible for supporting clients across The Walt Disney Company including Disney Parks, Experiences and Products (e.g., Walt Disney World, Disneyland, Disney Cruise Line), Disney Media & Entertainment Distribution (e.g., Disney+, ESPN+, Hulu), Studios Content (e.g., The Walt Disney Studios, Disney Theatric
Posted 18 days ago | Updated 5 hours ago

100% Remote Senior Data Engineer

Jobot

•

Remote

Full-time

100% Remote Senior Data Engineer up to $160k base salary This Jobot Job is hosted by: Lucas Watson Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $120,000 - $160,000 per year A bit about us: Our client, and innovation and technology focused upstream oil and gas enterprise, is seeking a Senior Data Engineer for a full time, direct hire, 100% remote role. Why join us? Fully remote opportunity Innovation driven company Cutting edge technolo
Posted 2 days ago | Updated 4 hours ago

100% Remote Senior Data Engineer

Jobot

•

Remote

Full-time

100% Remote Senior Data Engineer up to $160k base salary This Jobot Job is hosted by: Lucas Watson Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $120,000 - $160,000 per year A bit about us: Our client, and innovation and technology focused upstream oil and gas enterprise, is seeking a Senior Data Engineer for a full time, direct hire, 100% remote role. Why join us? Fully remote opportunity Innovation driven company Cutting edge technolo
Posted 2 days ago | Updated 4 hours ago

100% Remote Senior Data Engineer

Jobot

•

Remote

Full-time

100% Remote Senior Data Engineer up to $160k base salary This Jobot Job is hosted by: Lucas Watson Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $120,000 - $160,000 per year A bit about us: Our client, and innovation and technology focused upstream oil and gas enterprise, is seeking a Senior Data Engineer for a full time, direct hire, 100% remote role. Why join us? Fully remote opportunity Innovation driven company Cutting edge technolo
Posted 2 days ago | Updated 4 hours ago

Senior Data Engineer

Sparibis, LLC

•

Remote

Full-time

Location: 100% Remote Years Experience: 10+ years Education: Bachelor s in IT related field Work Authorization: Must show that applicant is legally permitted to work in the United States. Clearance: Applicants must be able to meet the requirements to obtain an Public Trust security clearance. NOTE: United States Citizenship is required to be eligible to obtain this security clearance. Key Skills: 10+ years of IT experience focusing on enterprise data architecture and management Experience with
Easy Apply
Posted 41 days ago | Updated 7 days ago

AWS Cloud Data Engineer

Shimento, Inc.

•

San Francisco, California, USA

Contract

Data Engineer Duration:- 12 Months Location:- San Francisco, CA Hybrid 2/3 Days tues, thurs - SFO Bay Area Data Engineer w/ Cloud Exp. GitLab is must (Terraform would be good to have not focused) A person exp. with realtime data migration from On prem to cloud. Understanding of Java and Python Scripting is required. Should know to read the codes AWS, Datawarehouse, Redshift exp. is required.. ETL tool Informatica Understanding would be a plus not focused Using Python exp. with Developing Data pi
Easy Apply
Posted 4 days ago | Updated 2 days ago