Kafka Engineer or Data Engineer Jobs in San Francisco, CA

Refine Results
21 - 40 of 145 Jobs

Azure Data Engineer

CC Pace Systems, Inc.

•

Remote

Contract

Open to Hybrid or Remote Responsibilities Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark SPARK Performance\tuning\optimization Identify and optimize long running Databricks SPARK jobs. Monitor resource utilization and costs associated with Databricks usage, identifying optimization and cost reduction opportunities. Analyze cluster performance metrics and implement tuning strategies to ensure optimal query
Easy Apply
Posted 3 hours ago | Updated 3 hours ago

FullStack Infra System Engineer

Pyramid Consulting, Inc.

•

Remote

Contract

Immediate need for a talentedSenior Infrastructure System Engineer. This is a30+ Monthscontract opportunity with long-term potential andis located inUnited States (Remote).Please review the job description below and contact me ASAP ifyou are interested. Job ID: 23-45398 Pay Range: $80/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Note-(Ideal candidate: Proficient in various areas
Easy Apply
Posted 7 days ago | Updated 4 days ago

Senior Software Engineer

Uber Corporate

•

Remote or San Francisco, California, USA

Full-time

About The Role The Uber Eats Delivery Search team enables best-in-class search experience for our customers. We help customers find exactly what they are looking for - store , dish or grocery items. The Search Backend team powers the end-to-end Search workflows. In this role, you will have to opportunity to engineer and productionize cutting-edge Search ML algos built by our peer ML team , You will also optimize the search stack so it runs efficiently at < 100ms latencies. You will work with t
Posted moments ago

Senior Dev Operations Engineer SRE

Buxton Consulting

•

Remote

Contract

Senior Dev Operations Engineer SRE Remote Role Top 3 Must Haves Experience setting up alerts / alarms / notifications in AWS cloud. CloudWatch / DynatraceExperience with AWS solutions using AWS services including Kafka, ECS, EKS.Experience with IaC (Infrastructure as code) CDK or Terraform.TECHNICAL KNOWLEDGE AND SKILLS: 6+ years of overall IT experience 4+ years of AWS Cloud management experience with below skill set AWS Certified DevOps and / or Solution Architect certification Experience
Easy Apply
Posted 20 days ago

Middleware Developer

Prestige Staffing

•

Remote

Full-time

This role is 100% Remote! Expected Outcomes and Requirements: We are hiring a Middleware Developer to design, develop, and maintain middleware solutions that facilitate seamless communication and data exchange between different applications. The Middleware Developer is expected to contribute in the following significant ways: Design, develop, and implement middleware solutions to facilitate communication between disparate systems and applications.Collaborate with cross-function teams to understa
Easy Apply
Posted 5 hours ago | Updated 4 hours ago

IT Engineer (Data Engineer)

HawkB Inc

•

Remote

Full-time

Job Description: Job Title: IT Engineer (Data Engineer). Job Responsibilities Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark SPARK Performance\tuning\optimization Identify and optimize long running Databricks SPARK jobs. Monitor resource utilization and costs associated with Databricks usage, identifying opportunities for optimization and cost reduction. Analyze cluster performance metrics and implement tu
Easy Apply
Posted 11 hours ago

Software Engineer, Analytics Platform

OpenAI

•

San Francisco, California, USA

Full-time

About the Team The Research Platform Analytics team designs, builds, and operates the critical foundational data and analytics infrastructure that enables research at OpenAI. Our goal is one, and one only: accelerate the progress of research towards AGI. We do this by owning critical components of the research training stack, starting from key data processing pipelines and complex libraries that directly feed into our distributed training, followed by a variety of observability and analytics s
Posted 27 days ago | Updated 13 days ago

Software Engineer - Safety Processing

Discord Inc.

•

San Francisco, California, USA

Full-time

As an engineer on the Safety Processing team, you will work on the core safety pipeline - ingesting signals, like user reports, and the processing of those signals through automated and manual means. This includes partnering with ML teams and building Agent facing tooling for manual review. You will be reporting to the Engineering Manager of Safety Processing. Join our team in taking on the immense challenge of designing the future of safety at Discord! What You'll Be Doing Scale and Improve D
Posted 56 days ago | Updated moments ago

Server Engineer, Integrity

Strava, Inc.

•

San Francisco, California, USA

Full-time

About This Role Strava is the leading digital community for active people with more than 120 million athletes, in more than 190 countries. The platform offers a holistic view of your active lifestyle, no matter where you live, which sport you love and/or what device you use. Everyone belongs on Strava when they are pursuing an active life. This role is on the Integrity Team, who focus on preserving the trust of our community. We work together on a set of tools, capabilities, and features that k
Posted 26 days ago | Updated moments ago

Software Engineer, Safety

OpenAI

•

San Francisco, California, USA

Full-time

About the Team The Applied AI team safely brings OpenAI's advanced technology to the world. We released the GPT-3 API , Codex (which powers GitHub Copilot ), and DALL-E . More is coming very soon. We empower developers with APIs offering state-of-the-art AI capabilities, which power product features that were never before possible. We also build AI-driven consumer applications. Across all product lines, we ensure that these powerful tools are used responsibly. This is a key part of OpenAI's p
Posted 60+ days ago | Updated 13 days ago

Senior Data Engineer

Sparibis, LLC

•

Remote

Full-time

Location: 100% Remote Years Experience: 10+ years Education: Bachelor s in IT related field Work Authorization: Must show that applicant is legally permitted to work in the United States. Clearance: Applicants must be able to meet the requirements to obtain an Public Trust security clearance. NOTE: United States Citizenship is required to be eligible to obtain this security clearance. Key Skills: 10+ years of IT experience focusing on enterprise data architecture and management Experience with
Easy Apply
Posted 29 days ago

Stream Infrastructure Engineer

OpenAI

•

San Francisco, California, USA

Full-time

About the Team You'll join the team that's behind OpenAI's data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The Streaming Infrastructure team within Data Platform is responsible for building and maintaining our streaming platform. This platform plays a crucial role in facilitating the seamless exchange of data across various systems within OpenAI and serves as a foundational component of our infrastructure. Our team is fo
Posted 60+ days ago | Updated 13 days ago

Data Engineer (L4) - Privacy

Netflix, Inc.

•

Remote

Full-time

Netflix is enjoyed by more than 230 million members globally, entertaining new audiences every day. We are in the midst of major transformative developments for the Netflix product with the launch of an Advertising-supported plan, Games, and Live content. These new products, alongside our streaming service, have resulted in significant increases in the complexity and breadth of our internal data ecosystem. We manage one of the largest paid subscription businesses and are committed to handling ou
Posted 45 days ago | Updated moments ago

Sr Software Engineer - Machine Learning

Uber Corporate

•

Remote or San Francisco, California, USA

Full-time

About the Role Promotions and discounts have become key components of modern e-commerce platforms. The Marketplace Consumer Incentives team is largely responsible for Uber's profitability and growth through the most efficient incentive structures across all business lines like Uber Rides and Uber Eats. The team heavily invests in machine learning, causal inference, constrained optimization, distributed system, etc to optimize/personalize incentive structures to increase consumer engagement. The
Posted 7 days ago | Updated moments ago

Senior Scala Software Engineer

JBC powered by Workgenius

•

Remote

Contract

Senior Software Engineer (Java / Scala) with Top Mass Media & Entertainment Company Senior Software Engineer (Java / Scala) Location: Remote Rate: up to $88.00/HR W2 Duration: 18 months Summary: The Ad Intelligence team is under Ad Platforms and its mission is to transform advertising and the Ad platform with data and AI across TV and streaming video. We build solutions to measure and optimize every aspect of the advertising life cycle. Our tenant is a strong cross-domain team to deliver E2E sol
Easy Apply
Posted 19 days ago | Updated 4 days ago

Software Engineer, Anti Fraud & Abuse

OpenAI

•

San Francisco, California, USA

Full-time

About the team The Applied team safely brings OpenAI's technology to the world. We released ChatGPT; Plugins; DALL E; and the APIs for GPT-4, GPT-3, embeddings, and fine-tuning. We also operate inference infrastructure at scale. There's a lot more on the immediate horizon. Our customers build fast-growing businesses around our APIs, which power product features that were never before possible. ChatGPT is a prime example of what is currently possible. We simultaneously ensure that our powerful
Posted 60+ days ago | Updated 13 days ago

Data Engineer (L5) - Privacy

Netflix, Inc.

•

Remote

Full-time

Netflix is enjoyed by more than 230 million members globally, entertaining new audiences every day. We are in the midst of major transformative developments for the Netflix product with the launch of an Advertising-supported plan, Games, and Live content. These new products, alongside our streaming service, have resulted in significant increases in the complexity and breadth of our internal data ecosystem. We manage one of the largest paid subscription businesses and are committed to handling ou
Posted 45 days ago | Updated moments ago

Healthcare Data Engineer II

Genzeon

•

Remote

Full-time

We are Genzeon Corp, established in 2009, A cutting-edge global digital company with focus on healthcare. Genzeon helps its clients achieve their goals by providing innovative services & solutions to reduce costs, streamline operations, improve experience, increase provider productivity, and advance patient care and satisfaction. Our culture anchors our core values Human connection, Accountability & Empowerment. Healthcare Data Engineer IIFTERemoteDescription: We are seeking a talented Healthcar
Easy Apply
Posted 43 days ago | Updated 8 days ago

Senior Backend Engineer, Project Mgmt Features

ClickUp

•

Remote or San Francisco, California, USA

Full-time

ClickUp is the world's only all-in-one productivity platform that flexes to the way people want to work. It replaces all individual workplace productivity tools with a single, unified platform that includes project management, document collaboration, whiteboards, spreadsheets, and AI. Our dedication to enhancing productivity has earned us recognition on prestigious lists including the Forbes Cloud 100, Fast Company's Most Innovative Companies, Inc. Power Partners and #1 on two of G2's Best Softw
Posted 50 days ago | Updated moments ago

Sr. Application Development Engineer

Randstad Digital

•

Remote or St. Louis, Missouri, USA

Contract

job summary: Responsibilities: Code development (specific programming language expert)Issue management (bug investigation)Solution engineeringDevelop Proofs-of-ConceptCode reviewsCoach junior developersUnit testingDeployment (non-prod)Investigate / troubleshoot code-related issues Required Skills/Experience: JavaSpring BootJavaScript (VUE/ React/ Angular) (VUE preferred)Dashboard / Monitoring - Dynatrace, Splunk, Kibana, GrafanaKubernetes/ Micro-services/ Docker/ JenkinsBachelors Preferred Sk
Posted 6 days ago | Updated moments ago