kafka engineer or data engineer Jobs in san francisco, ca

Refine Results
1 - 20 of 162 Jobs

Principle Engineer (C#, .NET and Kafka)

Infinite Computer Solutions (ICS)

Concord, California, USA

Full-time

Job Description: Job Title: Senior .NET Developer Duration: Contract / Full-Time Employment Location: Concord, CA Responsibilities: As our Principal Engineer you will demonstrate: Expert knowledge in at least one among C# / Rust environment and well-rounded experience in web technologies such as UI, HTML5, CSS and JavaScript Hands-on development utilizing OOP language Java/ C#;Sound knowledge of the .NET Core frameworkThe ability to understand the importance key business initiatives and lead ot

Data Engineer II

Strava, Inc.

San Francisco, California, USA

Full-time

About this role Strava is the leading digital community for active people with more than 120 million athletes, in more than 190 countries. The platform offers a holistic view of your active lifestyle, no matter where you live, which sport you love and/or what device you use. Everyone belongs on Strava when they are pursuing an active life. We are seeking data engineers to join our Data Platform team. Our vision is that key decisions and product at Strava can be greatly enriched with data to ben

Kafka Data Integration Engineer

New York Technology Partners

Remote

Full-time

Summary: Highly experienced Kafka Data Integration Engineer with over 7 years of hands-on experience in data engineering. Proficient in designing and operating solutions with relational databases such as Oracle, Postgres, and SQL Server. Skilled in AWS services, including AWS MSK (Amazon Managed Streaming for Apache Kafka) and primary AWS services like EC2, ELB, RDS, Route53, S3, VPC, VPN, and TGW. Self-motivated and capable of working with minimal supervision. Expertise in Kafka Connect for int

Azure Data Engineer

Talent Group

Remote

Full-time

We are seeking a skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for leveraging various Azure data services such as Azure Synapse Analytics, Apache Kafka, ADLS, and Blob Storage to build and maintain data pipelines for our Care Management Platform. This platform is designed to support health programs for provider and payer groups, such as Wipro, by ingesting, curating, and publishing data for business consumption. Key Responsibilities: Design, dev

Data Infrastructure Engineer

OpenAI

San Francisco, California, USA

Full-time

About the Team You'll join the team that's behind OpenAI's data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The systems we support include our data warehouse, batch compute infrastructure, streaming infrastructure, data orchestration system, data lake, vector databases, critical integrations, and more. About the Role The Applied Data Platform team designs, builds, and operates the foundational data infrastructure that ena

Senior Staff Software Engineer, Data and ML Platform

Discord Inc.

San Francisco, California, USA

Full-time

Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that connect our users and our employees at Discord. We are seeking an accomplished and experienced Senior Staff software Engineer to join our dynam

Data Analytics Engineer/Remote/Python/Go/ETL//Kafka/AWS

Motion Recruitment Partners, LLC

Remote or Arlington, Virginia, USA

Full-time

Job Description: Our client is an innovative tech firm specializing in advanced data analytics solutions. Established with a vision to empower businesses through data-driven insights, they offer a comprehensive suite of services tailored to meet the evolving needs of modern enterprises. With a focus on excellence and cutting-edge technology, our client strives to deliver scalable ETL operations and robust data analytics solutions to drive informed decision-making and foster sustainable growth. C

AWS Data Engineer - 14+ years consultants ONLY

Virtue Group

Remote

Contract

AWS Data Engineer *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. Looking for data engineer who has below exp.>Minimum 14+ years candidate.AWS GluePyspark expertAwsStreaming exp is MUSTAmazon Kinesis Data Streams, Apache Kafka, and Amazon Managed Streaming for Apache Kafka (Amazon MSK).

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Senior Network Software Engineer

Maxonic, Inc.

San Francisco, California, USA

Full-time

Maxonic maintains a close and long-term relationship with our direct client. In support of their needs, we are looking for a Senior Network Software Engineer Job Title: Senior Network Software Engineer Job Location: San Francisco Bay Area (Onsite - Once or Twice in a month depends on work) Duration: Full-time/ Permanent role Salary: $180K to $200K as Base salary Responsibilities: We are looking for an outstanding Senior Network Security Development Engineer to support the development and delive

Senior Kafka Engineer Contract Position - Remote

TechWish

Remote

Contract

Our sister firm is looking for a Senior Kafka Engineer for a remote contract opportunity. Pls apply if you are a suitable fit. Required Skills: 10+ years of strong hands-on knowledge and experience as a core Software Engineer. This person will need to not only edit and update existing code but also write new code in some cases as well as the project continues. 2. strong understanding of the Confluent Cloud platform with the ability to work with and implement the various connectors a. File Puls

Middleware/Kafka Engineer

Meridian Technologies, Inc.

Remote

Full-time

Meridian Technologies is currently seeking a Middleware/Kafka Engineer for the IPPS-A Army Military Pay (AMP) program to implement, configure and maintain Oracle ESB and Confluent Kafka. The client requires a five day work week. What you ll get to do: Implement, configure and maintain Oracle ESB and Confluent Kafka. Support the design of web services to support PeopleSoft HCM implementation, as well as the design, development and implementation of the messaging and stream processing architectu

Lead Application Engineer with Go, ETL, Kafka, Mongo, SQL, Agile, Gitlab 100% Remote

Zeektek

Remote

Contract

Walk me through the day to day responsibilities of this the role and a description of the project (Outside of Workday JD): This position is on the Loyalty and Rewards team. As a Lead Application Development Engineer, this position is responsible for not only their own code but also the oversight responsibilities of other developer s code as well. This position will need to o Development new and maintain existing rewards within the application. o Participate in Code Reviews. o Participate in al

Senior Staff Software Engineer, Data Platform

DoorDash

Remote or San Francisco, California, USA

Full-time

About the Team DoorDash is a data driven organization and relies on timely, accurate and reliable data to drive many business and product decisions. The Data Platform owns all the infrastructure necessary to run an operationally efficient analytical data stack. The Core Data part of this includes data ingestion (batch and real time), data compute & transformation, data storage (warehouse, data lake, OLAP etc.), querying infrastructure as well as data compliance, quality and governance. The adjac

Infrastructure Engineer - Kafka - Contract - W2 Only (no agency candidates) - Remote*

iTech Solutions

Remote or Bloomfield, Connecticut, USA

Contract

Infrastructure Engineer - Kafka* To start as REMOTE POSITION, but when in-office becomes a requirement, they would need to report to any of the client s locations - Bloomfield CT, Morris Plains NJ, Plano TX, Bloomington MN, St Louis MO. Monday-Friday, Full-time. Core Hours 8 am-5 pm EST.Duties Perform Kafka cluster build, including design, infrastructure planning, High Availability and Disaster Recovery Implementing wire encryption using SSL, authentication using SASL/LDAP & authorization using

Lead Data Engineer (Security Focus)

Iceberg

Remote

Full-time

My client is a leading innovator in financial technology and trading, dedicated to pushing the boundaries of technology to create impactful solutions. We are currently seeking a talented Lead Data Engineer with a strong background in software engineering and experience in data engineering, particularly in the realm of security. As the Lead Data Engineer with a focus on security, you will play a pivotal role in leading the development and optimization of data pipelines, tools, and products to enh

Senior Data Engineer

NTT DATA Americas, Inc

Remote or Dallas, Texas, USA

Contract

We are currently seeking a Senior Data Engineer to join our team remotely in the US. Job Description: Senior Cloud Data EngineerWe are looking to hire Senior Cloud Data Engineers with experience in building data pipelines using cloud technologies. The ideal candidate should have demonstrated experience building large-scale solutions in one or more major cloud providers - AWS, Azure, or Google Cloud Platform.Job Responsibilities: As a senior member of the team, deliver production data pipelines,