bigdata engineer Jobs in san francisco, ca

Refine Results
21 - 40 of 256 Jobs

Sr. LLM/AI/ML Engineer with Prompt Engineering

Critical River, Inc.

San Francisco, California, USA

Full-time

Hi, I Hope you are doing good..!! Title: Sr. LLM/AI/ML Engineer with Prompt Engineering Location: Bay Area California (Hybrid) Duration: Fulltime with CR Years of Experience: 5-10 Job Profile Senior LLM Engineer with a focus on Prompt Engineering to join our team. This role involves developing and optimizing large language models (LLMs), with a particular emphasis on creating and refining conversation prompts to enhance AI interactions. The ideal candidate will have extensive experience in deep

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin

Data Engineer

BayOne Solutions

San Bruno, California, USA

Contract

Job Title: Data Engineer Location: San Bruno, CA (Hybrid) Duration: 6+ months with possible ext. Description: Designs, develops, and implements Hadoop eco-system based applications to support business requirements.Follows approved life cycle methodologies, creates design documents, and performs program coding and testing.Resolves technical issues through debugging, research, and investigation. Experience/Skills Required: Bachelor s degree in Computer Science, Information Technology, or related

Engineering Manager, Data Mobility Frameworks

DoorDash

San Francisco, California, USA

Full-time

About the Team DoorDash is a data driven organization and relies on timely, accurate and reliable data to drive many business and product decisions. The Data Platform org owns all the infrastructure necessary to run an operationally efficient analytical data stack. The Data Mobility Frameworks team aims to provide a scalable and reliable compute framework layer capable of processing trillions of data points per day. This framework is essential for enabling timely business-critical decision-makin

Machine Learning Engineer

Perplexity AI

San Francisco, California, USA

Full-time

Perplexity is building the next generation answer engine, empowering our users to find information in new and more effective ways. Perplexity applies LLMs for knowledge search at scale, serving millions of users across the world. In pursuit of this mission, we are looking for engineers to build recommendation systems for a more engaging, easier to use product. You will be part of a dynamic team dedicated to pushing the boundaries of what's possible with machine learning, particularly in the real

Sr. Staff Machine Learning Engineer, Content Quality - Trust Engineering

Pinterest, Inc.

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the

Staff Software Engineer, Batch & Stream Processing

Pinterest, Inc.

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the

Sr. Staff Software Engineer, Batch & Stream Processing

Pinterest, Inc.

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the

Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the

Sr. Machine Learning Engineer, Core Engineering & Monetization Engineering

Pinterest, Inc.

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the

Senior Software Engineer - ModBus, DNP3, .NET [REMOTE]

Technology Navigators

Remote

Full-time

No sponsorship. No third-party/C2C candidates. Senior Software Engineer C#, .NET Core, PostGres, Modbus, DNP3 REMOTE, must reside in Texas Salary: 120-135K DOE Benefits: Medical, Dental, and Vision Insurance, Flexible Spending Account, Long and Short term Disability, 401K Match, Unlimited PTO *This is an exclusive, off-market opportunity. Our client searches are confidential.* Apply now to learn more about this unique new position! What you get to do: Operate independently in a distributed team

Staff Software Engineer, Content Quality, Signal Lifecycle TL

Pinterest, Inc.

San Francisco, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the

Staff Software Engineer - Algorithmic Pricing

Uber Corporate

San Francisco, California, USA

Full-time

About the Role At Uber, we are revolutionizing the way people move through our cities. Our Driver Pricing team plays a critical role in this mission by developing and refining the algorithms that determine pricing for our drivers. As a Staff Software Engineer, you will be at the forefront of this innovation, leveraging your expertise in algorithms, optimization, and machine learning to create solutions that balance the needs of drivers, riders, and Uber's business objectives. This role offers

Python - Big Data

Kforce Technology Staffing

Remote or Fremont, California, USA

Third Party, Contract

RESPONSIBILITIES: Come and join the Kforce Family! We are looking for a Senior Python Developer to join a well know client in the California Bay area. Summary: This role requires partnering continuously with many stakeholders and global teams daily to stay focused on common goals. This includes coordinating with internal and external teams (onsite/offshore) as necessary. REQUIREMENTS: * Advanced Level experience (at least 8+ years) with Python programming language handling Big Data * Experienc

Data Engineer- Azure

BayOne Solutions

Fremont, California, USA

Third Party, Contract

Role: Azure / Data Engineer Location: Fremont, CA Duration: Long Term Contract Its a Hybrid Role and need to be Onsite 2 Days a Week Looking for someone Local to Fremont, California only Must have Skills : 1. Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms. 2. 10 + years of proven experience with SQL, schema design and

Computer Vision/Machine Learning Engineer

INSPYR Solutions

San Francisco, California, USA

Contract

Computer Vision/Machine Learning Engineer - Long Term Project - Remote based in SF/Bay Area, CA. Title: Computer Vision/Machine Learning Engineer Location: Remote based in SF/Bay Area, CA. Duration: Long Term Project Compensation: $80-100/hr. Work Requirements: , Holders or Authorized to Work in the US Qualified candidates may send a copy of their resume (Word Format) to Description/Comment: The vision of the Machine Learning (ML) Engineering team is to drive and enable ML usage across several

Sr Scala Developer

TechLink Resources

Remote

Contract

NO H-1B ONLY W2 1. looking for hands-on developers at the moment, not Architect. Must be passionate about Scala programing. 2. OOD programming background is important, but should be big data related 3. Data analyst, data scientist and researcher are NOT the right candidates Responsibilities: Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs Build next-gen cloud based big data infrastructure f

Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Overview: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will possess a Bachelor's degree in Computer Science, along with a minimum of 5 years of related experience. strong communication skills are essential, as the role involves collaborating with various teams and stakeholders. The candidate should have a proven track record of developing and optimizing ETL processes, designing Enterprise Data Warehouses, and implementing Analy

Sr. Manager, Machine Learning - Homefeed Candidate Generation

Pinterest, Inc.

Palo Alto, California, USA

Full-time

About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It's where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you'll be challenged to take on work that upholds this mission and pushes Pinterest forward. You'll grow as a person and leader in your field, all the while helping Pinners make their lives better in the

Google Cloud Platform Data Engineer

ASCII Group LLC

Remote

Contract

I have a urgent requirement for the Principle Google Cloud Platform Data Engineer role. Please find the below mentioned job description and let me know if you re interested for the same. Position: Principle Google Cloud Platform Data Engineer Location: Remote Duration: W2 Job Description: Data Engineering Requirement Google Cloud PlatformBigQueryDataflow (Apache Beam)Cloud Composer (Airflow)GCSGKEDataform (Optional to dbt) Programming SQLPythonJava (Optional) Tools dbt / Dataform(On Google Clo