Lakehouse jobs in san francisco, ca

Remote

•

9d ago

Job Title: AWS Lakehouse Data Engineer Work Model: Remote offsite Responsibilities Build and operate data pipelines (batch and streaming) from APIs, relational databases, file drops, event streams, and external partners. Design, implement, test, and optimize ETL/ELT pipelines using Python and PySpark to produce analytics-ready datasets for reporting, visualization, and machine learning. Implement incremental processing, change data capture (CDC), data contracts, schema validation, and reusable

Easy Apply

Contract

Depends on Experience

Senior Software Engineer, Backend (Lakehouse Infra)

Remote

•

Today

At Affirm, we exist for the moments that matter-giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. The Data and Storage Services team is responsible for Affirm's data infrastructure across OLTP and OLAP systems, spanning critical online checkout databases, batch orchestration, streaming infrastructure, event-driven frameworks, BI, analytics tooling, large-scale data platforms, and agentic data tools such as semantic

Full-time

USD 195,000.00 - 255,000.00 per year

AWS Lakehouse Data Engineer

Remote

•

Today

Job Family: Software Development & Support Travel Required: None Clearance Required: Ability to Obtain Public Trust AWS Lakehouse Data Engineer We are seeking an AWS Lakehouse Data Engineer to design, implement, and operate the cloud-native data platform that powers AI/ML, analytics, reporting, and data visualization. You will build a modern lakehouse on Amazon S3 using AWS-native services and open table formats, providing Databricks-like capabilities while maintaining portability, strong go

Full-time

USD 113,000.00 - 188,000.00 per year

Databricks Architect

Remote

•

10d ago

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Specialist Advisor to join our team in Arlington, Virginia (US-VA), United States (US). Job Description: Business Hours Core U.S. business hours; overlap with EU stakeholders as needed Role Type Front-facing techno-functional Databricks architecture & da

Easy Apply

Third Party, Contract

Depends on Experience

Microsoft Fabric Data Architect

Remote

•

17d ago

Microsoft Fabric Data Architect (DataStage to Fabric Migration) 100% Remote Contract Opportunity About the role: The client is looking for a hands-on Data Architect to lead the migration of an existing IBM DataStage ETL estate to Microsoft Fabric. The architect will own the target-state design, the migration approach, and delivery guidance for the engineering team, from assessment through cutover. Key responsibilities: Assess the current DataStage landscape, including jobs, sequences, transforme

Easy Apply

Contract

Depends on Experience

Senior Data Architect / AI Data Architect

Remote

•

Today

Role: Senior Data Architect / AI Data Architect Experience: 15+ years preferred, with strong hands-on experience in cloud data engineering and AI integration Location: Remote Employment Type: Contract Mandatory Skills : Claude AI & Claude AI-Native Development Job Summary We are seeking an experienced Senior Data Architect with strong expertise in Microsoft Azure, Claude AI, Claude AI-native application development, Data bricks, and modern cloud data platforms. The ideal candidate will design

Easy Apply

Contract

Depends on Experience

Senior Data bricks Architect Security Data Platform

Remote

•

Today

Senior Data bricks Architect Security Data Platform Location: Remote Duration: Long-Term Contract Industry: Pharmaceutical / Life Sciences Role Type: Senior Architect / Technical Leadership 15 20+ years in data engineering/data architecture, with 5+ years of hands-on Databricks experience and 3+ years leading engineering teams. Has architected enterprise Databricks Lakehouse platforms using Spark, PySpark, Delta Lake, Unity Catalog, Python and SQL across Azure/AWS/Google Cloud Platform. Experien

Easy Apply

Contract

$70 - $80

Databricks Architect / Resident Solution Architect

Remote or Hybrid in San Francisco, California

•

23d ago

Job Title: Databricks Architect / Resident Solution Architect Openings: 2 Location: San Francisco, CA Local preferred; Remote considered Work Hours: Must be able to work PST hours Duration: 812 Months Visa: Any Rate: flexible Industry: Banking / Financial Services Experience: 1215+ Years Job DescriptionWe are looking for a highly experienced Databricks Architect / Resident Solution Architect with strong hands-on Data Engineering and Databricks architecture experience. The ideal candidate should

Easy Apply

Contract

Depends on Experience

Data Engineer (Snowflake)

Hybrid in Dublin, California

•

Yesterday

Data Engineer 6 months contract to start, extension/conversion Dublin CA 2 days a week onsite hybrid Local candidate who can be onsite at least 2 day/week ideal 7 yrs IT exp, 5+ atleast in data platforms (7-10 YOE is ideal, nothing over 15 YOE) Snowflake: MUSTAzure: MUSTPython: MUSTSQL: MUST, including complex/advanced SQL JD: The role is focused on platform engineering, including platform management, monitoring, performance optimization, production support, automation, and cost management, w

Easy Apply

Contract

60 - 65

MLOps Engineer

Emeryville, California

•

Today

Atomic Machines is building the Matter Compiler , the first in a new class of AI-native, all-digital manufacturing systems that build working machines directly from code. The Matter Compiler is aimed at micro-machines: motors and gears the size of a grain of sand, robots small enough to work inside the body, cooling built directly into the chips that run AI, and the many devices like them that have been waiting on a way to build them. Its first product is PrimeSwitch , an electromechanical powe

Full-time

USD 200,000.00 - 250,000.00 per year

AWS Data Architect (FTE)

Alameda, California

•

Today

Job Title: AWS Data Architect Location: Location: Alameda, CA Full Time Role Must Have: 1). 15+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation 2). 6+ years of hands-on experience in AWS data architecture, including Amazon S3, AWS Glue, Redshift, Athena, Lambda, EMR, Lake Formation, Kinesis, and RDS with strong understanding of cloud-native data patterns & SQL deve

Easy Apply

Full-time

$140,000 - $150,000

Data Lead Engineer

Fremont, California

•

6d ago

Job Title: Data Engineer (Lead/Sr.) Location: Fremont, CA (Onsite) Core Skills: Databricks, Apache Spark, PySpark, SQL, Spark SQL, ETL, ELT, API Integration, Data Warehousing, Schema Design, Dimensional Modeling, Medallion Architecture. Lead Data Engineer with strong expertise in Databricks, Apache Spark, PySpark, SQL, and ETL/ELT development. The ideal candidate will lead the design and development of scalable data pipelines, work with structured and unstructured data, and implement robust dat

Easy Apply

Contract

Depends on Experience

AWS Data Architect

Alameda, California

•

7d ago

Job Title: AWS Data Architect Location: Alameda, CA Duration: FTE **Experience Range: 13-20 yearsPrimary (Must have skills)* - To be Screened by TA Team**1). 15+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation2). 6+ years of hands-on experience in AWS data architecture, including Amazon S3, AWS Glue, Redshift, Athena, Lambda, EMR, Lake Formation, Kinesis, and RDS wi

Easy Apply

Full-time

$60,000 - $80,000

Senior Data Architect

Hybrid in Oakland, California

•

9d ago

Senior Data ArchitectLocation:Oakland, CA or Rancho Cordova, CA(Onsite required 2 days per week )Contract:6+ Month (contract to hire)Job Description:The Senior Data Architect will design and implement scalable data solutions using the latest and advanced technology and toolsets. This role offers the right candidate the rare opportunity to leverage their extensive background to design and architect scalable, secure, and modern cloud-native data solutions. The role will also be responsible for wor

Easy Apply

Contract

75 - 80

Senior Software Engineer, Field Software

San Francisco, California

•

Today

About Gridware Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid. We pioneered a groundbreaking new class of grid management called active grid response (AGR), focused on monitoring the electrical, physical, and environmental aspects of the grid that affect reliability and safety. Gridware's advanced Active Grid Response platform uses high-precision sensors to detect potential issues early, enabling proactive maintenance and fault mit

Full-time

USD 190,000.00 - 220,000.00 per year

AWS Data Architect

Alameda, California

•

Today

Job Title: AWS Data ArchitectLocation: Alameda, CADuration: FTEEducational Qualification*Any Bachelor's DegreeExperience Range13-20 YearsPrimary (Must have skills)* - To be Screened by TA Team1). 15+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation 2). 6+ years of hands-on experience in AWS data architecture, including Amazon S3, AWS Glue, Redshift, Athena, Lambda, E

Easy Apply

Full-time, Third Party

Depends on Experience

Urgent Hire || AWS Data Architect || Alameda, CA

Alameda, California

•

9d ago

Job Description: TitleAWS Data Architect location Alameda, CA TypeFull TimeEducational Qualification* Any Bachelor's Degree Experience Range 13-20 Years Primary (Must have skills)* - To be Screened by TA Team 1). 15+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation 2). 6+ years of hands-on experience in AWS data architecture, including Amazon S3, AWS Glue,

Easy Apply

Full-time, Third Party

Depends on Experience

Senior Data Architect

Hybrid in San Francisco, California

•

Today

Job Description The Senior Data Architect will design and implement scalable data solutions using the latest and advanced technology and toolsets. This role offers the right candidate the rare opportunity to leverage their extensive background to design and architect scalable, secure, and modern cloud-native data solutions. The role will also be responsible for working closely with business partners and IT leadership to understand the organization's business requirements and work with the broade

Easy Apply

Contract

70 - 75

Director of Engineering, Data

San Francisco, California

•

Today

Full-time

USD 260,000.00 - 280,000.00 per year

Principal Data Platform Architect

Menlo Park, California

•

Today

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset - who ra

Full-time

USD 189,000.00 - 248,062.00 per year

Lakehouse jobs in San Francisco, CA, USA