Lakehouse jobs in San Francisco, CA

Remote

•

8d ago

Job Title: AWS Lakehouse Data Engineer Work Model: Remote offsite Responsibilities Build and operate data pipelines (batch and streaming) from APIs, relational databases, file drops, event streams, and external partners. Design, implement, test, and optimize ETL/ELT pipelines using Python and PySpark to produce analytics-ready datasets for reporting, visualization, and machine learning. Implement incremental processing, change data capture (CDC), data contracts, schema validation, and reusable

Easy Apply

Contract

Depends on Experience

Senior Software Engineer, Backend (Lakehouse Infra)

Remote

•

Today

At Affirm, we exist for the moments that matter-giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. The Data and Storage Services team is responsible for Affirm's data infrastructure across OLTP and OLAP systems, spanning critical online checkout databases, batch orchestration, streaming infrastructure, event-driven frameworks, BI, analytics tooling, large-scale data platforms, and agentic data tools such as semantic

Full-time

USD 195,000.00 - 255,000.00 per year

AWS Lakehouse Data Engineer

Remote

•

Today

Job Family: Software Development & Support Travel Required: None Clearance Required: Ability to Obtain Public Trust AWS Lakehouse Data Engineer We are seeking an AWS Lakehouse Data Engineer to design, implement, and operate the cloud-native data platform that powers AI/ML, analytics, reporting, and data visualization. You will build a modern lakehouse on Amazon S3 using AWS-native services and open table formats, providing Databricks-like capabilities while maintaining portability, strong go

Full-time

USD 113,000.00 - 188,000.00 per year

Databricks Architect

Remote

•

10d ago

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Specialist Advisor to join our team in Arlington, Virginia (US-VA), United States (US). Job Description: Business Hours Core U.S. business hours; overlap with EU stakeholders as needed Role Type Front-facing techno-functional Databricks architecture & da

Easy Apply

Third Party, Contract

Depends on Experience

Microsoft Fabric Data Architect

Remote

•

17d ago

Microsoft Fabric Data Architect (DataStage to Fabric Migration) 100% Remote Contract Opportunity About the role: The client is looking for a hands-on Data Architect to lead the migration of an existing IBM DataStage ETL estate to Microsoft Fabric. The architect will own the target-state design, the migration approach, and delivery guidance for the engineering team, from assessment through cutover. Key responsibilities: Assess the current DataStage landscape, including jobs, sequences, transforme

Easy Apply

Contract

Depends on Experience

Senior Data Architect / AI Data Architect

Remote

•

Today

Role: Senior Data Architect / AI Data Architect Experience: 15+ years preferred, with strong hands-on experience in cloud data engineering and AI integration Location: Remote Employment Type: Contract Mandatory Skills : Claude AI & Claude AI-Native Development Job Summary We are seeking an experienced Senior Data Architect with strong expertise in Microsoft Azure, Claude AI, Claude AI-native application development, Data bricks, and modern cloud data platforms. The ideal candidate will design

Easy Apply

Contract

Depends on Experience

Senior Data bricks Architect Security Data Platform

Remote

•

Today

Senior Data bricks Architect Security Data Platform Location: Remote Duration: Long-Term Contract Industry: Pharmaceutical / Life Sciences Role Type: Senior Architect / Technical Leadership 15 20+ years in data engineering/data architecture, with 5+ years of hands-on Databricks experience and 3+ years leading engineering teams. Has architected enterprise Databricks Lakehouse platforms using Spark, PySpark, Delta Lake, Unity Catalog, Python and SQL across Azure/AWS/Google Cloud Platform. Experien

Easy Apply

Contract

$70 - $80

Data Architect - Healthcare / No C2C

Remote

•

Today

Role: Senior Data Architect & SME Location: USA (Remote) Domain: Healthcare Data platforms, Medicaid/T-MSIS Domain expertise Duration: 4 months (possibility of extension) Role Summary Senior architecture role focused on modern healthcare data platforms, Medicaid/T-MSIS domain expertise, and large-scale modernization using AWS Databricks. Roles & Responsibilities Define scalable data architecture patterns using AWS Databricks, PySpark, Spark SQL, Delta Lake, and lakehouse / medallion architectur

Easy Apply

Contract

Depends on Experience

Databricks Architect / Resident Solution Architect

Remote or Hybrid in San Francisco, California

•

23d ago

Job Title: Databricks Architect / Resident Solution Architect Openings: 2 Location: San Francisco, CA Local preferred; Remote considered Work Hours: Must be able to work PST hours Duration: 812 Months Visa: Any Rate: flexible Industry: Banking / Financial Services Experience: 1215+ Years Job DescriptionWe are looking for a highly experienced Databricks Architect / Resident Solution Architect with strong hands-on Data Engineering and Databricks architecture experience. The ideal candidate should

Easy Apply

Contract

Depends on Experience

AWS Data Architect with Salesforce cloud

Alameda, California

•

8d ago

Job Title: AWS Data Architect with Salesforce cloud 1015 Years, Locals Preferred Visa - , GC Last round Face to face, Alameda or Santa Clara Work Location: Candidate should go to the Exelixis office 4 days a week or as per customer expectation. Primary (Must-Have) Skills 13+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation.6+ years of hands-on experience in AWS data

Easy Apply

Full-time

150,000 - 160,000

Resident Solution Architect (Databricks)

Remote or San Francisco, California

•

23d ago

Job Summary:We are seeking a Senior Solution Architect to join our Databricks Practice and play a pivotal role in shaping data modernization journeys for enterprise customers. This is a customer-facing, consulting-oriented role where you will engage with CDOs, Data Architects, and Engineering leaders to design and deliver scalable, future-ready Lakehouse solutions on the Databricks Data Intelligence Platform.You will be the trusted technical advisor translating business problems into architectu

Easy Apply

Contract

70 - 80

Data Engineer (Snowflake)

Hybrid in Dublin, California

•

Yesterday

Data Engineer 6 months contract to start, extension/conversion Dublin CA 2 days a week onsite hybrid Local candidate who can be onsite at least 2 day/week ideal 7 yrs IT exp, 5+ atleast in data platforms (7-10 YOE is ideal, nothing over 15 YOE) Snowflake: MUSTAzure: MUSTPython: MUSTSQL: MUST, including complex/advanced SQL JD: The role is focused on platform engineering, including platform management, monitoring, performance optimization, production support, automation, and cost management, w

Easy Apply

Contract

60 - 65

MLOps Engineer

Emeryville, California

•

Today

Atomic Machines is building the Matter Compiler , the first in a new class of AI-native, all-digital manufacturing systems that build working machines directly from code. The Matter Compiler is aimed at micro-machines: motors and gears the size of a grain of sand, robots small enough to work inside the body, cooling built directly into the chips that run AI, and the many devices like them that have been waiting on a way to build them. Its first product is PrimeSwitch , an electromechanical powe

Full-time

USD 200,000.00 - 250,000.00 per year

AWS Data Architect (FTE)

Alameda, California

•

Today

Job Title: AWS Data Architect Location: Location: Alameda, CA Full Time Role Must Have: 1). 15+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation 2). 6+ years of hands-on experience in AWS data architecture, including Amazon S3, AWS Glue, Redshift, Athena, Lambda, EMR, Lake Formation, Kinesis, and RDS with strong understanding of cloud-native data patterns & SQL deve

Easy Apply

Full-time

$140,000 - $150,000

Data Lead Engineer

Fremont, California

•

6d ago

Job Title: Data Engineer (Lead/Sr.) Location: Fremont, CA (Onsite) Core Skills: Databricks, Apache Spark, PySpark, SQL, Spark SQL, ETL, ELT, API Integration, Data Warehousing, Schema Design, Dimensional Modeling, Medallion Architecture. Lead Data Engineer with strong expertise in Databricks, Apache Spark, PySpark, SQL, and ETL/ELT development. The ideal candidate will lead the design and development of scalable data pipelines, work with structured and unstructured data, and implement robust dat

Easy Apply

Contract

Depends on Experience

AWS Data Architect

Alameda, California

•

Today

Job Title: AWS Data ArchitectLocation: Alameda, CADuration: FTEEducational Qualification*Any Bachelor's DegreeExperience Range13-20 YearsPrimary (Must have skills)* - To be Screened by TA Team1). 15+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation 2). 6+ years of hands-on experience in AWS data architecture, including Amazon S3, AWS Glue, Redshift, Athena, Lambda, E

Easy Apply

Full-time, Third Party

Depends on Experience

Senior Data Architect

Hybrid in Oakland, California

•

9d ago

Senior Data ArchitectLocation:Oakland, CA or Rancho Cordova, CA(Onsite required 2 days per week )Contract:6+ Month (contract to hire)Job Description:The Senior Data Architect will design and implement scalable data solutions using the latest and advanced technology and toolsets. This role offers the right candidate the rare opportunity to leverage their extensive background to design and architect scalable, secure, and modern cloud-native data solutions. The role will also be responsible for wor

Easy Apply

Contract

75 - 80

Senior Software Engineer, Field Software

San Francisco, California

•

Today

About Gridware Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid. We pioneered a groundbreaking new class of grid management called active grid response (AGR), focused on monitoring the electrical, physical, and environmental aspects of the grid that affect reliability and safety. Gridware's advanced Active Grid Response platform uses high-precision sensors to detect potential issues early, enabling proactive maintenance and fault mit

Full-time

USD 190,000.00 - 220,000.00 per year

AWS Data Architect

Alameda, California

•

7d ago

Job Title: AWS Data Architect Location: Alameda, CA Duration: FTE **Experience Range: 13-20 yearsPrimary (Must have skills)* - To be Screened by TA Team**1). 15+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation2). 6+ years of hands-on experience in AWS data architecture, including Amazon S3, AWS Glue, Redshift, Athena, Lambda, EMR, Lake Formation, Kinesis, and RDS wi

Easy Apply

Full-time

$60,000 - $80,000

Urgent Hire || AWS Data Architect || Alameda, CA

Alameda, California

•

9d ago

Job Description: TitleAWS Data Architect location Alameda, CA TypeFull TimeEducational Qualification* Any Bachelor's Degree Experience Range 13-20 Years Primary (Must have skills)* - To be Screened by TA Team 1). 15+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end data solution design, architecture, and enterprise data platform implementation 2). 6+ years of hands-on experience in AWS data architecture, including Amazon S3, AWS Glue,

Easy Apply

Full-time, Third Party

Depends on Experience

Lakehouse jobs in San Francisco, CA, USA