Data Engineer

San Francisco, CA, US • Posted 19 hours ago • Updated 6 hours ago
Full Time
On-site
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • Sourcing
  • Advanced Analytics
  • Decision-making
  • Microsoft Excel
  • Data Architecture
  • Software Design
  • SQL
  • Data Modeling
  • Reporting
  • Artificial Intelligence
  • Performance Tuning
  • Scalability
  • Automated Testing
  • Collaboration
  • Partnership
  • Specification Gathering
  • QA Management
  • Technical Drafting
  • Documentation
  • Agile
  • Mentorship
  • Data Engineering
  • IT Management
  • Cloud Computing
  • Google Cloud Platform
  • Google Cloud
  • Extract
  • Transform
  • Load
  • ELT
  • Dimensional Modeling
  • Git
  • Version Control
  • Continuous Integration
  • Continuous Delivery
  • Communication
  • Analytical Skill
  • Conflict Resolution
  • Problem Solving
  • Workflow
  • Orchestration
  • Apache Airflow
  • Streaming
  • Apache Kafka
  • PySpark
  • Data Processing
  • Python
  • Retail
  • Supply Chain Management
  • Logistics
  • Warehouse Management
  • WMS
  • Data Governance
  • Data Quality
  • Meta-data Management
  • English
  • Law
  • Elasticsearch
  • PDF
  • Legal
  • Recruiting
  • LOS
  • Account Management

Summary

Job Title: Lead Data Engineer (Google Cloud Platform, Supply Chain & AI Data Platforms)

Role Overview
We are seeking an experienced and hands-on Lead Data Engineer to join our Enterprise Data & AI Organization. In this role, you will lead the design, development, and delivery of enterprise data products and advanced analytics solutions supporting complex supply chain, sourcing, transportation, and warehouse management (WMS) domains.

This is a technical leadership role requiring deep expertise in building modern, cloud-native data platforms on Google Cloud Platform (Google Cloud Platform). You will collaborate closely with Product Managers, Solution Architects, Data Architects, and cross-functional engineering teams to build scalable, high-quality data pipelines that power advanced analytics and AI-driven decision-making. If you excel at designing high-performance data models and driving engineering excellence, we want to hear from you.

Key Responsibilities
Data Architecture & Pipeline Development
Cloud-Native Solutions: Design, develop, and implement scalable data pipelines, architectures, and data products on Google Cloud Platform (Google Cloud Platform).
Modern Tooling: Build and optimize enterprise data solutions utilizing BigQuery, Dataproc, SQL, and dbt.
ETL/ELT Engineering: Develop efficient, robust data ingestion and transformation pipelines to integrate data across multiple enterprise operational systems.

Data Modeling & Performance Optimization
Dimensional Modeling: Design scalable data models supporting complex analytical, operational reporting, and AI requirements.
Performance Tuning: Optimize data processing performance, reliability, scalability, and cost efficiency across cloud data platforms.
Operational Reliability: Implement rigorous monitoring, automated testing, and operational best practices to support critical production workloads.

Technical Leadership & Collaboration
Cross-Functional Partnership: Work alongside Product Managers, Business Analysts, and Enterprise Architects to translate business requirements into robust technical specifications.
Code Quality: Lead technical design discussions, drive code reviews, and establish reusable engineering standards and documentation.
Team Enablement: Participate actively in Agile delivery ceremonies, contribute to backlog refinement, and mentor junior data engineering team members.

Qualifications & Requirements
Minimum Qualifications
Experience Baseline: 8+ years of professional experience in Data Engineering, featuring demonstrated technical leadership on complex enterprise data projects.
Cloud Mastery: Strong, hands-on production experience designing and deploying data solutions on Google Cloud Platform (Google Cloud Platform).
Technical Proficiency (Expert Level):
oDataproc & BigQuery
oSQL & dbt (Data Build Tool)
oModern ETL/ELT architecture principles and large-scale data processing techniques.
Engineering Best Practices: Proven experience with relational/dimensional data modeling, Git version control, and CI/CD automated deployment pipelines.
Core Competencies: Excellent verbal and written communication skills; strong analytical troubleshooting and problem-solving abilities.

Preferred Attributes
Experience with workflow orchestration frameworks (e.g., Apache Airflow) and streaming data platforms (e.g., Apache Kafka).
Working knowledge of PySpark for distributed data processing and Python for automation.
Domain experience within retail, apparel, supply chain data platforms, logistics, transportation, or Warehouse Management Systems (WMS).
Familiarity with data governance, data quality frameworks, and enterprise metadata management.

Equal Opportunity Employer / Disabled / Protected Veterans

The Know Your Rights poster is available here:
_EEOC_KnowYourRights6.12.pdf

The pay transparency policy is available here:
_%20English_formattedESQA508c.pdf

For temporary assignments lasting 13 weeks or longer, AllSTEM Connections is pleased to offer major medical, dental, vision, 401k and any statutory sick pay where required.

We are committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation for any part of the employment process, please contact your staffing representative who will reach out to our HR team.

AllSTEM Connections participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program.
_Participation_Poster_ES.pdf

We also consider for employment qualified applicants regardless of criminal histories, consistent with legal requirements, including, if applicable, the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance. Pursuant to applicable state and municipal Fair Chance Laws and Ordinances, we will consider for employment-qualified applicants with arrest and conviction records, including, if applicable, the San Francisco Fair Chance Ordinance. For Los Angeles, CA applicants: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Additional Skills

(none specified)

AllSTEM Representative Contact Info

Account Executive:

Nichols

Branch Phone:



Location:

Ontario, CA
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 80184143
  • Position Id: cf683920d4b3b45e0ec19d05694302dc
  • Posted 19 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

San Francisco, California

Today

Easy Apply

Full-time

$60 - $60 per hour

San Francisco, California

Today

Full-time

USD 166,400.00 - 208,000.00 per year

San Francisco, California

Today

Full-time

USD 187,000.00 per year

Oakland, California

Today

Full-time

USD 123,090.00 - 184,800.00 per year

Search all similar jobs