Data Engineer

San Francisco, CA, US • Posted 22 hours ago • Updated 10 hours ago
Full Time
On-site
Company Branding Image
Fitment

Dice Job Match Score™

⏳ Almost there, hang tight...

Job Details

Skills

  • Analytics
  • Decision-making
  • Reporting
  • Technical Drafting
  • Scalability
  • Testing
  • Issue Resolution
  • Continuous Improvement
  • Documentation
  • Mentorship
  • Agile
  • IT Management
  • Google Cloud Platform
  • Google Cloud
  • SQL
  • Extract
  • Transform
  • Load
  • ELT
  • Data Processing
  • Dimensional Modeling
  • Data Warehouse
  • Cloud Computing
  • Git
  • Continuous Integration
  • Continuous Delivery
  • Analytical Skill
  • Problem Solving
  • Conflict Resolution
  • Communication
  • Apache Airflow
  • Workflow
  • Orchestration
  • Apache Kafka
  • Streaming
  • PySpark
  • Python
  • Data Engineering
  • Data Quality
  • Meta-data Management
  • Retail
  • Supply Chain Management
  • Logistics
  • Warehouse Management
  • Distribution
  • Collaboration
  • Innovation
  • Artificial Intelligence

Summary

We're looking for a Lead Data Engineer to help design and deliver modern data solutions that power analytics and AI-driven decision-making across supply chain operations. This onsite opportunity in San Francisco offers the chance to work closely with cross-functional partners on scalable cloud-native data products in a fast-paced, collaborative environment.
Responsibilities
  • Design, build, and maintain scalable data pipelines and data products on Google Cloud Platform.
  • Develop and optimize enterprise data solutions using Dataproc, BigQuery, SQL, and dbt.
  • Create robust data models that support both analytical and operational reporting needs.
  • Build efficient ETL/ELT workflows to ingest, transform, and publish data from multiple systems.
  • Partner with product managers, architects, analysts, and business stakeholders to translate requirements into technical solutions.
  • Lead technical design discussions and participate in code reviews to help maintain engineering quality.
  • Improve performance, reliability, scalability, and cost efficiency across cloud-based data platforms.
  • Support production operations, including monitoring, testing, issue resolution, and continuous improvement efforts.
  • Contribute to reusable engineering standards, frameworks, and documentation.
  • Mentor team members and collaborate within Agile delivery teams.
Skills
  • 8+ years of experience in data engineering, including technical leadership on enterprise initiatives.
  • Strong hands-on experience with Google Cloud Platform.
  • Advanced proficiency with Dataproc, BigQuery, SQL, and dbt.
  • Solid understanding of modern ETL/ELT architecture and large-scale data processing.
  • Experience with dimensional modeling, normalized models, and data warehouse design.
  • Ability to design cloud-native pipelines that are scalable and maintainable.
  • Experience working with Git, CI/CD pipelines, and engineering best practices.
  • Strong troubleshooting, analytical thinking, and problem-solving skills.
  • Clear communication skills and the ability to work effectively across teams.
Preferred Skills
  • Experience with Apache Airflow for workflow orchestration.
  • Exposure to Kafka or other streaming technologies.
  • Working knowledge of PySpark for distributed processing.
  • Proficiency in Python for automation and data engineering support.
  • Familiarity with data quality, metadata management, and governance practices.
  • Background in retail, supply chain, transportation, logistics, or warehouse management systems.
  • Experience supporting distribution center operations.

Horizontal is committed to building an inclusive workplace where diverse perspectives are valued, respected, and supported. We welcome candidates from all backgrounds and encourage individuals who are passionate about collaboration, innovation, and equitable opportunities to apply.

By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10123528
  • Position Id: 75476
  • Posted 22 hours ago

Company Info

About Horizontal Talent

Horizontal Integration offers two service lines. Our staffing agency places IT, digital and creative talent in both contract and permanent roles. Our digital agency provides digital marketing strategy and technology consulting on a project basis. Many of our clients take advantage of both service lines.

We are a certified Minority Business Enterprise, with more than 200 employees across our offices in Minneapolis, Denver, Dallas and Vadodara, India. We ve been consistently growing and profitable since the company was founded in 2003.

Honors:
Recognized as a "2009 Best Place to Work" by Minneapolis/St.Paul Business Journal.

Fact:
Our people and our organization are deeply rooted in IT and interactive marketing.

Horizontal is proud to be an Equal Opportunity and Affirmative Action Employer. We seek to provide employment opportunities to talented, qualified candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status, or any other protected classification under federal, state or local law.

In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact us. All applicants applying must be legally authorized to work in the country of employment.

About_Company_OneAbout_Company_Two
Contact the job poster
KA

KP Aishwarya

Recruiter @ Horizontal Talent
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

San Francisco, California

Today

Full-time

San Francisco, California

Today

Full-time

San Francisco, California

Today

Full-time

Compensation information provided in the description

Houston, Texas

Today

Full-time

Search all similar jobs