Apply Now

Lead Data Engineer

Hybrid in San Francisco, CA, US • Posted 2 days ago • Updated 2 days ago

Contract Corp To Corp

Contract Independent

Contract W2

Hybrid

$105/hr

Akidev Corporation

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

SQL
Databricks
ADF
Data stage
ETL Tools
Tableau

Summary

Position - Lead Data Engineer
Location - San Francisco, CA

Main Skills - SQL, Databricks, ADF, Datastage (or other ETL tool), SSAS cubes, Cognos/other, Tableau/other, Thoughtspot/other

Job Description
We are seeking a Lead Data Engineer to design, implement, and maintain our data infrastructure and business intelligence solutions. This role requires a technical expert who can architect scalable data solutions while collaborating across teams to drive business insights.

Required Experience

8-10 years of software development and deployment experience
At least 7 years of hands-on experience with:
- SQL
- Databricks
- Azure Data Factory (ADF)
- Datastage (or other ETL tools)
- SSAS cubes
- BI tools (Cognos, Tableau, ThoughtSpot, etc.)
Strong Database knowledge (SQL & No-SQL preferred)
Advanced SQL and Python skills
Experience working with APIs for data collection/ingestion

Key Responsibilities
Technical Development

Write SQL for processing raw data, Kafka ingestions, ADF pipelines, data validation, and QA
Lead, design and implement innovative analytical solutions using Tableau, SQL, and Big Data technologies
Experience with storing, joining, filtering, and analyzing data using SQL, Spark, Hive, etc.

Data Architecture & Design

Design comprehensive data architecture and data modeling strategies for BI systems
Create logical and physical data models using best practices to ensure high data quality and reduced redundancy
Collaborate with stakeholders to translate business requirements into robust, scalable data models
Perform detailed analysis of business problems and technical environments to design quality solutions

Integration & Implementation

Integrate data from various sources (databases, warehouses, external systems)
Develop strategies for ETL processes ensuring data accuracy, consistency, and availability
Evaluate and select appropriate BI tools based on organizational needs
Run POCs and implement BI software, including visualization tools and analytics solutions

Optimization & Governance

Monitor and optimize BI system performance for efficient data retrieval, processing, and reporting
Identify and resolve performance bottlenecks through query tuning and data structure optimization
Establish data governance policies ensuring data quality, consistency, and security
Define access controls, privacy measures, and retention policies to meet regulatory requirements

Collaboration & Leadership

Build partnerships with architects, technical leads, and stakeholders across functional groups
Actively participate in code reviews and testing to ensure adherence to best practices
Work with product and engineering teams to evaluate requirements and new features
Build and foster a high-performance engineering culture
Mentor team members and provide tools and motivation for success

Additional Skills & Requirements

Experience building data ingestion pipelines and data warehouse architecture
Ability to write design documentation, source-to-target mapping documentation, and manage Confluence pages
Experience converting business functionalities into technical Jira stories
Strong experience with data modeling, design patterns, and building scalable BI solutions
Knowledge of cloud platforms (Azure, AWS or equivalent)
Experience analyzing large datasets to identify trends, patterns, and outliers

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10485492
Position Id: 26-00112
Posted 2 days ago

Company Info

About Akidev Corporation

Akidev Corporation is one of Silicon Valley’s leading technology services organizations, specializing in AI consulting, CRM Implementations, Application Integration and outsourcing services. We combine these capabilities to deliver tailored solutions that help our clients achieve their business goals efficiently.

We proudly work with some of the "The Magnificent Seven" companies as their direct partners — not tied up with layers or intermediaries. This gives our teams unique opportunities to collaborate on cutting-edge projects in AI, Full Stack, Cloud, and Mobile technologies, while ensuring our clients receive world-class service with speed and transparency.

At Akidev, people come first. Our culture is built on measurable client satisfaction and employee empowerment. Every team member contributes to delivering innovation, integrity, and excellence, making Akidev a trusted partner for global enterprises and a rewarding workplace for top talent. We believe that our deeply ingrained value system has helped us win multiple customers.

We’re continually on the lookout for outstanding talent to become part of our growing team

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Lead Data Engineer - Only W2

San Francisco, California

•

Today

Role: Lead Data Engineer Location: San Francisco, CA (1-2 days a week onsite is must) Job Type: W2 Contract Contract Length: 9 months with possible extension Experience Level: Senior/Lead Main Skills: SQL, Databricks, ADF, DataStage (or other ETL tool), SSAS cubes, Cognos/other, Tableau/other, Thoughtspot/other Required Experience: 8-10 years of software development and deployment experience At least 7 years of hands-on experience with: SQL Databricks Azure Data Factory (ADF) Datastage (or other

Easy Apply

Contract

Lead Data Engineer

Hybrid in San Francisco, California

•

Yesterday

Position: Lead Data Engineer Location: San Francisco, CA - Hybrid Duration: 9+Months with possible extension Main skills: SQL, Databricks, ADF, DataStage (or other ETL tool), SSAS cubes, Cognos/other, Tableau/other, ThoughtSpot Job Description: We are seeking a Lead Data Engineer to design, implement, and maintain our data infrastructure and business intelligence solutions. This role requires a technical expert who can architect scalable data solutions while collaborating across teams to drive b

Easy Apply

Contract

Depends on Experience

Lead Data Engineer to San Francisco, CA (Hybrid) - Local to CA Only

Hybrid in San Francisco, California

•

27d ago

ROLE: DATA ENGINEER LEAD (EDW to DATABRICKS MIGRATION) LOCATION: SAN FRANCISCO, CA (HYBRID) Final Interview will be F2F in client office. JOB OVERVIEW: Seeking a highly experienced Senior Data Engineer to support a large-scale enterprise data warehouse modernization initiative. The role focuses on migrating a 20-year-old SQL-based EDW environment to Databricks, involving deep analysis of legacy ETL pipelines, data models, and reporting dependencies. This is not a lift-and-shift migration the wor

Easy Apply

Contract, Third Party

Depends on Experience

Data Architect (AWS, Salesforce, Tableau, Analystics)

Alameda, California

•

14d ago

Job Description: We are seeking a highly skilled AWS Data Architect with strong experience in Salesforce and Tableau integration to design, develop, and maintain scalable data pipelines and analytics solutions. The ideal candidate will work closely with business stakeholders, data teams, and CRM teams to ensure seamless data flow, reporting, and insights generation. Skills / Experience Minimum 10+ years of overall IT experience, with 8+ years in Data Engineering & Analytics, including end-to-end

Easy Apply

Contract

Depends on Experience

Search all similar jobs