Search Jobs | Dice.com

Job Details

Skills

AWS Cloud
Data Architecture
Data Modeling
ETL/ELT Pipeline Development
Data Mesh Architecture
Terraform
CI/CD Pipelines
DevSecOps
Git
Data Integration
Data engineer
AWS
Cloud

Summary

Job Title:	AWS Cloud Data Engineer
Duration:	18 Months
Location:	San Francisco, CA

Job Description:

We are seeking an experienced Lead Cloud Data Engineer to design and modernize enterprise-scale data platforms using AWS, Data Mesh architecture, and AI-driven solutions. This role will lead the development of scalable data pipelines, cloud infrastructure, and AI-enabled engineering practices while mentoring technical teams and supporting enterprise data modernization initiatives.

Job Responsibilities:

Design, build, and maintain scalable ETL/ELT data pipelines using AWS services (Glue, EMR, Lambda, Kinesis, Step Functions).
Develop and implement Data Mesh architecture with domain-driven data products and federated governance.
Build modern cloud data platforms using Databricks, Delta Lake, Starburst/Trino, Collibra, and Immuta.
Implement data governance, metadata management, data lineage, and automated data quality frameworks.
Develop reusable frameworks and self-service tools for data publishing and consumption.
Integrate DevSecOps practices including CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), and security automation.
Design AI-powered solutions, RAG pipelines, and agentic AI applications using Amazon Bedrock or similar LLM platforms.
Provide technical leadership, mentor engineering teams, and support L3 production issues.
Collaborate with business stakeholders to translate requirements into scalable cloud data solutions.
Lead architecture reviews, technical documentation, and performance optimization initiatives.

Basic Qualifications:

7+ years of experience in Data Engineering, Cloud Data Platforms, or Data Architecture.
Strong hands-on experience with AWS services including S3, Glue, EMR, Redshift, Lake Formation, Lambda, and Kinesis.
Experience implementing Data Mesh architecture and modern data platforms using Databricks, Delta Lake, Starburst/Trino, Collibra, or Immuta.
Proficiency in DevSecOps, CI/CD, Terraform/CloudFormation, Docker, and AI technologies such as Amazon Bedrock, RAG, or Generative AI.

Additional Information:

Lead-level position requiring the ability to work independently with minimal supervision.
Experience working in hybrid cloud and on-premises enterprise environments is highly preferred.
Strong communication, leadership, and mentoring skills are essential.
Candidates with experience supporting government or regulated AWS environments (GovCloud) are highly preferred.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10123373
Position Id: PY/2056
Posted 15 days ago

Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

San Francisco, California

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Lead Cloud Data Engineer - Data Mesh & AI for a contract assignment with one of our premier Financial Services clients in San Francisco, CA. Responsibilities : We are seeking an experienced Lead Data Engineer to join our team and drive the development of modern data platforms and AI-augmented solutions. This role is critical to supporting ongoing operations of Large Data Warehouse, architecting the Large Data Hub, and preparin

Contract

USD 90.00 - 90.00 per hour

Lead Cloud Data Engineer - Data Mesh & AI

San Francisco, California

•

Today

Job#: 3043847 Job Description: Lead Cloud Data Engineer We are seeking a Lead Cloud Data Engineer to play a key role in the evolution of a large-scale cloud data platform supporting enterprise analytics, operational intelligence, and emerging AI-driven capabilities. This position offers a blend of hands-on engineering, technical leadership, and architecture ownership within a complex, highly regulated environment. The ideal candidate brings deep expertise in cloud data engineering, modern dat

Easy Apply

Full-time

$75 - $95 per hour

Lead Cloud Data Engineer - Data Mesh & A

San Francisco, California

•

Today

Job Title: Lead Cloud Data Engineer (Data Mesh & AI Platforms) Role Overview We are seeking an experienced and forward-thinking Lead Cloud Data Engineer to drive the development of modern enterprise data platforms and AI-augmented solutions. In this role, you will be critical to supporting large-scale data warehousing operations, architecting centralized and federated data hubs, and spearheading enterprise data mesh modernization programs. This is a technical leadership role for an engineer who

Full-time

USD 166,400.00 - 208,000.00 per year

Lead Cloud Data Engineer (Data Mesh & AI)

San Francisco, California

•

Today

Stefanini Group is hiring! Stefanini is looking for a Lead Cloud Data Engineer (Data Mesh & AI) for San Francisco, CA/Los Angeles, CA (Onsite) For quick Apply, please reach out to Prakhar Goel: / W2 candidates Preferred! We are seeking an experienced Lead Data Engineer to join our team and drive the development of modern data platforms and AI-augmented solutions. This role is critical to supporting ongoing operations of Large Data Warehouse, architecting the Large Data Hub, and preparing for the

Easy Apply

Contract

$95 - $100 /hr

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

AWS Cloud Data Engineer

Skills

Summary

Dice Job Match Score™

Similar Jobs

AWS Cloud Data Engineer

Job Details

Skills

Summary

Dice Job Match Score™

Similar Jobs