Data Platform Architect / Kubernetes & Spark Lead

San Jose, CA, US • Posted 4 days ago • Updated 4 days ago

Full Time

No Travel Required

On-site

Depends on Experience

Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

Kubernetes
Spark
Data Platform
python
Ansible

Summary

Position: Data Platform Architect / Kubernetes & Spark Lead
Location: San Jose, CA (Onsite)
Experience: 8–10 Years

Description

Lead and drive key architectural decisions across teams.
Provide strong technical leadership and participate in critical design discussions.
Engage with customers during escalations and ensure continuous improvements.
Design, develop, and maintain real-time data processing and Data LakeHouse infrastructure.
Develop Python-based data pipelines and processing layers.
Build and maintain Ansible playbooks for infrastructure configuration.
Develop and manage Kubernetes manifests, Helm charts, and deployment artifacts.
Hands-on experience with Docker and containerization (including private registry management).
Manage Kubernetes cluster access control and troubleshoot cluster issues.
Maintain and support Spark clusters.
Drive initiatives to containerize standalone applications.
Implement Infrastructure as Code (IaC) best practices.
Use observability tools for capacity management and monitoring.

Preferred Skills:

AWS ECS & EKS
Dremio
Dynatrace or other tracing/real-time monitoring tools

Thanks & Regards

Satish Reddy |Lead Technical Recruiter |Dizer Corp.

1912 Mentor Ave | Painesville | OH 44077

Direct : |Work : Ext: 134 |

Linkedin:

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10375940
Position Id: PSR_DPAKSL
Posted 4 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Cloud Data Engineer

San Jose, California

•

4d ago

Role: Data EngineerLocation: San Jose, CA - OnsiteJob RequirementsYouwill design and lead the team in important architectural decisions. The candidate will provide technical leadership for the team(s) they are associated with and participate in key decisions. They will engage with customers on escalations and ensure that there is continuous improvement in all areas. Participate in technical discussions within the team and with other groups within Business Units associated with specified projects

Easy Apply

Contract

65 - 70

Technical Lead Manager, ML Platform Infrastructure

Mountain View, California

•

Today

Who We Are Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world's most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver , to support a wide range of applications, from robotaxis and commercial fleets to personally owned vehicles. With technology proven over years of self-driving deployments, Nuro gives the automakers and mobility platforms

Full-time

USD 235,030.00 - 352,290.00 per year

Senior Manager, Data & Analytics Platform

San Jose, California

•

Today

Our Company Changing the world through digital experiences is what Adobe's all about. We give everyone-from emerging artists to global brands-everything they need to design and deliver exceptional digital experiences! We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We're on a mission to hire the very best and are committed to creating exceptional employee experiences wher

Full-time

USD 160,200.00 per year

Data Engineer - Last Mile & Application Layer (Tron Analytics Platform)

San Jose, California

•

Today

Data Engineer - Last Mile & Application Layer (Tron Analytics Platform) Are you passionate about delivering flawless data solutions that drive business impact? We are seeking a dedicated Data Engineer to join our team in San Jose, CA! At Adobe, you will play a pivotal role in our ambitious projects, ensuring our data pipelines and application layers are world-class. What you'll do day-to-day Work closely with business collaborators and data engineering teams to understand requirements and onboa

Full-time

USD 133,100.00 - 236,400.00 per year

Search all similar jobs