Sr Cloud Data Engineer/Lead

  • San Jose, CA
  • Posted 2 days ago | Updated 1 day ago

Overview

On Site
Depends on Experience
Contract - W2
Contract - Independent
Contract - 12 Month(s)

Skills

Python
Ansible
Docker
Kubernetes
Amazon Web Services
Apache Spark
Cloud Computing

Job Details

Note: Need Only Locals to San Jose, CA. Who can go Onsite from Day 1.

Position: Sr. Cloud Data Engineer/Lead Location: RTP Durham, NC / San Jose, CA - (Onsite from Day 1) Duration: Long Term Contract

Job Requirements:
8 to 10 years of relevant experience.
You will design and lead the team in important architectural decisions. The candidate will provide technical leadership for the team(s) they are associated with and participate in key technical decisions. They will engage with customers on escalations and ensure that there is continuous improvement in all areas. Participate in technical discussions within the team and with other groups within Business Units associated with specified projects
You design, develop, and maintain our real time data processing, data LakeHouse infrastructure.
You have experience with Python to write data pipelines and data processing layers.
You develop and maintain Ansible playbooks for infrastructure configuration and management
You develop and maintain Kubernetes manifests, Helm charts, and other deployment artifacts
You have hands on experience on Docker and containerisation and how to manage/prune the images in private registries.
You have hands-on experience on access control in K8S cluster
You have hands-on experience on SPARK and maintaining SPARK CLUSTER
You monitor and troubleshoot issues related to Kubernetes clusters and containerized applications
You drive initiatives to containerize standalone apps to be containerized in Kubernetes.
You develop and maintain infrastructure as code (IaC) and collaborate with other teams to ensure consistent infrastructure management across the organization
You use observability tools to do capacity management of our services and infrastructure resources.
You are for guiding the development and testing activities of other engineers that involve several inter-dependencies
Experience in AWS ECS and EKS is added advantage
Experience in Dremio is added advantage
Experience in Dynatrace or any tracing , infrastructure, or real time monitoring tool is added advantage


Thanks & Regards
Mahesh

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Solios Corp