Datacenter Observability and Site Reliability Engineer

Skillset Description Summary: This team is responsible for the overall site reliability solution, including alerts, monitoring and incident management related to hardware and Kubernetes infrastructure layer. This team includes L1, L2 and L3 support.

Roles and Responsibilities:

Observability and Monitoring-

• Design, implement, and maintain observability solutions for datacenter infrastructure.
• Develop, deploy, and maintain the operational and reliability components of a large-scale Observability and Telemetry collection platform, emphasizing performance at scale, real-time monitoring, logging, and alerting.
• Participate in and enhance the entire lifecycle of services, from inception and design to deployment, operation, and refinement.
• Develop and optimize monitoring systems to ensure high availability and performance.
• Create and manage dashboards, alerts, and reports to provide visibility into system health and performance.

Site Reliability Engineering (SRE)-

• Implement SRE best practices to improve the reliability, scalability, and performance of datacenter services.
• Develop and maintain automation scripts for infrastructure provisioning, monitoring, and management.
• Conduct root cause analysis and post-mortem reviews to prevent recurrence of incidents.

Performance Optimization-

• Analyze and optimize the performance of datacenter systems and applications.
• Implement best practices for resource utilization and efficiency.

Collaboration-

• Work closely with other engineering teams to understand and meet their observability and reliability requirements.
• Collaborate with hardware and software vendors to evaluate and integrate new technologies.
• Security and Compliance:
• Ensure that observability and reliability solutions comply with security policies and industry standards.
• Implement and maintain security measures to protect data and infrastructure.
• Troubleshooting and Support:
• Provide support for observability and reliability-related issues, including debugging and resolving hardware and software problems.
• Develop and maintain documentation for troubleshooting procedures and best practices.
• Continuous Improvement:
• Stay updated with the latest advancements in observability and SRE technologies and integrate them into the infrastructure.
• Continuously improve the reliability, scalability, and performance of datacenter services.

Qualifications:

Education-

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Experience:
• 8+ years of experience in datacenter observability and site reliability engineering.
• Proven experience in managing and optimizing large-scale datacenter environments.

Technical Skills-

• Proficiency in observability tools and technologies (e.g., Prometheus, Grafana, ELK Stack).
• Experience with SRE practices and tools (e.g., Kubernetes, Docker, Terraform).
• Strong programming and scripting skills (e.g., Python, Go, Bash).
• Familiarity with cloud platforms (AWS, Azure, Google Cloud Platform) and their observability and reliability services.

Soft Skills-

• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Ability to work in a fast-paced, dynamic environment.