Big Data Administrator with SRE

Overview

We are seeking a highly skilled Big Data Administrator with Site Reliability Engineering (SRE) experience to join our data infrastructure team. This role is responsible for deploying, maintaining, monitoring, and optimizing large-scale data platforms, while ensuring high availability, reliability, and performance through automation and operational excellence in line with SRE principles.

Key Responsibilities

• Administer Big Data platforms (e.g., Hadoop, Spark, Hive, HBase, Kafka, Airflow, etc.) including installation, configuration, upgrades, and patching.
• Design, implement, and maintain automated monitoring, alerting, and incident response systems for Big Data environments.
• Apply SRE principles to improve availability, latency, performance, and capacity of critical data systems.
• Collaborate with data engineers, software developers, and DevOps teams to define SLIs, SLOs, and error budgets for data services.
• Troubleshoot and resolve complex issues across data pipelines, storage, and compute layers.
• Manage security and compliance for data systems, including role-based access control data encryption, and audit logging.
• Implement disaster recovery strategies, backups, and failover mechanisms for critical data infrastructure.
• Analyze system performance and usage patterns to proactively identify and resolve bottlenecks.

Required Skills:

• 8+ years of experience in Big Data administration.
• 2+ years of experience in Site Reliability Engineering or DevOps role.
• Hands-on experience with Hadoop ecosystem, Kafka, Spark, and NoSQL databases.
• Proficiency in Linux system administration, shell scripting, and automation tools.
• Strong knowledge of cloud platforms (AWS, Google Cloud Platform, or Azure) and containerization (Docker, Kubernetes).
• Solid understanding of networking, system security, and operational best practices.