Hadoop Admin

Seeking an experienced Cloudera Administrator to manage and maintain our enterprise-grade big data platforms. The ideal candidate will ensure the stability, performance, and security of our Cloudera on-premise cluster, collaborating with data engineering, databases, networks, and application teams to support data-driven initiatives.

Main areas of responsibilities:

1.     Cluster Management: Deploy, configure, manage, and maintain Cloudera Hadoop/CDP clusters across three environments.

2.     Monitoring and Performance Tuning: Monitor cluster connectivity, health, and performance using tools like Cloudera Manager, Grafana, and Splunk. Proactively identify and resolve performance bottlenecks, tune configurations (HDFS, YARN, Spark, Hive, etc.), and conduct capacity planning.

3.     Security and Compliance: Implement and manage cluster security configurations, including Kerberos, Sentry/Ranger for authorization, HDFS ACLs, and integrate with enterprise IAM/LDAP.

4.     Automation and Scripting: Develop and maintain automation scripts using Python, Bash, or Perl for routine administrative tasks, configuration management, and streamlining operations.

5.     Troubleshooting and Support: Provide expert-level troubleshooting and technical support for issues related to the Hadoop ecosystem components and big data applications, including participation in an on-call rotation.

6.     Upgrades and Patching: Perform installations, patching, and upgrades of Hadoop software and Cloudera components while ensuring minimal downtime.

Requirements:                                                                     

·      Minimum 3 years of hands-on experience as a Cloudera/Hadoop Administrator in production environments.

·      Relevant certifications such as Cloudera Certified Administrator for Apache Hadoop are desirable.

·      Strong proficiency in Linux/Unix operating systems and command-line tools.

·      Proven experience with cluster management tools, particularly Cloudera Manager.

·      Solid understanding of security protocols (Kerberos, SSL/TLS) and their implementation in big data environments.

·      Excellent problem-solving, analytical, and communication skills.

1.     Cluster Management: Deploy, configure, manage, and maintain Cloudera Hadoop/CDP clusters across three environments.

2.     Monitoring and Performance Tuning: Monitor cluster connectivity, health, and performance using tools like Cloudera Manager, Grafana, and Splunk. Proactively identify and resolve performance bottlenecks, tune configurations (HDFS, YARN, Spark, Hive, etc.), and conduct capacity planning.

3.     Security and Compliance: Implement and manage cluster security configurations, including Kerberos, Sentry/Ranger for authorization, HDFS ACLs, and integrate with enterprise IAM/LDAP.

4.     Automation and Scripting: Develop and maintain automation scripts using Python, Bash, or Perl for routine administrative tasks, configuration management, and streamlining operations.

5.     Troubleshooting and Support: Provide expert-level troubleshooting and technical support for issues related to the Hadoop ecosystem components and big data applications, including participation in an on-call rotation.

6.     Upgrades and Patching: Perform installations, patching, and upgrades of Hadoop software and Cloudera components while ensuring minimal downtime.