Hadoop Administrator

********Client is not sponsoring any visa*******

Hadoop Administrator Job Description

Role Overview

The Hadoop Administrator is responsible for the deployment, configuration, monitoring, and maintenance of Hadoop clusters. This role ensures high availability, performance optimization, and security of big data infrastructure used for analytics and data processing.

Key Responsibilities

Cluster Administration

• Install, configure, and maintain Apache Hadoop clusters (single node and multi-node environments).

• Manage and monitor Hadoop Distributed File System and cluster resources.

• Ensure cluster health, uptime, and optimal performance.

Platform Management

• Administer Hadoop ecosystem tools such as:

  • Apache Hive

  • Apache Spark

  • Apache HBase

  • Apache Sqoop

  • Apache Oozie

  • Apache Kafka

Performance & Monitoring

• Monitor cluster performance using tools like:

  • Apache Ambari

  • Cloudera Manager

• Tune Hadoop parameters for performance optimization.

Security & Governance

• Implement cluster security with:

  • Apache Ranger

  • Apache Knox

  • Kerberos

• Manage user access, authentication, and data governance.

Data Management

• Manage data replication, backup, and disaster recovery.

• Perform upgrades, patches, and version migrations.

Troubleshooting

• Diagnose and resolve cluster failures, job failures, and performance issues.

• Work with data engineers and developers to support Hadoop workloads.

Required Skills

Technical Skills

• Strong experience with Apache Hadoop ecosystem

• Knowledge of Linux system administration

• Experience with Apache Spark and Apache Hive

• Familiarity with shell scripting, Python, or Bash

• Experience with cluster monitoring tools

Infrastructure Skills

• Networking fundamentals

• Storage systems

• High availability configurations

• Cloud Hadoop platforms (optional)

Preferred Qualifications

• Experience with Hadoop distributions like:

  • Cloudera

  • Hortonworks

  • MapR Technologies

• Exposure to cloud platforms such as:

  • Amazon Web Services

  • Microsoft Azure

  • Google Cloud

Typical Experience

• 4 10+ years in Hadoop / Big Data administration

• Bachelor s degree in Computer Science, IT, or related field