JOB DESCRIPTION:
"We are looking for an experienced Hadoop Administrator (MapR) to manage and support our production-grade MapR Hadoop clusters. The ideal candidate will have hands-on experience running missioncritical, multi-tenant Hadoop environments, ensuring high availability, performance, and security across diverse workloads.
Key Responsibilities
Cluster Administration
Manage, monitor, and optimize MapR-based Hadoop clusters in a production environment.
Oversee daily operations, including cluster health checks, performance tuning, capacity planning, and system upgrades.
Perform installation, configuration, patching, and version upgrades for MapR distributions and ecosystem tools.
Multi-Tenant Environment Management
Configure, support, and optimize multi-tenant setups, ensuring isolation, resource fairness, and performance SLAs.
Manage YARN queues, ACLs, quotas, and security policies per tenant requirements.
Collaborate with data engineering and analytics teams to onboard new tenants and align resource needs.
Performance & Troubleshooting
Diagnose and resolve cluster performance issues, bottlenecks, and failures across MapR FS, YARN, Spark, Hive, Kafka, and related services.
Manage node failures, job failures, and cluster rebalancing while maintaining uptime.
Automate alerting, monitoring, and reporting using tools like MapR Control System (MCS), Grafana, Nagios, Prometheus, or similar.
Security & Compliance
Implement and manage security features such as Kerberos, Ranger/Sentry policies, SSL encryption, and user/role management.
Ensure compliance with internal and external standards for data governance and security.
Backup, Disaster Recovery, & High Availability
Maintain reliable backup and DR strategies using MapR snapshots, mirrors, and failover configurations.
Ensure 24/7 availability of production environments and participate in on-call rotation.
Automation & Scripting
Develop automation for operational tasks using Python, Shell scripting, or Ansible.
Streamline cluster provisioning, monitoring, and deployment pipelines.
Required Skills & Qualifications
4+ years of hands-on experience as a Hadoop/MapR Administrator.
Strong knowledge of MapR-FS, MapR-DB, MapR Streams, YARN, Hive, Spark, and Kafka.
Experience managing production clusters with high availability requirements.
Proficiency in Linux administration (RHEL/CentOS/Ubuntu).
Expertise with multi-tenant Hadoop environments, resource governance, and user management.
Strong skills in shell scripting, automation, and performance tuning.
Experience with monitoring tools (Grafana, Nagios, Prometheus, MapR MCS).
Understanding of Hadoop security (Kerberos, SSL, ACLs, AD integration).
Preferred Qualifications
Experience migrating from MapR to other Hadoop distributions (Cloudera, Hortonworks) - a plus.
Knowledge of Cloud (AWS/Azure/Google Cloud Platform) big data services.
Experience with CI/CD pipelines, DevOps tools, or containerized big data workloads."
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91128170
- Position Id: OOJ - 10878-9879-1769695934
- Posted 13 hours ago
Never miss an opportunity! Create an alert based on the job you applied for.
