Hadoop Ops Support

Hello Professional,

Our client is looking Hadoop Ops Support project in Charlotte, NC below is the detailed requirements.

Role: Hadoop Ops Support

Locations: Charlotte, NC

Job Description:

Cluster Administration

• Manage monitor and optimize MapR based Hadoop clusters in a production environment
• Oversee daily operations including cluster health checks performance tuning capacity planning and system upgrades
• Perform installation configuration patching and version upgrades for MapR distributions and ecosystem tools

Multi-Tenant Environment Management

• Configure support and optimize multitenant setups ensuring isolation resource fairness and performance SLAs
• Manage YARN queues ACLs quotas and security policies per tenant requirements
• Collaborate with data engineering and analytics teams to onboard new tenants and align resource needs

Performance Troubleshooting

• Diagnose and resolve cluster performance issues bottlenecks and failures across MapR FS YARN Spark Hive Kafka and related services
• Manage node failures job failures and cluster rebalancing while maintaining uptime
• Automate alerting monitoring and reporting using tools like MapR Control System MCS Grafana Nagios Prometheus or similar

Security Compliance

• Implement and manage security features such as Kerberos Ranger Sentry policies SSL encryption and user role management
• Ensure compliance with internal and external standards for data governance and security

Backup Disaster Recovery High Availability

• Maintain reliable backup and DR strategies using MapR snapshots mirrors and failover configurations
• Ensure 247 availability of production environments and participate in on-call rotation

Automation Scripting

• Develop automation for operational tasks using Python Shell scripting or Ansible
• Streamline cluster provisioning monitoring and deployment pipelines

Required Skills Qualifications

• Hands on experience as a Hadoop MapR Administrator
• Strong knowledge of MapRFS MapRDB MapR Streams YARN Hive Spark and Kafka
• Experience managing production clusters with high availability requirements
• Proficiency in Linux administration RHEL CentOS Ubuntu
• Expertise with multitenant Hadoop environments resource governance and user management
• Strong skills in shell scripting automation and performance tuning
• Experience with monitoring tools Grafana Nagios Prometheus MapR MCS
• Understanding of Hadoop security Kerberos SSL ACLs AD integration

Preferred Qualifications

• Experience migrating from MapR to other Hadoop distributions Cloudera Hortonworks a plus
• Knowledge of Cloud AWS Azure Google Cloud Platform big data services
• Experience with CICD pipelines DevOps tools or containerized big data workloads