Hadoop Administrator

Charlotte, NC, US • Posted 2 days ago • Updated 2 days ago

Contract Corp To Corp

Contract W2

On-site

Depends on Experience

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

Amazon Web Services
Analytics
Ansible
Apache Hadoop
Apache Hive
Apache Kafka
Apache Spark
Backup
Big Data

Summary

We are looking for a Hadoop Administrator for our client in Charlotte, NC

Job Title: Hadoop Administrator

Job Location: Charlotte, NC

Job Type: Contract

Job Description:

Responsibilities:

Cluster Administration:

Manage, monitor, and optimize MapR-based Hadoop clusters in a production environment.
Oversee daily operations, including cluster health checks, performance tuning, capacity planning, and system upgrades.
Perform installation, configuration, patching, and version upgrades for MapR distributions and ecosystem tools.

Multi-Tenant Environment Management:

Configure, support, and optimize multi-tenant setups, ensuring isolation, resource fairness, and performance SLAs.
Manage YARN queues, ACLs, quotas, and security policies per tenant requirements.
Collaborate with data engineering and analytics teams to onboard new tenants and align resource needs.

Performance and Troubleshooting:

Diagnose and resolve cluster performance issues, bottlenecks, and failures across MapR FS, YARN, Spark, Hive, Kafka, and related services.
Manage node failures, job failures, and cluster rebalancing while maintaining uptime.
Automate alerting, monitoring, and reporting using tools like MapR Control System (MCS), Grafana, Nagios, Prometheus, or similar.

Security and Compliance:

Implement and manage security features such as Kerberos, Ranger/Sentry policies, SSL encryption, and user/role management.
Ensure compliance with internal and external standards for data governance and security.

Backup, Disaster Recovery, and High Availability:

Maintain reliable backup and DR strategies using MapR snapshots, mirrors, and failover configurations.
Ensure 24/7 availability of production environments and participate in on-call rotation.

Automation and Scripting:

Develop automation for operational tasks using Python, Shell scripting, or Ansible.
Streamline cluster provisioning, monitoring, and deployment pipelines.

Required Skills and Qualifications:

4+ years of hands-on experience as a Hadoop/MapR Administrator.
Strong knowledge of MapR-FS, MapR-DB, MapR Streams, YARN, Hive, Spark, and Kafka.
Experience managing production clusters with high availability requirements.
Proficiency in Linux administration (RHEL/CentOS/Ubuntu).
Expertise with multi-tenant Hadoop environments, resource governance, and user management.
Strong skills in shell scripting, automation, and performance tuning.
Experience with monitoring tools (Grafana, Nagios, Prometheus, MapR MCS).
Understanding of Hadoop security (Kerberos, SSL, ACLs, AD integration).

Preferred Qualifications:

Experience migrating from MapR to other Hadoop distributions (Cloudera, Hortonworks) a plus.
Knowledge of Cloud (AWS/Azure/Google Cloud Platform) big data services.
Experience with CI/CD pipelines, DevOps tools, or containerized big data workloads.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10516350
Position Id: NC_HOAD_0112
Posted 2 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Hadoop Administrator

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs