Overview
Hybrid
Depends on Experience
Contract - W2
Skills
Linux
rhel
Fedora
Shell
HADOOP
CLOUDERA
SPARK
HDFS
YARN
Job Details
Job Title: Senior Infrastructure Engineer – Linux, Hadoop & Spark
Location: Charlotte, NC (Onsite/Hybrid as applicable)
Type: Long-Term Contract
Experience Range: 5 + years
Job Overview:
Seeking a seasoned Infrastructure Support Engineer with deep expertise in Linux system administration and distributed compute/storage platforms, especially in Cloudera Hadoop and Apache Spark GRID environments.
This role is central to supporting a high-performance big data platform consisting of a 5+ PB Cloudera Hadoop cluster and a 30K-core Spark GRID, serving over 150+ quantitative and model development users. The ideal candidate will be a Linux power user (RHEL, Fedora) with strong troubleshooting and performance-tuning capabilities, combined with experience in GRID orchestration, capacity planning, and resource utilization optimization.
Required Qualifications:
- 5+ years of hands-on Linux system administration experience (preferably RHEL and Fedora).
- Proven expertise managing large-scale distributed storage and compute systems, particularly Cloudera Hadoop and Apache Spark.
- Solid understanding of Hadoop ecosystem components (HDFS, YARN, ResourceManager, NameNode, etc.) and Spark execution paradigms.
- Proficiency in scripting languages: Shell (Bash) and Python for automation and tooling.
- Experience with infrastructure monitoring platforms such as InfluxDB, Grafana, and Telegraf – including dashboard creation and alerting.
- Familiarity with CI/CD pipelines, source control (Git), and tools such as Jenkins, GitHub, and Ansible.
- Working knowledge of secrets management tools like HashiCorp Vault (HVault).
- Strong debugging and performance tuning skills, especially across compute and storage-intensive workloads.
Desired Qualifications:
- Experience in GRID management, cluster sizing, tuning, and compute job orchestration.
- Previous role in Site Reliability Engineering (SRE) or Infrastructure Operations in HPC or Big Data environments.
- Familiarity with containerization technologies such as Docker and Kubernetes.
- Exposure to Active Directory/Kerberos for access and identity management.
- Self-starter with strong ownership, communication skills, and a collaborative mindset.
Thanks & Regards
MD TOUHEED ALAM
SR. TECHNICAL RECRUITER
PURPLE HIRES INC.
Email -
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.