Overview
On Site
$50 - $60
Contract - W2
Contract - 12 Month(s)
Skills
Hadoop
Docker
Kubernetes
HDFS
Hive
Spark
Linux
Job Details
Position: BDP Platform Engineer - Hadoop Admin -
Location: Irvine, CA
Duration: 12 months(W2 only)
Requirements:
- 10+ years of experience in Platform Engineering, Site Reliability Engineering, or similar roles, with proven success managing large-scale, distributed Hadoop infrastructure.
- Deep expertise in the Hadoop ecosystem, including HDFS, YARN, Hive, Spark, NiFi, Ambari, and Iceberg.
- Strong Linux system administration skills (CentOS/Rocky preferred), including system tuning, performance optimization, and troubleshooting.
- Proficiency in containerization and orchestration using Docker and Kubernetes.
- Solid experience with automation and Infrastructure as Code, leveraging tools like GitLab CI/CD and scripting in Python and bash.
- Practical knowledge of monitoring and observability tools (e.g., Prometheus, Grafana, OpenTelemetry) and understanding of system health, alerting, and telemetry.
- Familiarity with networking concepts, security protocols, and data compliance requirements.
- Experience managing petabyte-scale data platforms and implementing disaster recovery strategies.
- Understanding of data governance, metadata management, and operational best practices.
- Demonstrated ability to lead technical projects, mentor engineers, and collaborate effectively with cross-functional teams.
- Excellent problem-solving, communication, and leadership skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.