Overview
Accepts corp to corp applications
Contract - 12
Skills
Firebase
Supabase
Job Details
Job Title : Cloudera Hadoop / Spark / Airflow Admin
Location : 100% Remote
Duration : Long term
Job description:
- Bachelor's degree in Computer science or equivalent, with minimum 10+ Years of IT experience.
- You should have experience in Administer Cloudera Hadoop clusters (HDFS, YARN, Hive, Impala) using Cloudera Manager; ensure high availability and performance.
- You must Perform OS and platform patching/upgrades for Hadoop, Spark, and Airflow components with rollback plans.
- You should Manage Spark workloads: tune executors, memory, and dynamic allocation for optimal performance.
- You should Install, configure, and maintain Apache Airflow (Scheduler, Webserver, Workers); ensure DAG reliability and SLA compliance.
- Implement security and compliance: Kerberos, LDAP/AD integration, Ranger policies, TLS certificates.
- You should Monitor and troubleshoot platform health using Cloudera Manager, PrometheGrafana, and log analysis.
- Strong Automate operational tasks with Ansible, Python, and shell scripting for provisioning, patching, and config management.
- Handle incident and change management: root cause analysis, documentation, and on-call support.
- Perform capacity planning and resource optimization for multi-tenant clusters.
- Collaborate with data engineering and infrastructure teams to ensure platform stability and scalability.
- Contributes to the technical design for development projects by reviewing and understanding the high level functional specifications.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.