Overview
Skills
Job Details
Job Title: Hadoop Admin /AWS Admin
Location: St. Louis, MO - Onsite
Duration: 12+ Months
Job Description:
You will work in a multi-functional role with a combination of expertise in AWS cloud and Hadoop administration.
You will work in a team that often interacts with customers on various aspects related to technical support for deployed system.
You will be deputed at customer premises to assist customers for issues related to System and Hadoop administration.
You will Interact with QA and Engineering team to co-ordinate issue resolution within the promised SLA to customer.
Responsibilities:
Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem on On-Prem & AWS cloud.
Maintaining core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, Impala, SPARK, HBASE etc.
Takes care of the day-to-day running of Hadoop clusters using Ambari/Cloudera manager/Other monitoring tools, ensuring that the Hadoop cluster is up and running all the time.
Work closely with the database team, network team and application teams to make sure that all the big data applications are highly available and performing as expected.
Expert in Kubernetes, deploying EKS clusters and maintaining them.
Automating infrastructure and Big Data technologies deployment, build and configuration using DevOps tools.
Writing Unix SHELL/Ansible Scripting for automation.
Optimize EMR Clusters for performance and cost-efficiency.
Hands on experience on AWS services like EC2, s3, RDS, secrete manager, system manager, lamda function , SNS, Event-Bridge, RDS, EMR, Farget, ETC..
What skills you should have?
Technical Domain: Linux administration, Hadoop Infrastructure and Administration, AWS Administration, DevOps tools, Kubernetes, Scripting.
Must Have Skills:
Linux Administration
Experience in Terraform, Python and Shell Scripting
Deploying and administering Hortonworks, Cloudera, EMR, Apache Hadoop/Spark ecosystem & AWS Administration.
Knowledge of Hadoop core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, Imapla, SPARK etc.
Knowledge of AWS Services Such as EC2, s3, RDS, secrete manager, system manager, lamda function , SNS, Event-Bridge, RDS, EMR, Farget, ETC.