Hadoop Admin /AWS Admin

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2

Skills

hadoop
admin
administration
aws
kafka
HDFS
impala
lambda
EC2
Cloudera
spark

Job Details

Job Title: Hadoop Admin /AWS Admin

Location: St. Louis, MO - Onsite

Duration: 12+ Months

 

Job Description:

You will work in a multi-functional role with a combination of expertise in AWS cloud and Hadoop administration.

You will work in a team that often interacts with customers on various aspects related to technical support for deployed system.

You will be deputed at customer premises to assist customers for issues related to System and Hadoop administration.

You will Interact with QA and Engineering team to co-ordinate issue resolution within the promised SLA to customer.

 

Responsibilities:

Deploying and administering Hortonworks, Cloudera, Apache Hadoop/Spark ecosystem on On-Prem & AWS cloud.

Maintaining core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, Impala, SPARK, HBASE etc.

Takes care of the day-to-day running of Hadoop clusters using Ambari/Cloudera manager/Other monitoring tools, ensuring that the Hadoop cluster is up and running all the time.

Work closely with the database team, network team and application teams to make sure that all the big data applications are highly available and performing as expected.

Expert in Kubernetes, deploying EKS clusters and maintaining them.

Automating infrastructure and Big Data technologies deployment, build and configuration using DevOps tools.

Writing Unix SHELL/Ansible Scripting for automation.

Optimize EMR Clusters for performance and cost-efficiency.

Hands on experience on AWS services like EC2, s3, RDS, secrete manager, system manager, lamda function , SNS, Event-Bridge, RDS, EMR, Farget, ETC..

 

What skills you should have?

Technical Domain: Linux administration, Hadoop Infrastructure and Administration, AWS Administration, DevOps tools, Kubernetes, Scripting.

 

Must Have Skills:

Linux Administration

Experience in Terraform, Python and Shell Scripting

Deploying and administering Hortonworks, Cloudera, EMR, Apache Hadoop/Spark ecosystem & AWS Administration.

Knowledge of Hadoop core components such as Zookeeper, Kafka, NIFI, HDFS, YARN, Imapla, SPARK etc.

Knowledge of AWS Services Such as EC2, s3, RDS, secrete manager, system manager, lamda function , SNS, Event-Bridge, RDS, EMR, Farget, ETC.