Scala, Sqoop, Zeppelin
Experience in Big data environment with proven experience in design and architecture in Hadoop projects.
Experience in Capacity forecasting (Compute, Storage), understand Ingestion Rates, Trending, Performance benchmarking
Experience in Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning servers for optimal performance of the cluster.
Troubleshoot Job Failures, do RCA & identify permanent fixes
Understand File/Directory permissions, identify violations and related impact analysis
Identify, Install & Configure Tools/ Sanity Checks/ Diagnostics required to monitor clusters health
Build Zeppelin dashboards, Automation using Shell/ Python/ Ansible scripts etc
Import /export/ copy data from HDFS to HDFS / Relational Database Systems/ Filesystem and vice-versa