Hadoop Systems Engineer

  • Alpharetta, GA
  • Posted 1 day ago | Updated 3 hours ago

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
No Travel Required

Skills

Description and Requirements : 1. Expert in setting up Hadoop cluster from scratch and server maintenance. 2. Commissioning and decommissioning of the nodes to/from Hadoop cluster. 3. Implementing
managing
and administering the overall Hadoop infrastructure. 4. Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster. 5. Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams. 6. Replicating huge amount data from one Hadoop cluster to another. 7. Applying encryption to secure the data in the Hadoop cluster. 8. Applying the configuration changes and testing the cluster in collaboration with the application teams and business users. 9. Sound knowledge of Hadoop services - HDFS
Hive
HBase
Impala
Hue
Ranger etc. 10. Experience with Cloudera CDP Hadoop upgrade. 11. Experience with access management and setting up user roles in Hadoop. 12. Able to create and debug complex Unix shell scripts. Nice to have: 1. Analyzing and troubleshooting the issues with the clusters. 2. Set up and maintain appropriate infrastructure to maintain performance and data integrity. 3. Experience with ELK Stack: Elasticsearch
Logstash
Kibana
Apache Hadoop 4. Ensuring appropriate monitoring & alerting of Elasticsearch cluster. 5. Expert in networking and security settings to support network related pipelines. 6. Good to have Ruby and/or Python
Unix and GIT Knowledge. Soft Skills 1. Good verbal and written communication skills. 2. Good analytical and problem-solving skills. 3. Good team player.
Analytical Skill
Apache HBase
Apache Hadoop
Apache Hive
Capacity Management
Cloudera
Cloudera Impala
Collaboration
Communication
Computer Networking
Conflict Resolution
Data Integrity
Debugging
Elasticsearch
Encryption
Estimating
Git
Ruby
Scratch
Scripting
Server Administration
Shell
Soft Skills
Testing
HDFS
Identity Management
Management
Network
Problem Solving
Python
Unix
Hadoop Systems Engineer
Hadoop Engineer

Job Details

Description and Requirements :
1. Expert in setting up Hadoop cluster from scratch and server maintenance.
2. Commissioning and decommissioning of the nodes to/from Hadoop cluster.
3. Implementing, managing, and administering the overall Hadoop infrastructure.
4. Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
5. Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
6. Replicating huge amount data from one Hadoop cluster to another.
7. Applying encryption to secure the data in the Hadoop cluster.
8. Applying the configuration changes and testing the cluster in collaboration with the application teams and business users.
9. Sound knowledge of Hadoop services - HDFS, Hive, HBase, Impala, Hue, Ranger etc.
10. Experience with Cloudera CDP Hadoop upgrade.
11. Experience with access management and setting up user roles in Hadoop.
12. Able to create and debug complex Unix shell scripts.

Nice to have:
1. Analyzing and troubleshooting the issues with the clusters.
2. Set up and maintain appropriate infrastructure to maintain performance and data integrity.
3. Experience with ELK Stack: Elasticsearch, Logstash, Kibana, Apache Hadoop
4. Ensuring appropriate monitoring & alerting of Elasticsearch cluster.
5. Expert in networking and security settings to support network related pipelines.
6. Good to have Ruby and/or Python, Unix and GIT Knowledge.

Soft Skills
1. Good verbal and written communication skills.
2. Good analytical and problem-solving skills.
3. Good team player.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Zealogics