BigData / Hadoop Admin

Overview

Hybrid
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 6 null
Able to Provide Sponsorship

Skills

HDFS
YARN
Hive
HBase
Spark
etc
Java 8
Spring
Spring MVC
Spring boot
Spring Security (OAuth
LDAP)
Spring Data (

Job Details

Position : Hadoop Admin

Location : Mount Laurel, NJ or NYC, NY or Charlotte, NC

Duration : 12+ Months

  • Install, configure, and maintain Hadoop clusters (HDFS, YARN, Hive, HBase, Spark, etc.)
  • Experience with Java 8 and frameworks like Spring, Spring MVC, Spring boot, Spring Security (OAuth, LDAP), Spring Data (JPA, JDBC
  • Experience developing multi-threaded applications and developing Micro Services using modern technology stack
  • Monitor cluster performance and troubleshoot issues related to hardware, software, and network
  • Implement and manage data security and access controls
  • Perform capacity planning and cluster scaling
  • Automate routine tasks using scripting (Shell, Python, etc.)
  • Collaborate with development teams to integrate Java-based applications with Hadoop
  • Optimize MapReduce, Spark, and other data processing jobs
  • Ensure data backup, recovery, and disaster recovery planning
  • Maintain documentation for configurations, procedures, and troubleshooting
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.