Big Data Administrator (Onsite)

Overview

On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Hadoop Ecosystem
Python
Java
SQL
AWS
CI/CD

Job Details

Job Description:

Looking for highly skilled Onprem Cloud Era/Big Data Administrator to manage big data platform:

Roles

Handle day-to-day operations; Administer, and monitor Big Data Platform components (Hadoop, Hive, HBase, BigSQL, etc)

  • Support Technical and Application team requests - data copies across environments, data cleanup, query tuning, etc.
  • Troubleshoot and resolve issues related to user queries, application jobs, etc.
  • Monitor and troubleshoot Big Data Platform, including hosted DBs, tools and services
  • Creating encryption zones ,managing encryption keys and copying data between the encryption zones.
  • Support projects/initiatives related to data acquisition, processing and utilization through Big Data Platform

Maintain and support Big Data Platform (CDP Private Cloud) and IBM BigSQL across multiple environments

  • Install new versions, patches; support upgrades of CDP Private Cloud and IBM BigSQL
  • Monitor and troubleshoot platform issues and performance tuning
  • Support security policies, documentation and compliance
  • Document processes and policies for Hadoop System Administration & Platform support activities
  • Work with end users to identify and resolve issues
  • Work with vendors to resolve issues as needed
  • Provide governance and support to project teams

. Upgrade to CDP Private Cloud to CDP Public Cloud

.

Skills:

Bachelors' or Master's degree in Computer Science or applicable field of study

  • 3-5 Years Of Experience In Hadoop Ecosystem (HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR)
  • 6+ Years Of Experience With Java And Linux/Unix
  • 4+ Years Of Experience With Security, Scripting and Automation
  • 2+ Years Of Experience In R, Python, Flume, Storm, Kafka,Pyspark
  • 2+ Years Of Experience With IBM BigSQL Or Similar MPP SQL Engines
  • 2+ Years Of Experience with MYSQL.

. 1+ Years Of Experience wit CI/CD

  • Experience with administration and performance tuning of Hadoop distributions (open source and commercial)
  • Highly competent with Data Lake concepts and Big Data capabilities
  • Good understanding of data virtualization , replication, Data G.
  • Experience with AWS or other Cloud-based PaaS/SaaS environments

. Experience with AWS EMR

  • Strong communication skills
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.