Hadoop Support Engineer

$50 - $55

Full Time

  • No Travel Required

Skills

ClouderaHadoopCDHAzureDatabricksDataAWSGCPAgile

Job Description

Riviera is a Global Business and Technology Services firm specializing in the areas of Telecom, Information Security, Data Center Virtualization/Consolidation, and Business Intelligence, Data Warehousing & Analytics. Riviera is committed to its client’s sustainable competitive advantage. The people at Riviera will work with you to develop a customized approach in streamlining client’s business needs in a comprehensive and flexible manner. Riviera offers a competitive compensation package with opportunities for growth and professional development.

We are an Equal Opportunity Employer.

 

 

Hadoop Support Engineer

Alpharetta, GA

Hybrid 3 days a week onsite

Databricks Operations is part of the Hadoop Support team. This team is responsible for managing the Databricks plant. Working within an Agile delivery (Scrum/Kanban/Scrumban)/ DevOps methodology. Support the application development teams and help them in debugging and fixing an issue.

Responsibilities and activities of these team include, but not limited to
- Build, Upgrade and maintain Hadoop clusters with several nodes.
- Monitoring and troubleshooting of services running on Hadoop clusters.
- Performance tuning.
- Setup of backup and recovery.
- Troubleshooting User issues which include User on boarding, job failures.
- Installing and integrating of a new services onto the Hadoop cluster.
- Working with Vendor to discuss/apply issue bugs, patches and issues.
- Deploy and automate the implementations/fixes using Ansible scripts.
- Hands-on experience on the administration side of DataBricks preferably on Azure.
- Prior experience in a support role on admin side of Databricks on one of Azure/AWS/Google Cloud Platform cloud
- Excellent knowledge of git and Jenkins. Understanding of distributed systems and databases, cloud computing environments - Azure/Linux(mandatory skills)
- General familiarity with Docker and Kubernetes concepts
- Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
- Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW
- Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment.
- Working within an Agile delivery (Scrum/Kanban/Scrumban)/ DevOps methodology.
- Deploy Azure Databricks workspaces using IaC (terraform + azure devops)

Qualification:
- Experience in Cloudera Hadoop distribution CDH 6.x and CDP 7 is preferred.
- Experience with Cluster maintenance tasks like adding and removing nodes, enabling High availability, installing services, applying patches.
- Unix/Linux knowledge including the ability to understand hardware, Operating system and network settings.
- Experience with Hadoop Ecosystem components which include HDFS, YARN, Hive, Impala, Spark, Sqoop, Kafka, Flume and Solr.
- Unix Shell, perl or python scripting.
- Kerberos and LDAP integration experience.
- TLS/SSL certificates knowledge to enable encryption cross Hadoop services.
- Some development experience in Databricks on Azure/AWS/Google Cloud Platform
- Some developer skills in Python
- Some experience with Terraform for IaaC

If you feel you match the above skill set then I would appreciate if you can either email me at or call me atlt;/p>

 

 

Regards,

Gaurang Pawar

Accounts Manager

Riviera Consulting LLC

239 Suite B205, New Road,

Parsippany, NJ-07054

(C)lt;/p>

(F) lt;/p>