Logo
  • Ubuntu
  • CentOS
  • Debian
  • Fedora
  • RedHat

How to Set Up High Availability for Resource Manager – Part 6 - DesignLinux

Jan 11 2021
designlinux 0 Comments

YARN is the Processing Layer of Hadoop, which consists of the Master (Resource Manager) and Slave (Node Manager) services to process the data. Resource Manager (RM) is the critical component that is responsible for resource allocation and management among all the jobs running in Hadoop Cluster.

It is always recommended and best practice to have the Cluster High Availability (HA) enabled on Critical services like Namenode and Resource Manager.

Requirements

  • Best Practices for Deploying Hadoop Server on CentOS/RHEL 7 – Part 1
  • Setting Up Hadoop Pre-requisites and Security Hardening – Part 2
  • How to Install and Configure the Cloudera Manager on CentOS/RHEL 7 – Part 3
  • How to Install CDH and Configure Service Placements on CentOS/RHEL 7 – Part 4
  • How to Set Up High Availability for Namenode – Part 5

In this article, we will see the steps to enable High Availability on Resource Manager.

Enabling High Availability on Resource Manager

1. Go to Cloudera Manager at the following addresses and navigate to YARN –> Actions –> Enable High Availability.

http://13.233.129.39:7180/cmf/home
Cloudera Manager Dashboard
Cloudera Manager Dashboard
Enable High Availability
Enable High Availability

2. Select a server where you are going to have a second Resource Manager. Usually, we will be having a second master server to deploy High Availability. Here, we are selecting master2 for enabling HA.

Add Resource Manager Host
Add Resource Manager Host
Select Resource Manager Hosts
Select Resource Manager Hosts

3. Once selected the master2, click ‘Continue’ to proceed.

Resource Manager Hosts
Resource Manager Hosts

4. Enabling HA process will be started. You can view the background operations by clicking each steps.

Enable High Availability Process
Enable High Availability Process

5. Once all the processes completed, you will be getting ‘Finished’ status. Click ‘Finish’.

Finish High Availability Process
Finish High Availability Process

6. Verify the Resource Manager High availability by viewing the Yarn instances at Cloudera Manager –> YARN –> Instances.

Verify High Availability
Verify High Availability

You can see two Resource Manager, one will be in the state ‘Active’, another will be in ‘Standby’.

Check Resource Manager High Availability
Check Resource Manager High Availability
Conclusion

In this article, we have gone through the step by step procedure to enable High Availability on Resource Manager. Whenever the Active Resource Manager goes down, the Standby Resource manager will become Active so that production will not be having an outage.

Related

Tags: CentOS Tips, Cloudera Manager, Hadoop Tips, RHEL Tips

How to Create Virtual Machines in KVM Using Virt-Manager

Prev Post

Find and Replace in Vim / Vi

Next Post
Archives
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
Categories
  • Android
  • Ansible
  • Apache
  • Arch Linux
  • AWS
  • Backups
  • Bash Shell
  • CentOS
  • CentOS Stream
  • Cloud Software
  • CMS
  • Control Panels
  • CouchDB
  • Data Recovery Tools
  • Databases
  • Debian
  • Development Tools
  • Drupal
  • Editors
  • Fedora
  • Firewalls
  • GIMP
  • Hadoop
  • HAProxy
  • Joomla
  • Kali Linux
  • KDE
  • Kubernetes
  • KVM
  • Laravel
  • Linux Commands
  • Linux Distros
  • Linux IDE
  • Linux Mint
  • Linux Talks
  • Lubuntu
  • Mail Server
  • Manjaro
  • MariaDB
  • MongoDB
  • Monitoring Tools
  • MySQL
  • Network
  • Networking Commands
  • NFS
  • Nginx
  • Nodejs
  • Open Source
  • OpenSUSE
  • Package Managers
  • Pentoo
  • PHP
  • Podman
  • Postfix Mail Server
  • PostgreSQL
  • Python
  • Questions
  • RedHat
  • Redis Server
  • Security
  • Shell Scripting
  • SSH
  • Storage
  • Top Tools
  • Torrent Clients
  • Tutorial
  • Ubuntu
  • VirtualBox
  • Virtualization
  • VMware
  • VPN
  • Web Browsers
  • Web Hosting
  • Web Servers
  • Windows
  • Windows Subsystem
  • WordPress
  • Zorin OS
Visits
  • 0
  • 66
  • 14,747

DesignLinux.com © All rights reserved

Go to mobile version