Monday, April 30, 2018

How to move the Job History Server (JHS) from one host to another.

Moving the Job History Server to another node:

The following steps are the same for Cloudera Manager and non Cloudera Manager managed clusters, only the tool to perform the steps are different.
  1. Shut down and remove the Job History Server from the old node
  2. Add a new Job History Server to the new node
  3. Start the Job History Server on the new node
  4. Restart the Resource and Node Managers. In a Cloudera Manager managed cluster this will deploy and activate the updated configuration. Otherwise the updated mapred-site.xml must be distributed to all nodes before restarting.
The mapred-site.xml is also part of the client configuration and is thus present on all nodes in the cluster. The file should be updated with the new Job History Server details on all nodes.

Note: No data is stored locally on the JHS node
Note: The finished applications in the Resource Manager web UI will still reference the old JHS node, these links will not be updated.

No comments: