Monday, July 31, 2017

Procedure to change Journal Node edit directory Hadoop - Name Node issue

Procedure to change Journal Node directory:

1. Create/add drive/disk (/data06)  and /data06/dfs/jn folders for journal node only iin all Nodes where journal node service installed.

2. Update hdfs-site.xml file in all Nodes where journal node service installed
 
    dfs.journalnode.edits.dir
    /data06/dfs/jn
 

3.    Copy existing edit folder from /data01/dfs/jn/mas (considering this folder having old edit logs) to new directory in all Nodes where journal node service installed ( this will take some time to copy edit logs) and change the permissions as below
cp -ar /data01/dfs/jn/*  /data06/dfs/jn /.
chown -R hdfs:hdfs /data06
chmod 700 /data06/dfs

4.  Stop standby name node and journal node
service hadoop-hdfs-namenode stop
service hadoop-hdfs-journalnode stop

5.         Start journal node and standby name node. Both services should be up and running
service hadoop-hdfs-journalnode start
service hadoop-hdfs-namenode start

6.         Stop active name node and journal node. Stand by should come up now
service hadoop-hdfs-namenode stop
service hadoop-hdfs-journalnode stop

7.         Start journal node and active name node
service hadoop-hdfs-journalnode start
service hadoop-hdfs-namenode start

8.        Restart 3rd journal node
service hadoop-hdfs-journalnode stop
service hadoop-hdfs-journalnode start

No comments: