全网最详细的再次或多次格式化导致namenode的ClusterID和datanode的ClusterID之间不一致的问题解决办法（图文详解）

2022-10-22 15:47:23

　　　　不多说，直接上干货！

　　java.io.IOException: Incompatible clusterIDs in /opt/modules/hadoop-2.6.0/data/tmp/dfs/data: namenode clusterID = CID-10c4a581-792e-48a2-932b-c279a448df47; datanode clusterID = CID-ea44321a-a510-430f-93b7-4334c3c800b7

-- ::, INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting BPOfferServices for nameservices: ns

-- ::, INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to bigdata-pro01.kfk.com/192.168.80.151: starting to offer service

-- ::, INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool <registering> (Datanode Uuid unassigned) service to bigdata-pro02.kfk.com/192.168.80.152: starting to offer service

-- ::, INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting

-- ::, INFO org.apache.hadoop.ipc.Server: IPC Server listener on : starting

-- ::, INFO org.apache.hadoop.hdfs.server.common.Storage: DataNode version: - and NameNode layout version: -

-- ::, INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /opt/modules/hadoop-2.6./data/tmp/dfs/data/in_use.lock acquired by nodename @bigdata-pro01.kfk.com

-- ::, INFO org.apache.hadoop.hdfs.server.common.Storage: DataNode version: - and NameNode layout version: -

-- ::, INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /opt/modules/hadoop-2.6./data/tmp/dfs/data/in_use.lock acquired by nodename @bigdata-pro01.kfk.com

-- ::, FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to bigdata-pro02.kfk.com/192.168.80.152:. Exiting.

java.io.IOException: Incompatible clusterIDs in /opt/modules/hadoop-2.6./data/tmp/dfs/data: namenode clusterID = CID-10c4a581-792e-48a2-932b-c279a448df47; datanode clusterID = CID-ea44321a-a510-430f-93b7-4334c3c800b7

    at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:)

    at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:)

    at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:)

    at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:)

    at java.lang.Thread.run(Thread.java:)

-- ::, FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool <registering> (Datanode Uuid unassigned) service to bigdata-pro01.kfk.com/192.168.80.151:. Exiting.

java.io.IOException: Incompatible clusterIDs in /opt/modules/hadoop-2.6./data/tmp/dfs/data: namenode clusterID = CID-10c4a581-792e-48a2-932b-c279a448df47; datanode clusterID = CID-ea44321a-a510-430f-93b7-4334c3c800b7

    at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:)

    at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:)

    at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:)

    at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:)

    at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:)

    at java.lang.Thread.run(Thread.java:)

-- ::, WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool <registering> (Datanode Uuid unassigned) service to bigdata-pro01.kfk.com/192.168.80.151:

解决办法：

　　改为最新的，一致，即可。

[kfk@bigdata-pro01 ns]$ cd current/

[kfk@bigdata-pro01 current]$ ll

total

drwxrwxr-x.  kfk kfk  Jun  : paxos

-rw-rw-r--.  kfk kfk   Jun  : VERSION

[kfk@bigdata-pro01 current]$ cat VERSION

#Sat Jun  :: CST

namespaceID=

clusterID=CID-10c4a581-792e-48a2-932b-c279a448df47

cTime=

storageType=JOURNAL_NODE

layoutVersion=-

[kfk@bigdata-pro01 current]$ pwd
/opt/modules/hadoop-2.6.0/data/jn/ns/current

[kfk@bigdata-pro01 current]$

[kfk@bigdata-pro01 current]$ ll

total

drwx------.  kfk kfk  Jun  : BP--192.168.80.151-

-rw-rw-r--.  kfk kfk   Jun  : VERSION

[kfk@bigdata-pro01 current]$ vim VERSION

[kfk@bigdata-pro01 current]$ pwd
/opt/modules/hadoop-2.6.0/data/tmp/dfs/data/current

[kfk@bigdata-pro01 current]$

[kfk@bigdata-pro02 current]$ cat VERSION

#Sat Jun  :: CST

namespaceID=

clusterID=CID-10c4a581-792e-48a2-932b-c279a448df47

cTime=

storageType=NAME_NODE

blockpoolID=BP--192.168.80.151-

layoutVersion=-

[kfk@bigdata-pro02 current]$ pwd
/opt/modules/hadoop-2.6.0/data/tmp/dfs/name/current

[kfk@bigdata-pro02 current]$

[kfk@bigdata-pro03 current]$ pwd
/opt/modules/hadoop-2.6.0/data/tmp/dfs/data/current

[kfk@bigdata-pro03 current]$ cat VERSION

#Sat Jun  :: CST

storageID=DS-dd6ab07e-640c-467d-88cf-ee421a0a2289

clusterID=CID-10c4a581-792e-48a2-932b-c279a448df47

cTime=

datanodeUuid=05ce9b98-1e61-490c--43398f96c12e

storageType=DATA_NODE

layoutVersion=-

[kfk@bigdata-pro03 current]$

　　　　先，

[kfk@bigdata-pro01 hadoop-2.6.0]$ sbin/stop-all.sh

　　　　再，

[kfk@bigdata-pro01 hadoop-2.6.0]$ sbin/start-all.sh

欢迎大家，加入我的微信公众号：大数据躺过的坑人工智能躺过的坑

同时，大家可以关注我的个人博客：

http://www.cnblogs.com/zlslch/ 和 http://www.cnblogs.com/lchzls/ http://www.cnblogs.com/sunnyDream/

详情请见：http://www.cnblogs.com/zlslch/p/7473861.html

　　人生苦短，我愿分享。本公众号将秉持活到老学到老学习无休止的交流分享开源精神，汇聚于互联网和个人学习工作的精华干货知识，一切来于互联网，反馈回互联网。
　　目前研究领域：大数据、机器学习、深度学习、人工智能、数据挖掘、数据分析。语言涉及：Java、Scala、Python、Shell、Linux等。同时还涉及平常所使用的手机、电脑和互联网上的使用技巧、问题和实用软件。只要你一直关注和呆在群里，每天必须有收获

对应本平台的讨论和答疑QQ群：大数据和人工智能躺过的坑（总群）（161156071）

码农公寓

相关文章