MAPREDUCE服务 MRS-HDFS写并发较大时报副本不足:问题背景与现象

时间:2024-08-27 10:23:56

问题背景与现象

用户运行作业时写文件到HDFS,偶现写文件失败的情况。

操作日志如下:

105 | INFO  | IPC Server handler 23 on 25000 | IPC Server handler 23 on 25000, call org.apache.hadoop.hdfs.protocol.ClientProtocol.addBlock from 192.168.1.96:47728 Call#1461167 Retry#0 | Server.java:2278 
java.io.IOException: File /hive/warehouse/000000_0.835bf64f-4103 could only be replicated to 0 nodes instead of minReplication (=1).  There are 3 datanode(s) running and 3 node(s) are excluded in this operation.
support.huaweicloud.com/trouble-mrs/mrs_03_0291.html