MAPREDUCE服务 MRS-ResourceManager进行主备切换后,任务中断后运行时间过长:回答

时间:2024-11-28 01:44:24

回答

因为ResourceManager HA已启用,但是Work-preserving RM restart功能未启用。

如果Work-preserving RM restart功能未启用,ResourceManager切换时container会被kill,然后导致Application Master超时。Work-preserving RM restart功能介绍请参见:

MRS 3.2.0之前版本:http://hadoop.apache.org/docs/r3.1.1/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html

MRS 3.2.0及之后版本:https://hadoop.apache.org/docs/r3.3.1/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html

support.huaweicloud.com/cmpntguide-lts-mrs/mrs_01_1789.html