MAPREDUCE服务 MRS-当事件队列溢出时如何配置事件队列的大小:问题

时间:2024-11-28 01:44:29

问题

当Driver日志中出现如下的日志时,表示事件队列溢出了。当事件队列溢出时如何配置事件队列的大小?

  • 普通应用
    Dropping SparkListenerEvent because no remaining room in event queue. 
    This likely means one of the SparkListeners is too slow and cannot keep
    up with the rate at which tasks are being started by the scheduler.
  • Spark Streaming应用
    Dropping StreamingListenerEvent because no remaining room in event queue.
    This likely means one of the StreamingListeners is too slow and cannot keep
    up with the rate at which events are being started by the scheduler.
support.huaweicloud.com/cmpntguide-lts-mrs/mrs_01_2008.html