MAPREDUCE服务 MRS-Structured Streaming的cluster模式,在数据处理过程中终止ApplicationManager,应用失败:问题

时间:2024-06-29 14:11:28

问题

Structured Streaming的cluster模式,在数据处理过程中终止ApplicationManager,执行应用时显示如下异常。

2017-05-09 20:46:02,393 | INFO  | main | 
  client token: Token { kind: YARN_CLIENT_TOKEN, service:  }
  diagnostics: User class threw exception: org.apache.spark.sql.AnalysisException: This query does not support recovering from checkpoint location. Delete hdfs://hacluster/structuredtest/checkpoint/offsets to start over.;
  ApplicationMaster host: 10.96.101.170
  ApplicationMaster RPC port: 0
  queue: default
  start time: 1494333891969
  final status: FAILED
  tracking URL: https://9-96-101-191:8090/proxy/application_1493689105146_0052/
  user: spark2x | org.apache.spark.internal.Logging$class.logInfo(Logging.scala:54)
Exception in thread "main" org.apache.spark.SparkException: Application application_1493689105146_0052 finished with failed status
support.huaweicloud.com/devg3-mrs/mrs_07_200156.html