数据湖探索 DLI-LOAD数据到OBS外表报错:IllegalArgumentException: Buffer size too small. size:问题描述

时间:2024-11-06 21:53:31

问题描述

在Spark SQL作业中,使用LOAD DATA命令导入数据到 DLI 表中时报如下错误:

error.DLI.0001: IllegalArgumentException: Buffer size too small. size = 262144 needed = 2272881
或者如下错误
error.DLI.0999: InvalidProtocolBufferException: EOF in compressed stream footer position: 3 length: 479 range: 0 offset: 3 limit: 479 range 0 = 0 to 479 while trying to read 143805 bytes
support.huaweicloud.com/dli_faq/dli_03_0169.html