Failed to read S3 file

💬 StarRocks 用户问答
#1

【详述】通过 hive catalog 查询 S3 上的 ORC 文件，报 Failed to read XX InvalidRange Message: The requested range is not satisfiable
【业务影响】有，查询总是出错
【是否存算分离】否
【StarRocks版本】2.5.13
【集群规模】3fe（1 follower+2observer）+5be（fe与be混部）
【机器信息】CPU虚拟核/内存/网卡，例如：16C/64G
【联系方式】StarRocks社区群-12（Hale）

HdfsOrcScanner::do_open failed. reason = Failed to read s3://XXXXX/dws_ots_order_profit_kpi_index_intc_da/dt=2023-11-27/000001_0: IO error: code=416(SdkErrorType:100), message=Unable to parse ExceptionName: InvalidRange Message: The requested range is not satisfiable /build/starrocks/be/src/io/readable.cpp:10 value_or_err_L10 /build/starrocks/be/src/io/shared_buffered_input_stream.cpp:152 _stream->read_at_fully(offset, out, count)

#2

麻烦您发下对应的建表和执行语句

#3

CREATE EXTERNAL CATALOG hive
PROPERTIES
(
“type” = “hive”,
“aws.s3.use_instance_profile” = “false”,
“aws.s3.access_key” = “XXX”,
“aws.s3.secret_key” = “XXXXX”,
“aws.s3.region” = “cn-northwest-1”,
“hive.metastore.type” = “glue”,
“aws.glue.use_instance_profile” = “false”,
“aws.glue.access_key” = “XXXX”,
“aws.glue.secret_key” = “XXXXXX”,
“aws.glue.region” = “cn-northwest-1”
);

#4 
select * from hive.ylz_ads.ads_whm_dbd_stock_index_da limit 10
#5

您好 是使用 AWS Glue 作为元数据服务的？ 这创建语句有重复 参考下docs中的例子 走一遍呢 有跑通的demo吗 https://docs.starrocks.io/zh/docs/data_source/catalog/hive_catalog/#创建-hive-catalog

#6

应该是我拷贝重复了。所有都跑通了的，只是有时候要报上面的错误

#7

报错的问题该如何解决呢？

京ICP备2022026421号-1