为了更快的定位您的问题,请提供以下信息,谢谢
【详述】查询hudi catalog数据时报错
【背景】进行初步测试
【业务影响】本地测试环境
【是否存算分离】否
【StarRocks版本】StarRocks-3.2.0-rc
【集群规模】1fe(1 follower+2observer)+3be(fe与be混部)
【联系方式】:邮箱:u_1704958333501_9020@default.com
已经做过的操作:
mysql> CREATE EXTERNAL CATALOG “hudi_catalog”
-> PROPERTIES
-> (
-> “type” = “hudi”,
-> “hive.metastore.type” = “hive”,
-> “hive.metastore.uris” = “thrift://hadoop10:9083”,
-> “aws.s3.enable_ssl” = “true”,
-> “aws.s3.enable_path_style_access” = “true”,
-> “aws.s3.endpoint” = “",
-> “aws.s3.access_key” = "",
-> “aws.s3.secret_key” = "********”
-> );
Query OK, 0 rows affected (1.12 sec)
mysql> show catalogs;
±----------------±---------±-----------------------------------------------------------------+
| Catalog | Type | Comment |
±----------------±---------±-----------------------------------------------------------------+
| default_catalog | Internal | An internal catalog contains this cluster’s self-managed tables. |
| hudi_catalog | Hudi | NULL |
±----------------±---------±-----------------------------------------------------------------+
成功运行
mysql> show databases from hudi_catalog;
±-------------------+
| Database |
±-------------------+
| default |
| hudi_catalog |
±-------------------+
此语句也成功运行
mysql> select language from hudi_catalog.hudi_catalog.countrylanguage_rt where language=‘English’;
报错信息
ERROR 1064 (HY000): Failed to open the off-heap table scanner. java exception details: java.io.IOException: Failed to open the hudi MOR slice reader.
at com.starrocks.hudi.reader.HudiSliceScanner.open(HudiSliceScanner.java:219)
Caused by: java.lang.NullPointerException
at com.starrocks.hudi.reader.HudiSliceScanner.parseRequiredTypes(HudiSliceScanner.java:128)
at com.starrocks.hudi.reader.HudiSliceScanner.open(HudiSliceScanner.java:211)
fe.log报错信息
2024-01-11 15:15:43,469 WARN (thrift-server-pool-49|391) [DefaultCoordinator.updateFragmentExecStatus():868] exec state report failed status=errorCode INTERNAL_ERROR Failed to open the off-heap table scanner. java exception details: java.io.IOException: Failed to open the hudi MOR slice reader.
at com.starrocks.hudi.reader.HudiSliceScanner.open(HudiSliceScanner.java:219)
Caused by: java.lang.NullPointerException
at com.starrocks.hudi.reader.HudiSliceScanner.parseRequiredTypes(HudiSliceScanner.java:128)
at com.starrocks.hudi.reader.HudiSliceScanner.open(HudiSliceScanner.java:211)
, query_id=3b875bd7-b051-11ee-ac6f-000c299c85a8, instance_id=3b875bd7-b051-11ee-ac6f-000c299c85aa
2024-01-11 15:15:43,469 WARN (thrift-server-pool-49|391) [DefaultCoordinator.updateStatus():687] one instance report fail throw updateStatus(), need cancel. job id: -1, query id: 3b875bd7-b051-11ee-ac6f-000c299c85a8, instance id: 3b875bd7-b051-11ee-ac6f-000c299c85aa
2024-01-11 15:15:43,473 INFO (thrift-server-pool-49|391) [QueryRuntimeProfile.finishAllInstances():212] unfinished instances: [3b875bd7-b051-11ee-ac6f-000c299c85a9, 3b875bd7-b051-11ee-ac6f-000c299c85ab]
2024-01-11 15:15:43,474 WARN (thrift-server-pool-50|392) [DefaultCoordinator.updateFragmentExecStatus():868] exec state report failed status=errorCode INTERNAL_ERROR Failed to open the off-heap table scanner. java exception details: java.io.IOException: Failed to open the hudi MOR slice reader.
at com.starrocks.hudi.reader.HudiSliceScanner.open(HudiSliceScanner.java:219)
Caused by: java.lang.NullPointerException
at com.starrocks.hudi.reader.HudiSliceScanner.parseRequiredTypes(HudiSliceScanner.java:128)
at com.starrocks.hudi.reader.HudiSliceScanner.open(HudiSliceScanner.java:211)
, query_id=3b875bd7-b051-11ee-ac6f-000c299c85a8, instance_id=3b875bd7-b051-11ee-ac6f-000c299c85ab
2024-01-11 15:15:43,490 WARN (starrocks-mysql-nio-pool-19|378) [DefaultCoordinator.getNext():709] get next fail, need cancel. status errorCode CANCELLED InternalError, query id: 3b875bd7-b051-11ee-ac6f-000c299c85a8
2024-01-11 15:15:43,490 WARN (starrocks-mysql-nio-pool-19|378) [DefaultCoordinator.getNext():735] query failed: Failed to open the off-heap table scanner. java exception details: java.io.IOException: Failed to open the hudi MOR slice reader.
at com.starrocks.hudi.reader.HudiSliceScanner.open(HudiSliceScanner.java:219)
Caused by: java.lang.NullPointerException
at com.starrocks.hudi.reader.HudiSliceScanner.parseRequiredTypes(HudiSliceScanner.java:128)
at com.starrocks.hudi.reader.HudiSliceScanner.open(HudiSliceScanner.java:211)
- 外表查询报错
- be.out和fe.warn.log