StarRocks3.1.2查询HDFS中的paimon 0.5-SNAPSHOT表报错问题

[Kong]

【StarRocks版本】3.1.2
【详述】apache paimon 0.5保存的数据，使用paimon catalog查询，可以查询到paimon元数据，但是查询表数据都是报错的，已经安装说明添加相关配置没有效果，老师想咨询一下目前3.1.2是否支持paimon 0.5版本的数据查询，元数据类型： filesystem，保存在HDFS上
报错信息：
SQL 错误 [1064] [42000]: Failed to open the off-heap table scanner. java exception details: java.io.IOException: Failed to open the paimon reader.[com.starrocks.paimon.reader.PaimonSplitScanner.open(PaimonSplitScanner.java:159)]
org.jkiss.dbeaver.model.sql.DBSQLException: SQL 错误 [1064] [42000]: Failed to open the off-heap table scanner. java exception details: java.io.IOException: Failed to open the paimon reader.[com.starrocks.paimon.reader.PaimonSplitScanner.open(PaimonSplitScanner.java:159)]
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.executeStatement(JDBCStatementImpl.java:133)
at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.executeStatement(SQLQueryJob.java:582)
at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.lambda$1(SQLQueryJob.java:491)
at org.jkiss.dbeaver.model.exec.DBExecUtils.tryExecuteRecover(DBExecUtils.java:189)
at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.executeSingleQuery(SQLQueryJob.java:498)
at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.extractData(SQLQueryJob.java:934)
at org.jkiss.dbeaver.ui.editors.sql.SQLEditor$QueryResultsContainer.readData(SQLEditor.java:3865)
at org.jkiss.dbeaver.ui.controls.resultset.ResultSetJobDataRead.lambda$0(ResultSetJobDataRead.java:123)
at org.jkiss.dbeaver.model.exec.DBExecUtils.tryExecuteRecover(DBExecUtils.java:189)
at org.jkiss.dbeaver.ui.controls.resultset.ResultSetJobDataRead.run(ResultSetJobDataRead.java:121)
at org.jkiss.dbeaver.ui.controls.resultset.ResultSetViewer$ResultSetDataPumpJob.run(ResultSetViewer.java:5092)
at org.jkiss.dbeaver.model.runtime.AbstractJob.run(AbstractJob.java:105)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)
Caused by: java.sql.SQLSyntaxErrorException: Failed to open the off-heap table scanner. java exception details: java.io.IOException: Failed to open the paimon reader.[com.starrocks.paimon.reader.PaimonSplitScanner.open(PaimonSplitScanner.java:159)]
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:120)
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:763)
at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:648)
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.execute(JDBCStatementImpl.java:329)
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.lambda$0(JDBCStatementImpl.java:131)
at org.jkiss.dbeaver.utils.SecurityManagerUtils.wrapDriverActions(SecurityManagerUtils.java:96)
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.executeStatement(JDBCStatementImpl.java:131)
… 12 more

【附件】
查询paimon元数据成功截图

[Kong]

补充一下：hadoop版本3.1.3

[leocheng]

可以提供下jni.log吗?位置在be的log目录下

[Kong]

jni.INFO.log_20230911.tar.gz (2.2 KB)
jni.log上传了？麻烦帮忙看看原因，谢谢，看日志是主键解析有报错

[Kong]

看了一下可能是一个bug，如果表的字段是大写的话，就会报错，试了一下，如果表字段为小写，没有报错
custom表：
schema-custom.txt (962 字节)

23/09/11 16:22:31 ERROR [Thread-45] open(PaimonSplitScanner.java:158): Failed to open the paimon reader.
java.lang.RuntimeException: Cannot find field C_CUSTKEY in schema [c_custkey, c_name, c_address, c_nationkey, c_phone, c_acctbal, c_mktsegment, c_comment]
at com.starrocks.paimon.reader.PaimonSplitScanner.parseRequiredTypes(PaimonSplitScanner.java:123) ~[starrocks-paimon-reader.jar:?]
at com.starrocks.paimon.reader.PaimonSplitScanner.open(PaimonSplitScanner.java:152) ~[starrocks-paimon-reader.jar:?]

nation_lower表：
schema-nation_lower.txt (571 字节)

[leocheng]

好的，正在修复中

[Kong]

你好，问一下修复好了大概什么时候可以发布出来，可否可以提前下载尝鲜一下，急着验证可行性，嘻嘻

[Kong]

好像这个bug已经改了，我将代码拉下来，编译后替换原来的包starrocks-paimon-reader.jar，可以了

[MatthewHoo]

我们也遇到了相同的问题，麻烦问下，你编的是v3.1.3 然后替换原来的包starrocks-paimon-reader.jar，就解决了么

[MatthewHoo]

大概在哪个版本能修复？

[Kong]

据说3.1.4修复了，今天发版了，这边还没有测试，之前是拉了最新main分支的代码编译替换的