为了更快的定位您的问题，请提供以下信息，谢谢
【详述】starrocks on k8s 存算分离，查询maxcompute 表报错说确实odps类，请问，是需要额外打镜像吗
【背景】
【业务影响】
【是否存算分离】是
【StarRocks版本】3.4.1
【集群规模】1fe+3be
fe报错如下：
be报错日志：
W20250415 12:15:39.042131 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:15:40.146776 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
I20250415 12:15:41.283057 140571630655040 jni_scanner.cpp:132] Initialize a scanner with parameters: endpoint->https://service.cn-beijing-vpc.maxcompute.aliyun-inc.com/api, nested_fields->, project_name->bc_dw, quota_name->pay-as-you-go, required_fields->user_id,p_date, session_id->20250415201540d15d750b01b39fd602target, split_index->0, split_policy->size, table_name->dim_user_df, time_zone->Etc/UTC, tunnel_endpoint->,
E20250415 12:15:41.283836 140571630655040 scan_operator.cpp:478] scan fragment 580427c3-19f3-11f0-9648-d68d29fc7552 driver 0 Scan tasks error: Internal error: Failed to initialize a scanner instance. java exception details: java.lang.NoClassDefFoundError: Could not initialize class com.aliyun.odps.table.read.impl.batch.TableBatchReadSessionImpl
at java.base/java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
at java.base/java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1717)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:264)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:262)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:261)
at java.base/java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:555)
at java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2020)
at java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1870)
at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2201)
at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:489)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:447)
at com.starrocks.odps.reader.OdpsSplitScanner.deserialize(OdpsSplitScanner.java:224)
at com.starrocks.odps.reader.OdpsSplitScanner.(OdpsSplitScanner.java:94)
be/src/exec/jni_scanner.cpp:138 _check_jni_exception(env, “Failed to initialize a scanner instance.”)
be/src/exec/jni_scanner.cpp:52 _init_jni_table_scanner(env, state)
be/src/exec/hdfs_scanner.cpp:219 do_open(runtime_state)
be/src/connector/hive_connector.cpp:185 _init_scanner(state)
be/src/exec/pipeline/scan/connector_scan_operator.cpp:757 _data_source->open(state)
be/src/exec/pipeline/scan/connector_scan_operator.cpp:784 _open_data_source(state, &mem_alloc_failed)
W20250415 12:15:41.283894 140571759691328 pipeline_driver.cpp:322] pull_chunk returns not ok status Internal error: Failed to initialize a scanner instance. java exception details: java.lang.NoClassDefFoundError: Could not initialize class com.aliyun.odps.table.read.impl.batch.TableBatchReadSessionImpl
at java.base/java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
at java.base/java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1717)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:264)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:262)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:261)
at java.base/java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:555)
at java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2020)
at java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1870)
at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2201)
at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:489)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:447)
at com.starrocks.odps.reader.OdpsSplitScanner.deserialize(OdpsSplitScanner.java:224)
at com.starrocks.odps.reader.OdpsSplitScanner.(OdpsSplitScanner.java:94)
be/src/exec/jni_scanner.cpp:138 _check_jni_exception(env, “Failed to initialize a scanner instance.”)
be/src/exec/jni_scanner.cpp:52 _init_jni_table_scanner(env, state)
be/src/exec/hdfs_scanner.cpp:219 do_open(runtime_state)
be/src/connector/hive_connector.cpp:185 _init_scanner(state)
be/src/exec/pipeline/scan/connector_scan_operator.cpp:757 _data_source->open(state)
be/src/exec/pipeline/scan/connector_scan_operator.cpp:784 _open_data_source(state, &mem_alloc_failed)
be/src/exec/pipeline/scan/scan_operator.cpp:279 _get_scan_status()
W20250415 12:15:41.283919 140571759691328 pipeline_driver_executor.cpp:177] [Driver] Process error, query_id=580427c3-19f3-11f0-9648-d68d29fc754f, instance_id=580427c3-19f3-11f0-9648-d68d29fc7552, status=Internal error: Failed to initialize a scanner instance. java exception details: java.lang.NoClassDefFoundError: Could not initialize class com.aliyun.odps.table.read.impl.batch.TableBatchReadSessionImpl
at java.base/java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
at java.base/java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1717)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:264)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:262)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:261)
at java.base/java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:555)
at java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2020)
at java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1870)
at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2201)
at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:489)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:447)
at com.starrocks.odps.reader.OdpsSplitScanner.deserialize(OdpsSplitScanner.java:224)
at com.starrocks.odps.reader.OdpsSplitScanner.(OdpsSplitScanner.java:94)
: BE:10002
I20250415 12:15:41.283998 140571759691328 query_context.cpp:57] finished query_id:580427c3-19f3-11f0-9648-d68d29fc754f context life time:1768094 cpu costs:61577 peak memusage:112536 scan_bytes:0 spilled bytes:0
I20250415 12:15:43.300723 140571546728000 jni_scanner.cpp:132] Initialize a scanner with parameters: endpoint->https://service.cn-beijing-vpc.maxcompute.aliyun-inc.com/api, nested_fields->, project_name->bc_dw, quota_name->pay-as-you-go, required_fields->user_id,p_date, session_id->202504152015429c3d390a01b3959502target, split_index->0, split_policy->size, table_name->dim_user_df, time_zone->Etc/UTC, tunnel_endpoint->,
E20250415 12:15:43.301545 140571546728000 scan_operator.cpp:478] scan fragment 5998d188-19f3-11f0-9648-d68d29fc7552 driver 0 Scan tasks error: Internal error: Failed to initialize a scanner instance. java exception details: java.lang.NoClassDefFoundError: Could not initialize class com.aliyun.odps.table.read.impl.batch.TableBatchReadSessionImpl
at java.base/java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
at java.base/java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1717)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:264)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:262)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:261)
at java.base/java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:555)
at java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2020)
at java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1870)
at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2201)
at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:489)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:447)
at com.starrocks.odps.reader.OdpsSplitScanner.deserialize(OdpsSplitScanner.java:224)
at com.starrocks.odps.reader.OdpsSplitScanner.(OdpsSplitScanner.java:94)
be/src/exec/jni_scanner.cpp:138 _check_jni_exception(env, “Failed to initialize a scanner instance.”)
be/src/exec/jni_scanner.cpp:52 _init_jni_table_scanner(env, state)
be/src/exec/hdfs_scanner.cpp:219 do_open(runtime_state)
be/src/connector/hive_connector.cpp:185 _init_scanner(state)
be/src/exec/pipeline/scan/connector_scan_operator.cpp:757 _data_source->open(state)
be/src/exec/pipeline/scan/connector_scan_operator.cpp:784 _open_data_source(state, &mem_alloc_failed)
W20250415 12:15:43.301601 140571742905920 pipeline_driver.cpp:322] pull_chunk returns not ok status Internal error: Failed to initialize a scanner instance. java exception details: java.lang.NoClassDefFoundError: Could not initialize class com.aliyun.odps.table.read.impl.batch.TableBatchReadSessionImpl
at java.base/java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
at java.base/java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1717)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:264)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:262)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:261)
at java.base/java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:555)
at java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2020)
at java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1870)
at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2201)
at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:489)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:447)
at com.starrocks.odps.reader.OdpsSplitScanner.deserialize(OdpsSplitScanner.java:224)
at com.starrocks.odps.reader.OdpsSplitScanner.(OdpsSplitScanner.java:94)
be/src/exec/jni_scanner.cpp:138 _check_jni_exception(env, “Failed to initialize a scanner instance.”)
be/src/exec/jni_scanner.cpp:52 _init_jni_table_scanner(env, state)
be/src/exec/hdfs_scanner.cpp:219 do_open(runtime_state)
be/src/connector/hive_connector.cpp:185 _init_scanner(state)
be/src/exec/pipeline/scan/connector_scan_operator.cpp:757 _data_source->open(state)
be/src/exec/pipeline/scan/connector_scan_operator.cpp:784 _open_data_source(state, &mem_alloc_failed)
be/src/exec/pipeline/scan/scan_operator.cpp:279 _get_scan_status()
W20250415 12:15:43.301627 140571742905920 pipeline_driver_executor.cpp:177] [Driver] Process error, query_id=5998d188-19f3-11f0-9648-d68d29fc754f, instance_id=5998d188-19f3-11f0-9648-d68d29fc7552, status=Internal error: Failed to initialize a scanner instance. java exception details: java.lang.NoClassDefFoundError: Could not initialize class com.aliyun.odps.table.read.impl.batch.TableBatchReadSessionImpl
at java.base/java.io.ObjectStreamClass.hasStaticInitializer(Native Method)
at java.base/java.io.ObjectStreamClass.computeDefaultSUID(ObjectStreamClass.java:1717)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:264)
at java.base/java.io.ObjectStreamClass$1.run(ObjectStreamClass.java:262)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/java.io.ObjectStreamClass.getSerialVersionUID(ObjectStreamClass.java:261)
at java.base/java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:555)
at java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2020)
at java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1870)
at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2201)
at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:489)
at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:447)
at com.starrocks.odps.reader.OdpsSplitScanner.deserialize(OdpsSplitScanner.java:224)
at com.starrocks.odps.reader.OdpsSplitScanner.(OdpsSplitScanner.java:94)
: BE:10002
I20250415 12:15:43.301733 140571742905920 query_context.cpp:57] finished query_id:5998d188-19f3-11f0-9648-d68d29fc754f context life time:2003390 cpu costs:77282 peak memusage:195664 scan_bytes:0 spilled bytes:0
I20250415 12:15:48.547888 140573329585728 daemon.cpp:158] Current memory statistics: process(5974240592), query_pool(0), load(0), metadata(1548141000), compaction(0), schema_change(0), page_cache(2848210032), update(0), chunk_allocator(0), passthrough(0), clone(0), consistency(0), datacache(23624472), jit(0)
W20250415 12:15:49.269165 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
I20250415 12:15:49.457873 140570832922176 update_manager.cpp:389] index cache expire: before:(0 0) after:(0 0) expire: (0 0)
I20250415 12:15:49.457887 140570832922176 update_manager.cpp:674] update state cache expire: (0 0), index cache expire: (0 0), compaction cache expire: (0 0)
W20250415 12:15:50.342385 140570936256064 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
I20250415 12:15:52.027375 140570488821312 starlet.cc:144] Report worker state to ‘bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local:6090’, counter:44077
W20250415 12:15:56.387748 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:15:57.493035 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:15:58.599087 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:15:59.704205 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:16:00.447883 140570936256064 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
I20250415 12:16:03.549888 140573329585728 daemon.cpp:158] Current memory statistics: process(5974240752), query_pool(0), load(0), metadata(1548141000), compaction(0), schema_change(0), page_cache(2848210032), update(0), chunk_allocator(0), passthrough(0), clone(0), consistency(0), datacache(23624472), jit(0)
W20250415 12:16:05.821719 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:16:06.926327 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:16:08.032913 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:16:09.138252 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:16:10.244413 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:16:16.358583 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
W20250415 12:16:17.463467 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more data to read.
I20250415 12:16:18.551751 140573329585728 daemon.cpp:158] Current memory statistics: process(5974240912), query_pool(0), load(0), metadata(1548141000), compaction(0), schema_change(0), page_cache(2848210032), update(0), chunk_allocator(0), passthrough(0), clone(0), consistency(0), datacache(23624472), jit(0)
W20250415 12:16:18.570095 140570953041472 thrift_rpc_helper.cpp:118] Rpc error: FE RPC failure, address=TNetworkAddress(hostname=bc-dw-starrocks-fe-0.bc-dw-starrocks-fe-search.starrocks.svc.cluster.local, port=9020), reason=No more da
MaxCompute catalog:
CREATE EXTERNAL CATALOG ali_mc
PROPERTIES
(
“type”=“odps”,
“odps.access.id”=“xxx”,
“odps.access.key”=“xxx”,
“odps.endpoint”=“https://service.cn-beijing-vpc.maxcompute.aliyun-inc.com/api”,
“odps.project”=“bc_dw”,
“odps.tunnel.quota”=“pay-as-you-go”
);
不过看fe、be的lib文件是有odps相关的jar包的
fe:
be:
