【详述】sr集群创建的hive catalog 创建后能够正常使用，在断电后，重启sr集群，sr catalog使用报错，版本是3.2.4 另外一套3.1版本集群能够正常访问hive catalog.
【背景】断电重启
【业务影响】
[抓包]
192是sr 节点 152是hms服务
存算一体
【StarRocks版本】3.2.4
【集群规模】例如：3fe（1 follower+2observer）+3be（fe与be混部）
【机器信息】CPU虚拟核/内存/网卡，例如：16C/64G/万兆
【联系方式】bo.zhang@ionrocking.com
【附件】
2024-04-12 11:23:38,708 ERROR (starrocks-mysql-nio-pool-2|364) [HiveMetaClient.callRPC():163] Failed to ge
t database test01java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:161) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:150) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.getDb(HiveMetaClient.java:252) ~[starrocks-fe.jar:?
] at com.starrocks.connector.hive.HiveMetastore.getDb(HiveMetastore.java:94) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadDb(CachingHiveMetastore.java:288) ~[starr
ocks-fe.jar:?] at com.google.common.cache.CacheLoader$FunctionToCacheLoader.load(CacheLoader.java:169) ~[spark-dp
p-1.0.0.jar:?] at com.google.common.cache.CacheLoader$1.load(CacheLoader.java:192) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3570) ~[spa
rk-dpp-1.0.0.jar:?] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2312) ~[spark-dpp-1.0.0.jar
:?] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2189) ~[spark-dpp-1.
0.0.jar:?] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.get(LocalCache.java:4011) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4034) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:5010) ~[spark-dpp-1.0.
0.jar:?] at com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:5017) ~[spark
-dpp-1.0.0.jar:?] at com.starrocks.connector.hive.CachingHiveMetastore.get(CachingHiveMetastore.java:623) ~[starrock
s-fe.jar:?] at com.starrocks.connector.hive.CachingHiveMetastore.getDb(CachingHiveMetastore.java:284) ~[starro
cks-fe.jar:?] at com.starrocks.connector.hive.HiveMetastoreOperations.getDb(HiveMetastoreOperations.java:145) ~[
starrocks-fe.jar:?] at com.starrocks.connector.hive.HiveMetadata.getDb(HiveMetadata.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.CatalogConnectorMetadata.getDb(CatalogConnectorMetadata.java:192) ~[sta
rrocks-fe.jar:?] at com.starrocks.server.MetadataMgr.lambda$getDb$1(MetadataMgr.java:221) ~[starrocks-fe.jar:?]
at java.util.Optional.map(Optional.java:215) ~[?:1.8.0_333]
at com.starrocks.server.MetadataMgr.getDb(MetadataMgr.java:221) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.changeCatalogDb(GlobalStateMgr.java:3713) ~[starrocks-fe.ja
r:?] at com.starrocks.qe.ConnectProcessor.handleInitDb(ConnectProcessor.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:582) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:883) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.
jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed ou
t at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[libthrift-0.
13.0.jar:0.13.0] at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[libthrift-0.13.0.jar:0.13.
0] at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:455) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:354) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:243) ~[libthri
ft-0.13.0.jar:0.13.0] at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[libthrift-0.13.0.jar:0.1
3.0] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMet
astore.java:1151) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastor
e.java:1138) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1068)
~[starrocks-fe.jar:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:20
8) ~[hive-apache-3.1.2-13.jar:?] at com.sun.proxy.$Proxy43.getDatabase(Unknown Source) ~[?:?]
… 35 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[?:1.8.0_333]
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) ~[?:1.8.0_333]
at java.net.SocketInputStream.read(SocketInputStream.java:171) ~[?:1.8.0_333]
at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:1.8.0_333]
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) ~[?:1.8.0_333]
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) ~[?:1.8.0_333]
at java.io.BufferedInputStream.read(BufferedInputStream.java:345) ~[?:1.8.0_333]
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:125) ~[libthrift-0.
13.0.jar:0.13.0] at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[libthrift-0.13.0.jar:0.13.
0] at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:455) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:354) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:243) ~[libthri
ft-0.13.0.jar:0.13.0] at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[libthrift-0.13.0.jar:0.1
3.0] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMet
astore.java:1151) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastor
e.java:1138) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1068)
~[starrocks-fe.jar:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:20
8) ~[hive-apache-3.1.2-13.jar:?] at com.sun.proxy.$Proxy43.getDatabase(Unknown Source) ~[?:?]
… 35 more
2024-04-12 11:23:38,712 ERROR (starrocks-mysql-nio-pool-2|364) [HiveMetaClient.callRPC():170] An exception
occurred when using the current long link to access metastore. msg: Failed to get database test012024-04-12 11:23:38,712 INFO (starrocks-mysql-nio-pool-2|364) [HiveMetaStoreClient.close():624] Closed a c
onnection to metastore, current connections: 02024-04-12 11:23:38,712 ERROR (starrocks-mysql-nio-pool-2|364) [CachingHiveMetastore.get():625] Error occu
rred when loading cachecom.google.common.util.concurrent.UncheckedExecutionException: com.starrocks.connector.exception.StarRocks
ConnectorException: Failed to get database test01, msg: null at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2085) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.get(LocalCache.java:4011) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4034) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:5010) ~[spark-dpp-1.0.
0.jar:?] at com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:5017) ~[spark
-dpp-1.0.0.jar:?] at com.starrocks.connector.hive.CachingHiveMetastore.get(CachingHiveMetastore.java:623) ~[starrock
s-fe.jar:?] at com.starrocks.connector.hive.CachingHiveMetastore.getDb(CachingHiveMetastore.java:284) ~[starro
cks-fe.jar:?] at com.starrocks.connector.hive.HiveMetastoreOperations.getDb(HiveMetastoreOperations.java:145) ~[
starrocks-fe.jar:?] at com.starrocks.connector.hive.HiveMetadata.getDb(HiveMetadata.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.CatalogConnectorMetadata.getDb(CatalogConnectorMetadata.java:192) ~[sta
rrocks-fe.jar:?] at com.starrocks.server.MetadataMgr.lambda$getDb$1(MetadataMgr.java:221) ~[starrocks-fe.jar:?]
at java.util.Optional.map(Optional.java:215) ~[?:1.8.0_333]
at com.starrocks.server.MetadataMgr.getDb(MetadataMgr.java:221) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.changeCatalogDb(GlobalStateMgr.java:3713) ~[starrocks-fe.ja
r:?] at com.starrocks.qe.ConnectProcessor.handleInitDb(ConnectProcessor.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:582) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:883) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.
jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: com.starrocks.connector.exception.StarRocksConnectorException: Failed to get database test01, m
sg: null at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:164) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:150) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.getDb(HiveMetaClient.java:252) ~[starrocks-fe.jar:?
] at com.starrocks.connector.hive.HiveMetastore.getDb(HiveMetastore.java:94) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadDb(CachingHiveMetastore.java:288) ~[starr
ocks-fe.jar:?] at com.google.common.cache.CacheLoader$FunctionToCacheLoader.load(CacheLoader.java:169) ~[spark-dp
p-1.0.0.jar:?] at com.google.common.cache.CacheLoader$1.load(CacheLoader.java:192) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3570) ~[spa
rk-dpp-1.0.0.jar:?] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2312) ~[spark-dpp-1.0.0.jar
:?] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2189) ~[spark-dpp-1.
0.0.jar:?] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2079) ~[spark-dpp-1.0.0.jar:?]
… 20 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:161) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:150) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.getDb(HiveMetaClient.java:252) ~[starrocks-fe.jar:?
] at com.starrocks.connector.hive.HiveMetastore.getDb(HiveMetastore.java:94) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadDb(CachingHiveMetastore.java:288) ~[starr
ocks-fe.jar:?] at com.google.common.cache.CacheLoader$FunctionToCacheLoader.load(CacheLoader.java:169) ~[spark-dp
p-1.0.0.jar:?] at com.google.common.cache.CacheLoader$1.load(CacheLoader.java:192) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3570) ~[spa
rk-dpp-1.0.0.jar:?] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2312) ~[spark-dpp-1.0.0.jar
:?] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2189) ~[spark-dpp-1.
0.0.jar:?] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2079) ~[spark-dpp-1.0.0.jar:?]
… 20 more
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed ou
t at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[libthrift-0.
13.0.jar:0.13.0] at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[libthrift-0.13.0.jar:0.13.
0] at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:455) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:354) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:243) ~[libthri
ft-0.13.0.jar:0.13.0] at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[libthrift-0.13.0.jar:0.1
3.0] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMet
astore.java:1151) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastor
e.java:1138) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1068)
~[starrocks-fe.jar:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:20
8) ~[hive-apache-3.1.2-13.jar:?] at com.sun.proxy.$Proxy43.getDatabase(Unknown Source) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:161) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:150) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.getDb(HiveMetaClient.java:252) ~[starrocks-fe.jar:?
] at com.starrocks.connector.hive.HiveMetastore.getDb(HiveMetastore.java:94) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadDb(CachingHiveMetastore.java:288) ~[starr
ocks-fe.jar:?] at com.google.common.cache.CacheLoader$FunctionToCacheLoader.load(CacheLoader.java:169) ~[spark-dp
p-1.0.0.jar:?] at com.google.common.cache.CacheLoader$1.load(CacheLoader.java:192) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3570) ~[spa
rk-dpp-1.0.0.jar:?] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2312) ~[spark-dpp-1.0.0.jar
:?] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2189) ~[spark-dpp-1.
0.0.jar:?] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2079) ~[spark-dpp-1.0.0.jar:?]
… 20 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[?:1.8.0_333]
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) ~[?:1.8.0_333]
at java.net.SocketInputStream.read(SocketInputStream.java:171) ~[?:1.8.0_333]
at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:1.8.0_333]
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) ~[?:1.8.0_333]
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) ~[?:1.8.0_333]
at java.io.BufferedInputStream.read(BufferedInputStream.java:345) ~[?:1.8.0_333]
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:125) ~[libthrift-0.
13.0.jar:0.13.0] at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[libthrift-0.13.0.jar:0.13.
0] at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:455) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:354) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:243) ~[libthri
ft-0.13.0.jar:0.13.0] at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[libthrift-0.13.0.jar:0.1
3.0] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMet
astore.java:1151) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastor
e.java:1138) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1068)
~[starrocks-fe.jar:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:20
8) ~[hive-apache-3.1.2-13.jar:?] at com.sun.proxy.$Proxy43.getDatabase(Unknown Source) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:161) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:150) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.getDb(HiveMetaClient.java:252) ~[starrocks-fe.jar:?
] at com.starrocks.connector.hive.HiveMetastore.getDb(HiveMetastore.java:94) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadDb(CachingHiveMetastore.java:288) ~[starr
ocks-fe.jar:?] at com.google.common.cache.CacheLoader$FunctionToCacheLoader.load(CacheLoader.java:169) ~[spark-dp
p-1.0.0.jar:?] at com.google.common.cache.CacheLoader$1.load(CacheLoader.java:192) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3570) ~[spa
rk-dpp-1.0.0.jar:?] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2312) ~[spark-dpp-1.0.0.jar
:?] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2189) ~[spark-dpp-1.
0.0.jar:?] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2079) ~[spark-dpp-1.0.0.jar:?]
… 20 more
2024-04-12 11:23:38,714 ERROR (starrocks-mysql-nio-pool-2|364) [HiveMetadata.getDb():128] Failed to get hi
ve database [hive_d.test01]com.starrocks.connector.exception.StarRocksConnectorException: Failed to get database test01, msg: null
at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:164) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:150) ~[starrocks-fe.jar
:?] at com.starrocks.connector.hive.HiveMetaClient.getDb(HiveMetaClient.java:252) ~[starrocks-fe.jar:?
] at com.starrocks.connector.hive.HiveMetastore.getDb(HiveMetastore.java:94) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadDb(CachingHiveMetastore.java:288) ~[starr
ocks-fe.jar:?] at com.google.common.cache.CacheLoader$FunctionToCacheLoader.load(CacheLoader.java:169) ~[spark-dp
p-1.0.0.jar:?] at com.google.common.cache.CacheLoader$1.load(CacheLoader.java:192) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3570) ~[spa
rk-dpp-1.0.0.jar:?] at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2312) ~[spark-dpp-1.0.0.jar
:?] at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2189) ~[spark-dpp-1.
0.0.jar:?] at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.get(LocalCache.java:4011) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4034) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:5010) ~[spark-dpp-1.0.
0.jar:?] at com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:5017) ~[spark
-dpp-1.0.0.jar:?] at com.starrocks.connector.hive.CachingHiveMetastore.get(CachingHiveMetastore.java:623) ~[starrock
s-fe.jar:?] at com.starrocks.connector.hive.CachingHiveMetastore.getDb(CachingHiveMetastore.java:284) ~[starro
cks-fe.jar:?] at com.starrocks.connector.hive.HiveMetastoreOperations.getDb(HiveMetastoreOperations.java:145) ~[
starrocks-fe.jar:?] at com.starrocks.connector.hive.HiveMetadata.getDb(HiveMetadata.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.CatalogConnectorMetadata.getDb(CatalogConnectorMetadata.java:192) ~[sta
rrocks-fe.jar:?] at com.starrocks.server.MetadataMgr.lambda$getDb$1(MetadataMgr.java:221) ~[starrocks-fe.jar:?]
at java.util.Optional.map(Optional.java:215) ~[?:1.8.0_333]
at com.starrocks.server.MetadataMgr.getDb(MetadataMgr.java:221) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.changeCatalogDb(GlobalStateMgr.java:3713) ~[starrocks-fe.ja
r:?] at com.starrocks.qe.ConnectProcessor.handleInitDb(ConnectProcessor.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:582) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:883) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.
jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:161) ~[starrocks-fe.jar
:?] … 30 more
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed ou
t at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[libthrift-0.
13.0.jar:0.13.0] at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[libthrift-0.13.0.jar:0.13.
0] at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:455) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:354) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:243) ~[libthri
ft-0.13.0.jar:0.13.0] at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[libthrift-0.13.0.jar:0.1
3.0] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMet
astore.java:1151) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastor
e.java:1138) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1068)
~[starrocks-fe.jar:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:20
8) ~[hive-apache-3.1.2-13.jar:?] at com.sun.proxy.$Proxy43.getDatabase(Unknown Source) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:161) ~[starrocks-fe.jar
:?] … 30 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[?:1.8.0_333]
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) ~[?:1.8.0_333]
at java.net.SocketInputStream.read(SocketInputStream.java:171) ~[?:1.8.0_333]
at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[?:1.8.0_333]
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) ~[?:1.8.0_333]
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) ~[?:1.8.0_333]
at java.io.BufferedInputStream.read(BufferedInputStream.java:345) ~[?:1.8.0_333]
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:125) ~[libthrift-0.
13.0.jar:0.13.0] at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[libthrift-0.13.0.jar:0.13.
0] at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:455) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:354) ~[libthrift-0.13.0
.jar:0.13.0] at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:243) ~[libthri
ft-0.13.0.jar:0.13.0] at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[libthrift-0.13.0.jar:0.1
3.0] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMet
astore.java:1151) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastor
e.java:1138) ~[hive-apache-3.1.2-13.jar:?] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1068)
~[starrocks-fe.jar:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:20
8) ~[hive-apache-3.1.2-13.jar:?] at com.sun.proxy.$Proxy43.getDatabase(Unknown Source) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0
_333] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:161) ~[starrocks-fe.jar
:?] … 30 more
2024-04-12 11:23:42,871 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (185ms) Module
Backup - BackupHandler estimated 81.9MB of memory. Contains BackupOrRestoreJob with 0 object(s). 2024-04-12 11:23:42,871 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (0ms) Module C
oordinator - QeProcessorImpl estimated 240B of memory. Contains QueryInfo with 0 object(s). 2024-04-12 11:23:42,871 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (0ms) Module D
elete - DeleteMgr estimated 4.4KB of memory. Contains DeleteInfo with 7 object(s). 2024-04-12 11:23:43,013 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (142ms) Module
Dict - CacheDictManager estimated 81.9MB of memory. Contains ColumnDict with 0 object(s). 2024-04-12 11:23:43,013 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (0ms) Module E
xport - ExportMgr estimated 248B of memory. Contains ExportJob with 0 object(s). 2024-04-12 11:23:43,152 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (138ms) Module
Load - LoadMgr estimated 81.9MB of memory. Contains LoadJob with 762 object(s). 2024-04-12 11:23:43,152 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (0ms) Module L
oad - RoutineLoadMgr estimated 704B of memory. Contains RoutineLoad with 0 object(s). 2024-04-12 11:23:43,152 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (0ms) Module L
oad - StreamLoadMgr estimated 360B of memory. Contains StreamLoad with 0 object(s). 2024-04-12 11:23:43,152 INFO (MemoryUsageTracker|59) [MemoryUsageTracker.trackMemory():119] (0ms) Module L
ocalCatalog - InternalCatalogMemoryTracker estimated 6.5MB of memory. Contains Partition with 1410 object(s).