配置hive外部表访问对象存储，添加完core-site.xml无法连接sql客户端

💬 StarRocks 用户问答
#1

为了更快的定位您的问题，请提供以下信息，谢谢
【详述】配置hive外部表访问对象存储时，在$FE_HOME/conf/下添加core-site.xml文件，并修改了be.conf，重启fe，be后，无法连接sql客户端
【背景】1.core-site.xml内容

<property>
    <name>hadoop.zk.address</name>
    <value>d01-303-d11-3:2181,d01-303-d12-1:2181,d01-303-d12-5:2181</value>
</property>

<property>
    <name>zk-dt-secret-manager.zkConnectionString</name>
    <value>d01-303-d11-3:2181,d01-303-d12-1:2181,d01-303-d12-5:2181</value>
</property>
<property>
    <name>zk-dt-secret-manager.znodeWorkingPath</name>
    <value>/docker-router-dt1</value>
</property>
<property>
    <name>zk-dt-secret-manager.zkAuthType</name>
    <value>none</value>
</property>

<property>
    <name>hadoop.tmp.dir</name>
    <value>/opt/hadoop/tmp</value>
</property>
<!--spark default user -->
<property>
    <name>hadoop.proxyuser.185.hosts</name>
    <value>*</value>
</property>

<property>
    <name>hadoop.proxyuser.185.groups</name>
    <value>*</value>
</property>

<property>
    <name>hadoop.proxyuser.hdfs.hosts</name>
    <value>*</value>
</property>

<property>
    <name>hadoop.proxyuser.hdfs.groups</name>
    <value>*</value>
</property>

<property>
    <name>hadoop.proxyuser.hive.hosts</name>
    <value>*</value>
</property>

<property>
    <name>hadoop.proxyuser.hive.groups</name>
    <value>*</value>
</property>

<property>
    <name>hadoop.proxyuser.trino.hosts</name>
    <value>*</value>
</property>

<property>
    <name>hadoop.proxyuser.trino.groups</name>
    <value>*</value>
</property>

<property>
    <name>fs.s3a.impl.disable.cache</name>
    <value>true</value>
</property>

<property>
    <name>fs.jfs.impl.disable.cache</name>
    <value>true</value>
</property>

<property>
    <name>fs.jfs.impl</name>
    <value>io.juicefs.JuiceFileSystem</value>
</property>

<property>
    <name>fs.AbstractFileSystem.jfs.impl</name>
    <value>io.juicefs.JuiceFS</value>
</property>
<property>
    <name>fs.s3a.impl</name>
    <value>org.apache.hadoop.fs.s3a.S3AFileSystem</value>
</property>
<property>
    <name>fs.AbstractFileSystem.s3a.impl</name>
    <value>org.apache.hadoop.fs.s3a.S3A</value>
</property>
<property>
    <name>fs.s3a.access.key</name>
    <value>***</value>
</property>
<property>
    <name>fs.s3a.secret.key</name>
    <value>***</value>
</property>
<property>
    <name>fs.s3a.endpoint</name>
    <value>http://**.**.*.*</value>
</property>
<property>
    <name>fs.s3a.connection.maximum</name>
    <value>500</value>
</property>
2.be.conf添加配置 object_storage_access_key_id=*** object_storage_secret_access_key=*** object_storage_endpoint=http://**.**.*.* 【业务影响】 【是否存算分离】否 【StarRocks版本】3.2.2 【集群规模】1fe+1be 【联系方式】为了在解决问题过程中能及时联系到您获取一些日志信息，请补充下您的联系方式，例如：260306828@qq.com，谢谢 【附件】 - fe.log/beINFO/相应截图 ![image|690x145](upload://xD1p1HUq1iRmxAm91lAf4cyFgO3.png)
#2

fe.log:
org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
at org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[libthrift-0.13.0.jar:0.13.0]
at org.apache.thrift.transport.TSocket.open(TSocket.java:221) ~[libthrift-0.13.0.jar:0.13.0]
org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
at org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[libthrift-0.13.0.jar:0.13.0]
at org.apache.thrift.transport.TSocket.open(TSocket.java:221) ~[libthrift-0.13.0.jar:0.13.0]
org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
at org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[libthrift-0.13.0.jar:0.13.0]
at org.apache.thrift.transport.TSocket.open(TSocket.java:221) ~[libthrift-0.13.0.jar:0.13.0]
2024-02-22 10:39:06,896 WARN (UNKNOWN 100.71.36.42_9010_1704166552578(-1)|1) [SRMetaBlockReader.close():113] skip 1 json: {“id”:12002,“name”:“hive_s3”,“config”:{“aws.s3.access_key”:“12UEI8WAZ2GFLU3PVYVG”,“hive.metastore.type”:“hive”,“aws.s3.secret_key”:“QNdV8jZ4FCx2XLDiwdc7aWktNNmOAGwpaIS2L1if”,“aws.s3.endpoint”:“http://10.253.41.2”,“aws.s3.enable_ssl”:“true”,“aws.s3.region”:"",“hive.metastore.uris”:“thrift://100.71.36.42:32660”,“type”:“hive”}}
2024-02-22 11:12:14,445 WARN (UNKNOWN 100.71.36.42_9010_1704166552578(-1)|1) [SRMetaBlockReader.close():113] skip 1 json: {“id”:12002,“name”:“hive_s3”,“config”:{“aws.s3.access_key”:“12UEI8WAZ2GFLU3PVYVG”,“hive.metastore.type”:“hive”,“aws.s3.secret_key”:“QNdV8jZ4FCx2XLDiwdc7aWktNNmOAGwpaIS2L1if”,“aws.s3.endpoint”:“http://10.253.41.2”,“aws.s3.enable_ssl”:“true”,“aws.s3.region”:"",“hive.metastore.uris”:“thrift://100.71.36.42:32660”,“type”:“hive”}}

京ICP备2022026421号-1