Flink写入SR on K8S,Caused by: java.net.UnknownHostException: starrockscluster-be-0.starrockscluster-be-search.starrocks.svc.cluster.local

为了更快的定位您的问题,请提供以下信息,谢谢
【详述】
我使用了starrocks-kubernetes-operator:v1.8.5部署starrocks:3.1.4,
我的starrocks-fe-and-be.yaml如下

apiVersion: starrocks.com/v1
kind: StarRocksCluster
metadata:
name: starrockscluster
namespace: starrocks
spec:
starRocksFeSpec:
image: 192.168.107.100:5000/starrocks-fe:3.1.4
replicas: 2
requests:
cpu: 500m
memory: 1Gi
limits:
cpu: 1
memory: 2Gi
storageVolumes:
- name: fe-storage-meta
storageClassName: nfs-starrocks-fe-meta # you can remove this line if you want to use the default storage class
storageSize: 10Gi # the size of storage volume for metadata
mountPath: /opt/starrocks/fe/meta # the path of metadata
- name: fe-storage-log
storageClassName: nfs-starrocks-fe-log # you can remove this line if you want to use the default storage class
storageSize: 1Gi # the size of storage volume for log
mountPath: /opt/starrocks/fe/log # the path of log
service:
type: LoadBalancer # specified as LoadBalancer
starRocksBeSpec:
image: 192.168.107.100:5000/starrocks-be:3.1.4
replicas: 2
requests:
cpu: 2
memory: 16Gi
limits:
cpu: 2
memory: 16Gi
storageVolumes:
- name: be-storage-data
storageClassName: nfs-starrocks-be-data # you can remove this line if you want to use the default storage class
storageSize: 2Ti # the size of storage volume for data
mountPath: /opt/starrocks/be/storage # the path of data
- name: be-storage-log
storageClassName: nfs-starrocks-be-log # you can remove this line if you want to use the default storage class
storageSize: 1Gi # the size of storage volume for log
mountPath: /opt/starrocks/be/log # the path of log

使用Flink app去写入starrocks会报下列错误日志:

java.lang.RuntimeException: java.net.UnknownHostException: starrockscluster-fe-1.starrockscluster-fe-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:157) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.begin(TransactionStreamLoader.java:99) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:170) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.streamLoad(TransactionTableRegion.java:331) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.flush(TransactionTableRegion.java:228) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.StreamLoadManagerV2.lambda$init$0(StreamLoadManagerV2.java:179) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.net.UnknownHostException: starrockscluster-fe-1.starrockscluster-fe-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]
at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:929) ~[?:?]
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1519) ~[?:?]
at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:848) ~[?:?]
at java.net.InetAddress.getAllByName0(InetAddress.java:1509) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1368) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1302) ~[?:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:129) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
… 6 more
java.lang.RuntimeException: java.net.UnknownHostException: starrockscluster-fe-1.starrockscluster-fe-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:157) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.begin(TransactionStreamLoader.java:99) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:170) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.streamLoad(TransactionTableRegion.java:331) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.flush(TransactionTableRegion.java:228) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.StreamLoadManagerV2.lambda$init$0(StreamLoadManagerV2.java:179) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.net.UnknownHostException: starrockscluster-fe-1.starrockscluster-fe-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]
at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:929) ~[?:?]
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1519) ~[?:?]
at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:848) ~[?:?]
at java.net.InetAddress.getAllByName0(InetAddress.java:1509) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1368) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1302) ~[?:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:129) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
… 6 more
java.lang.RuntimeException: java.net.UnknownHostException: starrockscluster-be-0.starrockscluster-be-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:157) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.begin(TransactionStreamLoader.java:99) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:170) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.streamLoad(TransactionTableRegion.java:331) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.flush(TransactionTableRegion.java:228) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.StreamLoadManagerV2.lambda$init$0(StreamLoadManagerV2.java:179) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.net.UnknownHostException: starrockscluster-be-0.starrockscluster-be-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]
at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:929) ~[?:?]
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1519) ~[?:?]
at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:848) ~[?:?]
at java.net.InetAddress.getAllByName0(InetAddress.java:1509) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1368) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1302) ~[?:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:129) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
… 6 more

请问需要配置什么解决该问题呢?

【StarRocks版本】
starrocks-kubernetes-operator:v1.8.5
Starrocks: 3.1.4
flink-connector-starrocks:1.2.8_flink-1.17
【集群规模】2fe + 2be
【机器信息】 Mac Studio
【联系方式】phoesh@gmail.com

请使用fe proxy.


还没有合入,是我个人 repo 下的.

谢谢答覆,所以starRocksFeProxySpec目前还未release在v1.8.5对吧?
预计会在v1.8.6 release吗?

不是。fe proxy 功能已经在 v1.8.5 当中了。我说的是那篇文档还没有合进去。

了解,那么我可以直接添加配置在 starrocks-fe-and-be.yaml 内吧?
看你提供的文档写的用Helm

谢谢提供方案,已配置好可用