为了更快的定位您的问题,请提供以下信息,谢谢
【详述】
我使用了starrocks-kubernetes-operator:v1.8.5部署starrocks:3.1.4,
我的starrocks-fe-and-be.yaml如下
apiVersion: starrocks.com/v1
kind: StarRocksCluster
metadata:
name: starrockscluster
namespace: starrocks
spec:
starRocksFeSpec:
image: 192.168.107.100:5000/starrocks-fe:3.1.4
replicas: 2
requests:
cpu: 500m
memory: 1Gi
limits:
cpu: 1
memory: 2Gi
storageVolumes:
- name: fe-storage-meta
storageClassName: nfs-starrocks-fe-meta # you can remove this line if you want to use the default storage class
storageSize: 10Gi # the size of storage volume for metadata
mountPath: /opt/starrocks/fe/meta # the path of metadata
- name: fe-storage-log
storageClassName: nfs-starrocks-fe-log # you can remove this line if you want to use the default storage class
storageSize: 1Gi # the size of storage volume for log
mountPath: /opt/starrocks/fe/log # the path of log
service:
type: LoadBalancer # specified as LoadBalancer
starRocksBeSpec:
image: 192.168.107.100:5000/starrocks-be:3.1.4
replicas: 2
requests:
cpu: 2
memory: 16Gi
limits:
cpu: 2
memory: 16Gi
storageVolumes:
- name: be-storage-data
storageClassName: nfs-starrocks-be-data # you can remove this line if you want to use the default storage class
storageSize: 2Ti # the size of storage volume for data
mountPath: /opt/starrocks/be/storage # the path of data
- name: be-storage-log
storageClassName: nfs-starrocks-be-log # you can remove this line if you want to use the default storage class
storageSize: 1Gi # the size of storage volume for log
mountPath: /opt/starrocks/be/log # the path of log
使用Flink app去写入starrocks会报下列错误日志:
java.lang.RuntimeException: java.net.UnknownHostException: starrockscluster-fe-1.starrockscluster-fe-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:157) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.begin(TransactionStreamLoader.java:99) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:170) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.streamLoad(TransactionTableRegion.java:331) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.flush(TransactionTableRegion.java:228) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.StreamLoadManagerV2.lambda$init$0(StreamLoadManagerV2.java:179) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.net.UnknownHostException: starrockscluster-fe-1.starrockscluster-fe-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]
at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:929) ~[?:?]
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1519) ~[?:?]
at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:848) ~[?:?]
at java.net.InetAddress.getAllByName0(InetAddress.java:1509) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1368) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1302) ~[?:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:129) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
… 6 more
java.lang.RuntimeException: java.net.UnknownHostException: starrockscluster-fe-1.starrockscluster-fe-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:157) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.begin(TransactionStreamLoader.java:99) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:170) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.streamLoad(TransactionTableRegion.java:331) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.flush(TransactionTableRegion.java:228) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.StreamLoadManagerV2.lambda$init$0(StreamLoadManagerV2.java:179) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.net.UnknownHostException: starrockscluster-fe-1.starrockscluster-fe-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]
at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:929) ~[?:?]
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1519) ~[?:?]
at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:848) ~[?:?]
at java.net.InetAddress.getAllByName0(InetAddress.java:1509) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1368) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1302) ~[?:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:129) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
… 6 more
java.lang.RuntimeException: java.net.UnknownHostException: starrockscluster-be-0.starrockscluster-be-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:157) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.begin(TransactionStreamLoader.java:99) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:170) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.streamLoad(TransactionTableRegion.java:331) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.TransactionTableRegion.flush(TransactionTableRegion.java:228) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.v2.StreamLoadManagerV2.lambda$init$0(StreamLoadManagerV2.java:179) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.net.UnknownHostException: starrockscluster-be-0.starrockscluster-be-search.starrocks.svc.cluster.local: nodename nor servname provided, or not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]
at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:929) ~[?:?]
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1519) ~[?:?]
at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:848) ~[?:?]
at java.net.InetAddress.getAllByName0(InetAddress.java:1509) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1368) ~[?:?]
at java.net.InetAddress.getAllByName(InetAddress.java:1302) ~[?:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.streamload.shade.org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
at com.starrocks.data.load.stream.TransactionStreamLoader.doBegin(TransactionStreamLoader.java:129) ~[flink-connector-starrocks-1.2.8_flink-1.17.jar:?]
… 6 more
请问需要配置什么解决该问题呢?
【StarRocks版本】
starrocks-kubernetes-operator:v1.8.5
Starrocks: 3.1.4
flink-connector-starrocks:1.2.8_flink-1.17
【集群规模】2fe + 2be
【机器信息】 Mac Studio
【联系方式】phoesh@gmail.com