Couldn't open transport for (open() timed out)

【详述】生产环境kafka->flink->starrocks同步数据时出现数据丢失,查看flink日志时发现有这种错误,查看了该时间点的fe的日志,有点奇怪只到40秒,40秒之后的日志就没有了
Stream Load response:

{“Status”:“Fail”,“BeginTxnTimeMs”:0,“Message”:“Couldn’t open transport for 10.163.205.120:9020 (open() timed out)”,“NumberUnselectedRows”:0,“CommitAndPublishTimeMs”:0,

“Label”:“617fb32c-6a7c-4bcd-8558-be47ecc1d594”,“LoadBytes”:0,“StreamLoadPutTimeMs”:0,“NumberTotalRows”:0,“WriteDataTimeMs”:0,“TxnId”:-1,“LoadTimeMs”:0,“ReadDataTimeMs”:0,

“NumberLoadedRows”:0,“NumberFilteredRows”:0}
【StarRocks版本】例如:2.3.7
1.log (1.6 MB)

您好,请问您这边确认数据丢失的方法是?您能帮忙在fe leader节点的fe.warning日志里面搜索下617fb32c-6a7c-4bcd-8558-be47ecc1d594这个看看吗?感觉报错好像是通信超时了

日志没了,搜索不到了 :sweat_smile:

请问这个报错还能复现吗?

flink消费kafka写入starrocks报错如下

flink1.14 starrocks2.1

Suppressed: java.lang.RuntimeException: Writing records to StarRocks failed.
	at com.starrocks.connector.flink.manager.StarRocksSinkManager.checkFlushException(StarRocksSinkManager.java:392) ~[flink-connector-starrocks-1.2.2_flink-1.14_2.11.jar:?]
	at com.starrocks.connector.flink.manager.StarRocksSinkManager.close(StarRocksSinkManager.java:281) ~[flink-connector-starrocks-1.2.2_flink-1.14_2.11.jar:?]
	at com.starrocks.connector.flink.table.sink.StarRocksDynamicSinkFunction.close(StarRocksDynamicSinkFunction.java:198) ~[flink-connector-starrocks-1.2.2_flink-1.14_2.11.jar:?]
	at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:141) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:127) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1035) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runAndSuppressThrowable(StreamTask.java:1021) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.cleanUp(StreamTask.java:928) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.runtime.taskmanager.Task.lambda$restoreAndInvoke$0(Task.java:940) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:940) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:766) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) ~[flink-dist_2.11-1.14.0.jar:1.14.0]
	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_272]
Caused by: com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response: 

{“Status”:“Fail”,“BeginTxnTimeMs”:0,“Message”:“Couldn’t open transport for :0 (Could not resolve host for client socket.)”,“NumberUnselectedRows”:0,“CommitAndPublishTimeMs”:0,“Label”:“f91d8434-4ee8-4a1c-8401-958e6d3e17b7”,“LoadBytes”:0,“StreamLoadPutTimeMs”:0,“NumberTotalRows”:0,“WriteDataTimeMs”:0,“TxnId”:-1,“LoadTimeMs”:0,“ReadDataTimeMs”:0,“NumberLoadedRows”:0,“NumberFilteredRows”:0}
{}

	at com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:104) ~[flink-connector-starrocks-1.2.2_flink-1.14_2.11.jar:?]
	at com.starrocks.connector.flink.manager.StarRocksSinkManager.asyncFlush(StarRocksSinkManager.java:316) ~[flink-connector-starrocks-1.2.2_flink-1.14_2.11.jar:?]
	at com.starrocks.connector.flink.manager.StarRocksSinkManager.lambda$startAsyncFlushing$0(StarRocksSinkManager.java:160) ~[flink-connector-starrocks-1.2.2_flink-1.14_2.11.jar:?]
	... 1 more

Caused by: com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response:
{“Status”:“Fail”,“BeginTxnTimeMs”:0,“Message”:“Couldn’t open transport for :0 (Could not resolve host for client socket.)”,“NumberUnselectedRows”:0,“CommitAndPublishTimeMs”:0,“Label”:“f91d8434-4ee8-4a1c-8401-958e6d3e17b7”,“LoadBytes”:0,“StreamLoadPutTimeMs”:0,“NumberTotalRows”:0,“WriteDataTimeMs”:0,“TxnId”:-1,“LoadTimeMs”:0,“ReadDataTimeMs”:0,“NumberLoadedRows”:0,“NumberFilteredRows”:0}
{}

at com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:104) ~[flink-connector-starrocks-1.2.2_flink-1.14_2.11.jar:?]
at com.starrocks.connector.flink.manager.StarRocksSinkManager.asyncFlush(StarRocksSinkManager.java:316) ~[flink-connector-starrocks-1.2.2_flink-1.14_2.11.jar:?]