为了更快的定位您的问题,请提供以下信息,谢谢
【详述】Flink批模式读取Starrocks 有时候会报错 java.lang.RuntimeException: java.net.SocketTimeoutException: Read timed out,但不是必现的,大部分时候第二次重试就OK了
【背景】调整Flink读取Starrocks的参数
【业务影响】
【是否存算分离】Flink和Starrocks部署在不同机器
【StarRocks版本】3.2.9
【集群规模】例如:1fe+3be(fe与be混部)
【机器信息】20C/176G/2.5~5G
【表模型】主键模型
【导入或者导出方式】Flink
【联系方式】jxlzq535081831@163.com
【附件】
Caused by: java.lang.RuntimeException: java.net.SocketTimeoutException: Read timed out
at com.starrocks.connector.flink.table.source.StarRocksSourceBeReader.startToRead(StarRocksSourceBeReader.java:157)
at com.starrocks.connector.flink.table.source.StarRocksSourceBeReader.getNext(StarRocksSourceBeReader.java:176)
at com.starrocks.connector.flink.table.source.StarRocksDynamicSourceFunction.lambda$run$1(StarRocksDynamicSourceFunction.java:162)
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:291)
at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731)
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401)
at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734)
at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:160)
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:174)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233)
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:583)
at com.starrocks.connector.flink.table.source.StarRocksDynamicSourceFunction.run(StarRocksDynamicSourceFunction.java:160)
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:67)
at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:333)