Timeout while offering data to flushQueue

【详述】问题详细描述
【背景】做过哪些操作?
【业务影响】
【StarRocks版本】例如:1.18.2
【集群规模】例如:3fe(1 follower+2observer)+5be(fe与be混部)
【机器信息】CPU虚拟核/内存/网卡,例如:48C/64G/万兆
【表模型】例如:主键模型
【导入或者导出方式】例如:Flink
【联系方式】为了在解决问题过程中能及时联系到您获取一些日志信息,请补充下您的联系方式,例如:社区群4-小李或者邮箱,谢谢
Caused by: org.apache.flink.runtime.checkpoint.CheckpointException: Could not complete snapshot 46 for operator Source: flink-mysql-cdc -> detailsSingleOutputStreamOperators -> (Map -> Sink: starrocks.deliver_orderOutputDataStreamSink, Map -> Sink: starrocks.piece_workOutputDataStreamSink, Map -> Sink: starrocks.receipt_orderOutputDataStreamSink, Map -> Sink: starrocks.staffOutputDataStreamSink, Map -> Sink: starrocks.subtask_recordsOutputDataStreamSink, Map -> Sink: starrocks.subtasksOutputDataStreamSink, Map -> Sink: starrocks.tasksOutputDataStreamSink, Map -> Sink: starrocks.wave_orderOutputDataStreamSink, Map -> Sink: starrocks.stock_historyOutputDataStreamSink, Map -> Sink: starrocks.stock_history_reportOutputDataStreamSink, Map -> Sink: starrocks.dock_subscriberOutputDataStreamSink, Process) (1/1)#2. Failure reason: Checkpoint was declined.
at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:265) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:170) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:348) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.checkpointStreamOperator(RegularOperatorChain.java:233) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.buildOperatorSnapshotFutures(RegularOperatorChain.java:206) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.snapshotState(RegularOperatorChain.java:186) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.takeSnapshotSync(SubtaskCheckpointCoordinatorImpl.java:605) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.checkpointState(SubtaskCheckpointCoordinatorImpl.java:315) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$performCheckpoint$14(StreamTask.java:1329) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:1315) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsyncInMailbox(StreamTask.java:1163) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
… 13 more
Caused by: java.lang.RuntimeException: Timeout while offering data to flushQueue, exceed 600000 ms, see sink.buffer-flush.enqueue-timeout-ms
at com.starrocks.connector.flink.manager.StarRocksSinkManager.offer(StarRocksSinkManager.java:371) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at com.starrocks.connector.flink.manager.StarRocksSinkManager.waitAsyncFlushingDone(StarRocksSinkManager.java:356) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at com.starrocks.connector.flink.manager.StarRocksSinkManager.flushInternal(StarRocksSinkManager.java:260) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at com.starrocks.connector.flink.manager.StarRocksSinkManager.flush(StarRocksSinkManager.java:241) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at com.starrocks.connector.flink.table.sink.StarRocksDynamicSinkFunction.snapshotState(StarRocksDynamicSinkFunction.java:187) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.trySnapshotFunctionState(StreamingFunctionUtils.java:118) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.snapshotFunctionState(StreamingFunctionUtils.java:99) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.snapshotState(AbstractUdfStreamOperator.java:87) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:219) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:170) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:348) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.checkpointStreamOperator(RegularOperatorChain.java:233) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.buildOperatorSnapshotFutures(RegularOperatorChain.java:206) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.snapshotState(RegularOperatorChain.java:186) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.takeSnapshotSync(SubtaskCheckpointCoordinatorImpl.java:605) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.checkpointState(SubtaskCheckpointCoordinatorImpl.java:315) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$performCheckpoint$14(StreamTask.java:1329) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:1315) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsyncInMailbox(StreamTask.java:1163) ~[datax-wms-stream-1.0-SNAPSHOT.jar:?]
… 13 more

当前使用的是什么版本呢,是开启了精准一致吗,可以检查下flink是不是有什么异常