【详述】flink 写数据到starrocks稳定运行半年后突然写不进去
【背景】什么没做
【业务影响】flink无法正常向starrock写入数据
【StarRocks版本】例如:2.1.4
【集群规模】例如:3fe(1 follower+2observer)+8be
【机器信息】CPU虚拟核/内存/网卡,例如:64C/125G/万兆
【表模型】聚合模型
【导入或者导出方式】例如:Flink
【附件】
- fe.log/be.INFO/相应截图
flink 写 starrock报错
... 13 more
Caused by: java.lang.RuntimeException: Writing records to StarRocks failed.
at com.starrocks.connector.flink.manager.StarRocksSinkManager.checkFlushException(StarRocksSinkManager.java:406)
at com.starrocks.connector.flink.manager.StarRocksSinkManager.waitAsyncFlushingDone(StarRocksSinkManager.java:372)
at com.starrocks.connector.flink.manager.StarRocksSinkManager.flushInternal(StarRocksSinkManager.java:253)
at com.starrocks.connector.flink.manager.StarRocksSinkManager.flush(StarRocksSinkManager.java:237)
at com.starrocks.connector.flink.table.sink.StarRocksDynamicSinkFunction.snapshotState(StarRocksDynamicSinkFunction.java:181)
at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.trySnapshotFunctionState(StreamingFunctionUtils.java:118)
at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.snapshotFunctionState(StreamingFunctionUtils.java:99)
at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.snapshotState(AbstractUdfStreamOperator.java:89)
at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:218)
… 23 more
[CIRCULAR REFERENCE:com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response:
{“Status”:“Fail”,“BeginTxnTimeMs”:0,“Message”:“cancelled”,“NumberUnselectedRows”:0,“CommitAndPublishTimeMs”:0,“Label”:“805fcf4f-b908-414d-86a2-2dcd0746582b”,“LoadBytes”:9432524,“StreamLoadPutTimeMs”:114,“NumberTotalRows”:0,“WriteDataTimeMs”:876,“TxnId”:71982263,“LoadTimeMs”:1020,“ReadDataTimeMs”:24,“NumberLoadedRows”:0,“NumberFilteredRows”:0}
{}