【详述】Broker load的时候，报“failed to execute plan when the left time is less then 0”
【背景】做过哪些操作？
该方案运行了半年都正常，昨天集群突然全挂掉，没有任何报错日志。重启后，load命令就经常报“failed to execute plan when the left time is less then 0”。后来发现，任务一直处于loading中。但是broker并没有导入流量进入。
【业务影响】
【StarRocks版本】例如：1.19.1
【集群规模】例如：3fe（1 follower+2observer）+15be
【机器信息】CPU虚拟核/内存/网卡，例如：32C/125G/万兆
【附件】
StackTrace：
2022-06-09 07:33:16,343 WARN (loading_load_task_scheduler_pool-5|517) [LoadTask.exec():65] LOAD_JOB=3901007, error_msg={Failed to execute load task}
com.starrocks.common.LoadException: Cancelled FileScanNode::get_next
at com.starrocks.load.loadv2.LoadLoadingTask.actualExecute(LoadLoadingTask.java:158) ~[starrocks-fe.jar:?]
at com.starrocks.load.loadv2.LoadLoadingTask.executeOnce(LoadLoadingTask.java:130) ~[starrocks-fe.jar:?]
at com.starrocks.load.loadv2.LoadLoadingTask.executeTask(LoadLoadingTask.java:109) ~[starrocks-fe.jar:?]
at com.starrocks.load.loadv2.LoadTask.exec(LoadTask.java:59) [starrocks-fe.jar:?]
at com.starrocks.task.MasterTask.run(MasterTask.java:35) [starrocks-fe.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_211]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_211]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_211]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_211] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_211]
2022-06-09 07:33:16,344 WARN (loading_load_task_scheduler_pool-5|517) [LoadTask.exec():65] LOAD_JOB=3901007, error_msg={Failed to execute load task}
com.starrocks.common.LoadException: failed to execute plan when the left time is less then 0
at com.starrocks.load.loadv2.LoadLoadingTask.actualExecute(LoadLoadingTask.java:139) ~[starrocks-fe.jar:?]
at com.starrocks.load.loadv2.LoadLoadingTask.executeOnce(LoadLoadingTask.java:130) ~[starrocks-fe.jar:?]
at com.starrocks.load.loadv2.LoadLoadingTask.executeTask(LoadLoadingTask.java:109) ~[starrocks-fe.jar:?] at com.starrocks.load.loadv2.LoadTask.exec(LoadTask.java:59) [starrocks-fe.jar:?]
at com.starrocks.task.MasterTask.run(MasterTask.java:35) [starrocks-fe.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_211] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_211]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_211]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_211] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_211]