be cpu io 很高

为了更快的定位您的问题,请提供以下信息,谢谢
【详述】be cpu io 很高
【背景】drop table 一个大主键表 没加FORCE
【业务影响】
【是否存算分离】
【StarRocks版本】2.5.13
【集群规模】1fe+3be

be.WARNING.log.20240903-222218 (616.8 KB) 上传中:be.INFO.log.20240903-221949…

failed to perform update compaction. res=Memory limit exceeded: Memory of process exceed limit. read and decompress page Used: 58848344240, Limit: 58828320718. Mem usage has exceed the limit of BE

总是合并内存不足

I0904 08:32:29.878687 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657427
I0904 08:32:29.878690 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657431
I0904 08:32:29.878691 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657385
I0904 08:32:29.878693 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657389
I0904 08:32:29.878696 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657377
I0904 08:32:29.878698 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657381
I0904 08:32:29.878700 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657393
I0904 08:32:29.878702 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657397
I0904 08:32:29.878705 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657352
I0904 08:32:29.878711 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657344
I0904 08:32:29.878713 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657348
I0904 08:32:29.878715 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657193
I0904 08:32:29.878718 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657197
I0904 08:32:29.878720 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657185
I0904 08:32:29.878722 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657189
I0904 08:32:29.878724 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657201

还有这种任务异常的

这个表没有写入任务的

内存很有规律

help

看着应该是建表buckets设置不规范导致,这个表重建吧。另外升级2.5最新小版本吧,还有2.5我们已经不维护了