为了更快的定位您的问题,请提供以下信息,谢谢
【详述】be cpu io 很高
【背景】drop table 一个大主键表 没加FORCE
【业务影响】
【是否存算分离】
【StarRocks版本】2.5.13
【集群规模】1fe+3be
failed to perform update compaction. res=Memory limit exceeded: Memory of process exceed limit. read and decompress page Used: 58848344240, Limit: 58828320718. Mem usage has exceed the limit of BE
总是合并内存不足
I0904 08:32:29.878687 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657427
I0904 08:32:29.878690 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657431
I0904 08:32:29.878691 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657385
I0904 08:32:29.878693 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657389
I0904 08:32:29.878696 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657377
I0904 08:32:29.878698 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657381
I0904 08:32:29.878700 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657393
I0904 08:32:29.878702 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657397
I0904 08:32:29.878705 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657352
I0904 08:32:29.878711 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657344
I0904 08:32:29.878713 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657348
I0904 08:32:29.878715 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657193
I0904 08:32:29.878718 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657197
I0904 08:32:29.878720 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657185
I0904 08:32:29.878722 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657189
I0904 08:32:29.878724 123187 agent_server.cpp:386] Submit task failed, already exists type=DROP, signature=23657201
还有这种任务异常的
这个表没有写入任务的
help
看着应该是建表buckets设置不规范导致,这个表重建吧。另外升级2.5最新小版本吧,还有2.5我们已经不维护了
请问你这个用的是什么软件可以看到图形的?
配置的监控https://docs.starrocks.io/zh/docs/administration/management/monitoring/Monitor_and_Alert/
我遇到了和你一样的问题,也是drop了一个大表没加force,请问你现在问题解决了吗?
解决了,把合并频率降低了,等到了数据的自动清理时间,再重建表
请问具体如何操作呢?可以分享一下嘛,万分感谢!
你们也是drop以后,后台还在做合并导致的cpu,内存波动嘛
把参数设大点base_compaction_check_interval_seconds
cumulative_compaction_check_interval_seconds update_compaction_check_interval_seconds
合并的内存也设置小点,尽量不合并
是的,查看be.INFO也是一直在输出Submit task failed, already exists type=DROP, signature=9908718这种日志