2.5.4升级3.0正式版（非存算分离集群）BE挂一台 重启后又挂 streamload BE节点

【详述】问题详细描述
【背景】做过哪些操作？ 升级2.54->3.0.0正式 无其他操作
【业务影响】
【StarRocks版本】例如：3.0.0
【集群规模】例如：3fe（3 follower）+4be（fe与be混部）
【机器信息】CPU虚拟核/内存/网卡，例如： 万兆
【联系方式】为了在解决问题过程中能及时联系到您获取一些日志信息，请补充下您的联系方式，例如：社区群9- nohup$，谢谢
【附件】

• fe.log/beINFO/相应截图
• 慢查询：
  • Profile信息
  • 并行度：show variables like ‘%parallel_fragment_exec_instance_num%’; 1
  • pipeline是否开启：show variables like ‘%pipeline%’;
  • be节点cpu和内存使用率截图
• 查询报错：
  • query_dump，怎么获取query_dump文件
• be crash
  • be.outMay 5 10点31 be.INFO (119.3 KB) May 5 10点37 be.WARNING (318 字节) May 5 10点40 fe.out (61.8 KB)

be 挂了需要提供下be.out，具体排查参考 [问题排查]BE Crash

已经提供相关文件

提供的fe.out呀，不是be.out

tail -f be.out

COULD NOT CREATE A LOGGINGFILE 20230505-103140!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103141!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103141!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103142!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103142!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103142!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103143!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103143!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103144!Could not create logging file: No such file or directory

COULD NOT CREATE A LOGGINGFILE 20230505-103145!start time: Fri May 5 11:27:57 CST 2023

没有后续了

我重新恢复be 再启动任务 be一段时间后挂 be.out 无日志输出

是不是被系统kill了，dmesg -T|grep -i oom
另外机器配置是多少

$ dmesg -T|grep -i oom
[Fri May 5 01:02:01 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 01:02:01 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 01:02:01 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 01:02:01 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 01:02:03 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 01:02:03 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 01:02:03 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 01:02:03 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 01:11:57 2023] java invoked oom-killer: gfp_mask=0x3000d0, order=2, oom_score_adj=0
[Fri May 5 01:11:57 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 01:11:57 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 01:11:57 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 01:21:54 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 01:21:54 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 01:21:54 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 01:21:54 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 01:21:55 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 01:21:55 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 01:21:55 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 01:21:55 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 02:01:47 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 02:01:47 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 02:01:47 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 02:01:47 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 02:31:46 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 02:31:46 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 02:31:46 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 02:31:46 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 02:31:46 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 02:31:46 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 02:31:46 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 02:31:46 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 03:41:38 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 03:41:38 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 03:41:38 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 03:41:38 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 03:41:38 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 03:41:38 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 03:41:38 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 03:41:38 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 03:41:38 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 03:41:38 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 03:41:38 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 03:41:38 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 04:51:25 2023] python invoked oom-killer: gfp_mask=0x3000d0, order=2, oom_score_adj=0
[Fri May 5 04:51:25 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 04:51:25 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 04:51:25 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 04:51:25 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 04:51:25 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 04:51:25 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 04:51:25 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 04:51:26 2023] java invoked oom-killer: gfp_mask=0x3000d0, order=2, oom_score_adj=0
[Fri May 5 04:51:26 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 04:51:26 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 04:51:26 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 05:11:24 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 05:11:24 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 05:11:24 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 05:11:24 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 05:11:24 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 05:11:24 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 05:11:24 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 05:11:24 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 05:11:24 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 05:11:24 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 05:11:24 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 05:11:24 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 05:11:24 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 05:11:24 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 05:11:24 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 05:11:24 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 05:11:24 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 05:11:24 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 05:11:24 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 05:11:24 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 05:11:25 2023] java invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
[Fri May 5 05:11:25 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 05:11:25 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 05:11:25 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
[Fri May 5 05:11:25 2023] java invoked oom-killer: gfp_mask=0x280da, order=0, oom_score_adj=0
[Fri May 5 05:11:25 2023] [] oom_kill_process+0x2cd/0x490
[Fri May 5 05:11:25 2023] [] ? oom_unkillable_task+0xcd/0x120
[Fri May 5 05:11:25 2023] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name

64c 256g

是BE挂的那台机器内存超了 kill几个任务后 内存有了后 be正常 谢谢您的回复