starrocks_be_metadata_mem_bytes占用内存大

[hjp18186487482]

【详述】starrocks_be_metadata_mem_bytes占用内存大，starrocks_be_tablet_metadata_mem_bytes占用不大，这两个有什么区别，怎么限制。
【业务影响】BE节点每两周会挂掉
【是否存算分离】否
【StarRocks版本】2.5.3

starrocks_be_bitmap_index_mem_bytes 0
starrocks_be_bloom_filter_index_mem_bytes 0
starrocks_be_chunk_allocator_mem_bytes 2150481928
starrocks_be_clone_mem_bytes 0
starrocks_be_column_metadata_mem_bytes 128369220242
starrocks_be_column_pool_mem_bytes 3658228313
starrocks_be_column_zonemap_index_mem_bytes 206039834
starrocks_be_compaction_mem_bytes 0
starrocks_be_consistency_mem_bytes 0
starrocks_be_load_mem_bytes 122905440
starrocks_be_metadata_mem_bytes 129464929302
starrocks_be_ordinal_index_mem_bytes 68366436936
starrocks_be_process_mem_bytes 163982918664
starrocks_be_query_mem_bytes 0
starrocks_be_rowset_metadata_mem_bytes 494020168
starrocks_be_schema_change_mem_bytes 0
starrocks_be_segment_metadata_mem_bytes 247240738
starrocks_be_segment_zonemap_mem_bytes 97253580
starrocks_be_short_key_index_mem_bytes 66780469
starrocks_be_storage_page_cache_mem_bytes 4598442768
starrocks_be_tablet_metadata_mem_bytes 354448154
starrocks_be_tablet_schema_mem_bytes 111446130
starrocks_be_update_mem_bytes 684527732

[dongquan]

集群中的导入任务有多少，导入频次是多大，show backends 结果请发下

[hjp18186487482]

导入任务每小时大概200个，Stream Load 100个左右， insert into select 分时间段，见附图。

mysql> show backends;
±----------±---------------±--------------±-------±---------±---------±--------------------±--------------------±------±---------------------±----------------------±----------±-----------------±--------------±--------------±--------±---------------±-------±--------------±-------------------------------------------------------±------------------±------------±---------±------------------±-----------±-----------+
| BackendId | IP | HeartbeatPort | BePort | HttpPort | BrpcPort | LastStartTime | LastHeartbeat | Alive | SystemDecommissioned | ClusterDecommissioned | TabletNum | DataUsedCapacity | AvailCapacity | TotalCapacity | UsedPct | MaxDiskUsedPct | ErrMsg | Version | Status | DataTotalCapacity | DataUsedPct | CpuCores | NumRunningQueries | MemUsedPct | CpuUsedPct |
±----------±---------------±--------------±-------±---------±---------±--------------------±--------------------±------±---------------------±----------------------±----------±-----------------±--------------±--------------±--------±---------------±-------±--------------±-------------------------------------------------------±------------------±------------±---------±------------------±-----------±-----------+
| 10007 | 192.168.1.10 | 9050 | 9060 | 8040 | 8060 | 2024-01-12 05:12:18 | 2024-01-19 08:52:14 | true | false | false | 219009 | 25.265 TB | 56.678 TB | 86.622 TB | 34.57 % | 34.68 % | | 2.5.3-46bf084 | {“lastSuccessReportTabletsTime”:“2024-01-19 08:51:50”} | 81.943 TB | 30.83 % | 48 | 0 | 76.40 % | 2.7 % |
| 411101 | 192.168.1.11 | 9050 | 9060 | 8040 | 8060 | 2024-01-12 06:33:20 | 2024-01-19 08:52:14 | true | false | false | 218858 | 25.266 TB | 56.689 TB | 86.622 TB | 34.56 % | 34.79 % | | 2.5.3-46bf084 | {“lastSuccessReportTabletsTime”:“2024-01-19 08:51:18”} | 81.955 TB | 30.83 % | 48 | 0 | 75.07 % | 2.5 % |
| 411107 | 192.168.1.12 | 9050 | 9060 | 8040 | 8060 | 2024-01-12 06:54:04 | 2024-01-19 08:52:14 | true | false | false | 219101 | 25.238 TB | 56.699 TB | 86.622 TB | 34.54 % | 34.73 % | | 2.5.3-46bf084 | {“lastSuccessReportTabletsTime”:“2024-01-19 08:51:35”} | 81.937 TB | 30.80 % | 48 | 0 | 75.68 % | 2.5 % |
| 411108 | 192.168.1.13 | 9050 | 9060 | 8040 | 8060 | 2024-01-12 05:54:59 | 2024-01-19 08:52:14 | true | false | false | 219062 | 25.240 TB | 56.701 TB | 86.622 TB | 34.54 % | 34.78 % | | 2.5.3-46bf084 | {“lastSuccessReportTabletsTime”:“2024-01-19 08:51:41”} | 81.941 TB | 30.80 % | 48 | 0 | 75.42 % | 2.3 % |
| 411109 | 192.168.1.14 | 9050 | 9060 | 8040 | 8060 | 2024-01-12 05:15:45 | 2024-01-19 08:52:14 | true | false | false | 218595 | 25.282 TB | 56.697 TB | 86.622 TB | 34.55 % | 34.66 % | | 2.5.3-46bf084 | {“lastSuccessReportTabletsTime”:“2024-01-19 08:51:53”} | 81.979 TB | 30.84 % | 48 | 0 | 75.54 % | 2.3 % |
| 10008 | 192.168.1.15 | 9050 | 9060 | 8040 | 8060 | 2024-01-12 05:56:29 | 2024-01-19 08:52:14 | true | false | false | 219031 | 25.271 TB | 56.668 TB | 86.622 TB | 34.58 % | 34.77 % | | 2.5.3-46bf084 | {“lastSuccessReportTabletsTime”:“2024-01-19 08:52:04”} | 81.939 TB | 30.84 % | 48 | 0 | 75.58 % | 5.1 % |
| 10012 | 192.168.1.16 | 9050 | 9060 | 8040 | 8060 | 2024-01-12 07:17:06 | 2024-01-19 08:52:14 | true | false | false | 206859 | 24.653 TB | 57.300 TB | 86.622 TB | 33.85 % | 34.24 % | | 2.5.3-46bf084 | {“lastSuccessReportTabletsTime”:“2024-01-19 08:51:30”} | 81.954 TB | 30.08 % | 48 | 0 | 75.78 % | 6.3 % |
| 10003 | 192.168.1.9 | 9050 | 9060 | 8040 | 8060 | 2024-01-12 07:11:44 | 2024-01-19 08:52:14 | true | false | false | 205685 | 24.636 TB | 57.306 TB | 86.622 TB | 33.84 % | 34.08 % | | 2.5.3-46bf084 | {“lastSuccessReportTabletsTime”:“2024-01-19 08:51:52”} | 81.942 TB | 30.06 % | 48 | 0 | 75.69 % | 2.3 % |
±----------±---------------±--------------±-------±---------±---------±--------------------±--------------------±------±---------------------±----------------------±----------±-----------------±--------------±--------------±--------±---------------±-------±--------------±-------------------------------------------------------±------------------±------------±---------±------------------±-----------±-----------+
8 rows in set (0.00 sec)

insert into select 统计：每次BE挂掉也在4~5点，峰值时间段。

[Y002480]

这个问题解决了吗