【详述】升级到 StarRocks-2.5.2之后,在内存占用接近 MemTotal * mem_limit 时,就会 crash
- 设置
disable_storage_page_cache = true
后也是如此 - 增大内存也是会如此
而且出现连续的的 query_pool 为负数的情况
这个版本是我自己编译的
【附件】
附件中错误信息主要看 2023-03月开始的,之前的不用关注
be.out (131.2 KB)
terminate called after throwing an instance of 'std::bad_alloc'
what(): std::bad_alloc
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
tracker:process consumption: 8515766680
tracker:query_pool consumption: 38925376
tracker:load consumption: 7606192
tracker:metadata consumption: 565906926
tracker:tablet_metadata consumption: 328703361
tracker:rowset_metadata consumption: 208222339
tracker:segment_metadata consumption: 5130364
tracker:column_metadata consumption: 23850862
tracker:tablet_schema consumption: 25933561
tracker:segment_zonemap consumption: 3915864
tracker:short_key_index consumption: 709057
tracker:column_zonemap_index consumption: 6385790
tracker:ordinal_index consumption: 8903408
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 0
tracker:schema_change consumption: 0
tracker:column_pool consumption: 1298115310
tracker:page_cache consumption: 1308356832
tracker:update consumption: 11163674
tracker:chunk_allocator consumption: 222210064
tracker:clone consumption: 0
tracker:consistency consumption: 0
*** Aborted at 1678161218 (unix time) try "date -d @1678161218" if you are using GNU date ***
PC: @ 0x7f5e2e57a00b gsignal
*** SIGABRT (@0x2a9) received by PID 681 (TID 0x7f5c86592700) from PID 681; stack trace: ***
@ 0x54d8a82 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f5e2e73d420 (unknown)
@ 0x7f5e2e57a00b gsignal
@ 0x7f5e2e559859 abort
@ 0x29f47de _ZN9__gnu_cxx27__verbose_terminate_handlerEv.cold
@ 0x7996116 __cxxabiv1::__terminate()
@ 0x7a3e209 __cxa_call_terminate
@ 0x7995b31 __gxx_personality_v0
@ 0x7a44dae _Unwind_RaiseException_Phase2
@ 0x7a458a6 _Unwind_Resume
@ 0x28f0a96 _ZN4brpc6policy17ProcessRpcRequestEPNS_16InputMessageBaseE.cold
@ 0x56688d7 brpc::ProcessInputMessage()
@ 0x56697ab brpc::InputMessenger::OnNewMessages()
@ 0x5659d3e brpc::Socket::ProcessEvent()
@ 0x562ca8f bthread::TaskGroup::task_runner()
@ 0x57743e1 bthread_make_fcontext
start time: Tue 07 Mar 2023 03:54:23 AM UTC
terminate called after throwing an instance of 'St9bad_alloc'
what(): std::bad_alloc
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
terminate called recursively
start time: Tue 07 Mar 2023 04:28:12 AM UTC
terminate called after throwing an instance of 'std::bad_alloc'
what(): std::bad_alloc
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
tracker:process consumption: 8709016768
tracker:query_pool consumption: -293123984
tracker:load consumption: 8099744
tracker:metadata consumption: 559781688
tracker:tablet_metadata consumption: 328889065
tracker:rowset_metadata consumption: 213370639
tracker:segment_metadata consumption: 3766760
tracker:column_metadata consumption: 13755224
tracker:tablet_schema consumption: 25933561
tracker:segment_zonemap consumption: 2617336
tracker:short_key_index consumption: 823392
tracker:column_zonemap_index consumption: 4259856
tracker:ordinal_index consumption: 4896440
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 0
tracker:schema_change consumption: 0
tracker:column_pool consumption: 728051636
tracker:page_cache consumption: 0
tracker:update consumption: 4969420
tracker:chunk_allocator consumption: 422033400
tracker:clone consumption: 0
tracker:consistency consumption: 0
*** Aborted at 1678163575 (unix time) try "date -d @1678163575" if you are using GNU date ***
PC: @ 0x7ff0c4cea00b gsignal
*** SIGABRT (@0x2b4) received by PID 692 (TID 0x7fef117b9700) from PID 692; stack trace: ***
@ 0x54d8a82 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7ff0c4ead420 (unknown)
@ 0x7ff0c4cea00b gsignal
@ 0x7ff0c4cc9859 abort
@ 0x29f47de _ZN9__gnu_cxx27__verbose_terminate_handlerEv.cold
@ 0x7996116 __cxxabiv1::__terminate()
@ 0x7996181 std::terminate()
@ 0x79962d4 __cxa_throw
@ 0x29f46f6 _Znwm.cold
@ 0x7a0eb4a std::__cxx11::basic_string<>::_M_mutate()
@ 0x7a1016b std::__cxx11::basic_string<>::_M_append()
@ 0x54d5dbf google::DumpStackTrace()
@ 0x45d1c2c __wrap___cxa_throw
@ 0x29f46f6 _Znwm.cold
@ 0x7a0eb4a std::__cxx11::basic_string<>::_M_mutate()
@ 0x7a1016b std::__cxx11::basic_string<>::_M_append()
@ 0x54d5dbf google::DumpStackTrace()
@ 0x45d1c2c __wrap___cxa_throw
@ 0x29f46f6 _Znwm.cold
@ 0x7a0eb4a std::__cxx11::basic_string<>::_M_mutate()
@ 0x7a1016b std::__cxx11::basic_string<>::_M_append()
@ 0x54d5dbf google::DumpStackTrace()
@ 0x45d1c2c __wrap___cxa_throw
@ 0x29f46f6 _Znwm.cold
@ 0x7a0eb4a std::__cxx11::basic_string<>::_M_mutate()
@ 0x7a1016b std::__cxx11::basic_string<>::_M_append()
@ 0x54d5dbf google::DumpStackTrace()
@ 0x45d1c2c __wrap___cxa_throw
@ 0x29f46f6 _Znwm.cold
@ 0x7a0eb4a std::__cxx11::basic_string<>::_M_mutate()
@ 0x7a1016b std::__cxx11::basic_string<>::_M_append()
@ 0x54d5dbf google::DumpStackTrace()
start time: Tue 07 Mar 2023 04:33:55 AM UTC
terminate called after throwing an instance of 'std::bad_alloc'
what(): std::bad_alloc
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
tracker:process consumption: 9335463760
tracker:query_pool consumption: 55839040
tracker:load consumption: 8678960
tracker:metadata consumption: 575148060
tracker:tablet_metadata consumption: 328815125
tracker:rowset_metadata consumption: 213287475
tracker:segment_metadata consumption: 6883764
tracker:column_metadata consumption: 26161696
tracker:tablet_schema consumption: 25934125
tracker:segment_zonemap consumption: 4996212
tracker:short_key_index consumption: 1353278
tracker:column_zonemap_index consumption: 7780624
tracker:ordinal_index consumption: 9498576
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 0
tracker:schema_change consumption: 0
tracker:column_pool consumption: 1211438139
tracker:page_cache consumption: 0
tracker:update consumption: 5725457
tracker:chunk_allocator consumption: 348341936
tracker:clone consumption: 0
tracker:consistency consumption: 0
*** Aborted at 1678164869 (unix time) try "date -d @1678164869" if you are using GNU date ***
PC: @ 0x7f813d88c00b gsignal
*** SIGABRT (@0x2b4) received by PID 692 (TID 0x7f7f87a38700) from PID 692; stack trace: ***
@ 0x54d8a82 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f813da4f420 (unknown)
start time: Tue 07 Mar 2023 04:55:20 AM UTC
terminate called after throwing an instance of 'St9bad_alloc'
what(): std::bad_alloc
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
terminate called recursively
start time: Tue 07 Mar 2023 05:09:29 AM UTC
start time: Tue 07 Mar 2023 05:14:04 AM UTC
start time: Tue 07 Mar 2023 05:32:40 AM UTC
terminate called after throwing an instance of 'St9bad_alloc'
what(): std::bad_alloc
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
terminate called recursively
start time: Tue 07 Mar 2023 05:40:20 AM UTC