【详述】be一个节点进程异常被关停,
【背景】2023-06-06 14:54:46 be一个节点进程异常被关停
【附件】[输出日志]be.out日志:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/module/starrocks/be/lib/jni-packages/starrocks-jdbc-bridge-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/module/starrocks/be/lib/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
terminate called after throwing an instance of ‘terminate called recursively
std::bad_alloc’
what(): std::bad_allocquery_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
tracker:process consumption: 12395432560
tracker:query_pool consumption: 1216847715
tracker:load consumption: 3561863112
tracker:metadata consumption: 220870608
tracker:tablet_metadata consumption: 81302691
tracker:rowset_metadata consumption: 18685850
tracker:segment_metadata consumption: 22169451
tracker:column_metadata consumption: 98712616
tracker:tablet_schema consumption: 553699
tracker:segment_zonemap consumption: 6992426
tracker:short_key_index consumption: 13542720
tracker:column_zonemap_index consumption: 17928768
tracker:ordinal_index consumption: 57391000
tracker:bitmap_index consumption: 31008
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 41043720
tracker:schema_change consumption: 0
tracker:column_pool consumption: 765373178
tracker:page_cache consumption: 337032320
tracker:update consumption: 687063595
tracker:chunk_allocator consumption: 2141043712
tracker:clone consumption: 0
tracker:consistency consumption: 0
*** Aborted at 1686034486 (unix time) try “date -d @1686034486” if you are using GNU date ***
PC: @ 0x7f3751511387 __GI_raise
*** SIGABRT (@0x3e80008b625) received by PID 570917 (TID 0x7f366ba0e700) from PID 570917; stack trace: ***
@ 0x5769222 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f3751fc6630 (unknown)
@ 0x7f3751511387 __GI_raise
@ 0x7f3751512a78 __GI_abort
@ 0x7c31e22 __gnu_cxx::__verbose_terminate_handler()
@ 0x7c308b6 __cxxabiv1::__terminate()
@ 0x7cd89a9 __cxa_call_terminate
@ 0x7c302d1 __gxx_personality_v0
@ 0x7cdf54e _Unwind_RaiseException_Phase2
@ 0x7ce0046 _Unwind_Resume
@ 0x292d00e _ZN4brpc6policy17ProcessRpcRequestEPNS_16InputMessageBaseE.cold
@ 0x58f9077 brpc::ProcessInputMessage()
@ 0x58f9f4b brpc::InputMessenger::OnNewMessages()
@ 0x58ea4de brpc::Socket::ProcessEvent()
@ 0x58bd22f bthread::TaskGroup::task_runner()
@ 0x5a04b81 bthread_make_fcontext
【业务影响】
【StarRocks版本】2.5.3
【集群规模】2fe+3be(fe与be混部)