【详述】隔一段时间compaction就会由于内存的分配问题导致BE Crash
【StarRocks版本】例如:2.3.13
【集群规模】例如:3fe+6be(fe与be独立部署)
【机器信息】CPU虚拟核/内存/网卡,例如:32C/64G/万兆
【联系方式】社区群6-苍山雪
be.out中的内容如下:
start time: Thu Sep 21 22:57:05 CST 2023
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
*** Aborted at 1695308944 (unix time) try “date -d @1695308944” if you are using GNU date ***
PC: @ 0x5fc676a __libc_malloc
*** SIGSEGV (@0x0) received by PID 14769 (TID 0x7f4349c54700) from PID 0; stack trace: ***
@ 0x419cf22 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f4423c7a630 (unknown)
@ 0x5fc676a __libc_malloc
@ 0x2352c58 malloc
@ 0x486dcc6 bshuf_untrans_bit_elem_AVX_avx2
@ 0x486e347 bshuf_decompress_lz4_block_avx2
@ 0x486dfaf bshuf_blocked_wrap_fun_avx2
@ 0x1fa55fd starrocks::BinaryDictDataDecoder::decode_page_data()
@ 0x1fa4d68 starrocks::StoragePageDecoder::decode_page()
@ 0x1f96975 starrocks::PageIO::read_and_decompress_page()
@ 0x1f38bb3 starrocks::ColumnReader::read_page()
@ 0x1f8a016 starrocks::ScalarColumnIterator::_read_data_page()
@ 0x1f8b575 starrocks::ScalarColumnIterator::seek_to_ordinal()
@ 0x1ddaed9 starrocks::vectorized::SegmentIterator::_read()
@ 0x1dd3b2c starrocks::vectorized::SegmentIterator::_do_get_next()
@ 0x1dd75a1 starrocks::vectorized::SegmentIterator::do_get_next()
@ 0x2273fea starrocks::SegmentIteratorWrapper::do_get_next()
@ 0x1e6781b starrocks::vectorized::TimedChunkIterator::do_get_next()
@ 0x2143570 starrocks::vectorized::HeapMergeIterator::fill()
@ 0x2142721 starrocks::vectorized::MergeIterator::init()
@ 0x2143fe2 starrocks::vectorized::HeapMergeIterator::do_get_next()
@ 0x1e6054e starrocks::vectorized::TabletReader::do_get_next()
@ 0x1e7e0ad starrocks::vectorized::Compaction::_merge_rowsets_vertically()
@ 0x1e7f9d2 starrocks::vectorized::Compaction::do_compaction_impl()
@ 0x1e80b7b starrocks::vectorized::Compaction::do_compaction()
@ 0x1e78ad0 starrocks::vectorized::CumulativeCompaction::compact()
@ 0x1cd02c9 starrocks::StorageEngine::_perform_cumulative_compaction()
@ 0x1ed14bd starrocks::StorageEngine::_cumulative_compaction_thread_callback()
@ 0x5f90730 execute_native_thread_routine
@ 0x7f4423c72ea5 start_thread
@ 0x7f4422e099fd __clone
@ 0x0 (unknown)
start time: Thu Sep 21 23:09:21 CST 2023
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
*** Aborted at 1695309559 (unix time) try “date -d @1695309559” if you are using GNU date ***
PC: @ 0x5fc676a __libc_malloc
*** SIGSEGV (@0x0) received by PID 20436 (TID 0x7f29b8a56700) from PID 0; stack trace: ***
@ 0x419cf22 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f2a9196c630 (unknown)
@ 0x5fc676a __libc_malloc
@ 0x2352c58 malloc
@ 0x5f16cd5 operator new()
@ 0x1c33bbc starrocks::vectorized::FixedLengthColumnBase<>::reserve()
@ 0x27fd404 starrocks::vectorized::NullableColumn::reserve()
@ 0x1d62da5 starrocks::vectorized::ChunkHelper::new_chunk()
@ 0x1dce84f starrocks::vectorized::SegmentIterator::_switch_context()
@ 0x1dd220f starrocks::vectorized::SegmentIterator::_init_context()
@ 0x1dd712e starrocks::vectorized::SegmentIterator::_init()
@ 0x1dd7659 starrocks::vectorized::SegmentIterator::do_get_next()
@ 0x2273fea starrocks::SegmentIteratorWrapper::do_get_next()
@ 0x1e6781b starrocks::vectorized::TimedChunkIterator::do_get_next()
@ 0x2143570 starrocks::vectorized::HeapMergeIterator::fill()
@ 0x2142721 starrocks::vectorized::MergeIterator::init()
@ 0x2143fe2 starrocks::vectorized::HeapMergeIterator::do_get_next()
@ 0x1e67683 starrocks::vectorized::TimedChunkIterator::do_get_next()
@ 0x1fcbe85 starrocks::vectorized::AggregateIterator::do_get_next()
@ 0x1e67683 starrocks::vectorized::TimedChunkIterator::do_get_next()
@ 0x1e6054e starrocks::vectorized::TabletReader::do_get_next()
@ 0x1e7e0ad starrocks::vectorized::Compaction::_merge_rowsets_vertically()
@ 0x1e7f9d2 starrocks::vectorized::Compaction::do_compaction_impl()
@ 0x1e80b7b starrocks::vectorized::Compaction::do_compaction()
@ 0x1e78ad0 starrocks::vectorized::CumulativeCompaction::compact()
@ 0x1cd02c9 starrocks::StorageEngine::_perform_cumulative_compaction()
@ 0x1ed14bd starrocks::StorageEngine::_cumulative_compaction_thread_callback()
@ 0x5f90730 execute_native_thread_routine
@ 0x7f2a91964ea5 start_thread
@ 0x7f2a90afb9fd __clone
@ 0x0 (unknown)
start time: Fri Sep 22 03:28:50 CST 2023
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
*** Aborted at 1695327225 (unix time) try “date -d @1695327225” if you are using GNU date ***
PC: @ 0x5d3839c tcmalloc::CentralFreeList::FetchFromOneSpans()
*** SIGSEGV (@0x0) received by PID 23199 (TID 0x7f60d645a700) from PID 0; stack trace: ***
@ 0x419cf22 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f61ad364630 (unknown)
@ 0x5d3839c tcmalloc::CentralFreeList::FetchFromOneSpans()
@ 0x5d3867d tcmalloc::CentralFreeList::FetchFromOneSpansSafe()
@ 0x5d38734 tcmalloc::CentralFreeList::RemoveRange()
@ 0x5d48048 tcmalloc::ThreadCache::FetchFromCentralCache()
@ 0x2352c58 malloc
@ 0x5f16cd5 operator new()
@ 0x23ec8c8 starrocks::faststring::ShrinkToFitInternal()
@ 0x1f9502f starrocks::PageIO::compress_page_body()
@ 0x1f42df6 starrocks::ScalarColumnWriter::finish_current_page()
@ 0x1f44c1c starrocks::ScalarColumnWriter::append()
@ 0x1f46c45 starrocks::ScalarColumnWriter::append()
@ 0x1f46d1f starrocks::StringColumnWriter::append()
@ 0x1dc42d9 starrocks::SegmentWriter::append_chunk()
@ 0x227acdc starrocks::VerticalBetaRowsetWriter::add_columns()
@ 0x1e7e442 starrocks::vectorized::Compaction::_merge_rowsets_vertically()
@ 0x1e7f9d2 starrocks::vectorized::Compaction::do_compaction_impl()
@ 0x1e80b7b starrocks::vectorized::Compaction::do_compaction()
@ 0x1e75a94 starrocks::vectorized::BaseCompaction::compact()
@ 0x1cd0999 starrocks::StorageEngine::_perform_base_compaction()
@ 0x1ed09e2 starrocks::StorageEngine::_base_compaction_thread_callback()
@ 0x5f90730 execute_native_thread_routine
@ 0x7f61ad35cea5 start_thread
@ 0x7f61ac4f39fd __clone
@ 0x0 (unknown)
start time: Fri Sep 22 08:55:41 CST 2023
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
*** Aborted at 1695347313 (unix time) try “date -d @1695347313” if you are using GNU date ***
PC: @ 0x5fc676a __libc_malloc
*** SIGSEGV (@0x1c0) received by PID 16387 (TID 0x7f59fee58700) from PID 448; stack trace: ***
@ 0x419cf22 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f5ad6ee7630 (unknown)
@ 0x5fc676a __libc_malloc
@ 0x2352c58 malloc
@ 0x5f16cd5 operator new()
@ 0x1d61fbc std::vector<>::reserve()
@ 0x1e6ee89 starrocks::vectorized::ChunkAggregator::ChunkAggregator()
@ 0x1fcdaa3 starrocks::vectorized::AggregateIterator::init_encoded_schema()
@ 0x1e699fe starrocks::vectorized::TimedChunkIterator::init_encoded_schema()
@ 0x1e65fce starrocks::vectorized::TabletReader::_init_collector()
@ 0x1e6716b starrocks::vectorized::TabletReader::open()
@ 0x1e7c9c7 starrocks::vectorized::Compaction::_merge_rowsets_horizontally()
@ 0x1e7f7cc starrocks::vectorized::Compaction::do_compaction_impl()
@ 0x1e80b7b starrocks::vectorized::Compaction::do_compaction()
@ 0x1e78ad0 starrocks::vectorized::CumulativeCompaction::compact()
@ 0x1cd02c9 starrocks::StorageEngine::_perform_cumulative_compaction()
@ 0x1ed14bd starrocks::StorageEngine::_cumulative_compaction_thread_callback()
@ 0x5f90730 execute_native_thread_routine
@ 0x7f5ad6edfea5 start_thread
@ 0x7f5ad60769fd __clone
@ 0x0 (unknown)