[be crash] 3.3.10 SpillableAggregateBlockingSourceOperator

💬 StarRocks 用户问答
#1

为了更快的定位您的问题，请提供以下信息，谢谢
【详述】问题详细描述

branch-3.3.10 RELEASE (build 62cb1c9)
query_id:c4c06a2e-05d6-11f0-91a0-02422f0b9c09, fragment_instance:c4c06a2e-05d6-11f0-91a0-02422f0b9c75
tracker:process consumption: 5148159352
tracker:jemalloc_metadata consumption: 457848272
tracker:query_pool consumption: 2773875880
tracker:query_pool/connector_scan consumption: 0
tracker:load consumption: 8163775
tracker:metadata consumption: 530993407
tracker:tablet_metadata consumption: 170413930
tracker:rowset_metadata consumption: 61131240
tracker:segment_metadata consumption: 9519381
tracker:column_metadata consumption: 289928856
tracker:tablet_schema consumption: 1292466
tracker:segment_zonemap consumption: 4399256
tracker:short_key_index consumption: 95764
tracker:column_zonemap_index consumption: 9188760
tracker:ordinal_index consumption: 124577824
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 0
tracker:schema_change consumption: 0
tracker:column_pool consumption: 0
tracker:page_cache consumption: 0
tracker:jit_cache consumption: 6136
tracker:update consumption: 12300356
tracker:chunk_allocator consumption: 0
tracker:passthrough consumption: 0
tracker:clone consumption: 0
tracker:consistency consumption: 0
tracker:datacache consumption: 0
tracker:replication consumption: 0
*** Aborted at 1742508052 (unix time) try "date -d @1742508052" if you are using GNU date ***
PC: @          0x5192852 starrocks::ColumnVisitorMutableAdapter<starrocks::ColumnAppendPermutation>::visit(starrocks::FixedLengthColumn<signed char>*)
*** SIGSEGV (@0x0) received by PID 25 (TID 0x7f501524c640) from PID 0; stack trace: ***
    @     0x7f50bae51ee8 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x99ee7)
    @          0x9af2d89 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7f50badfa520 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x4251f)
    @          0x5192852 starrocks::ColumnVisitorMutableAdapter<starrocks::ColumnAppendPermutation>::visit(starrocks::FixedLengthColumn<signed char>*)
    @          0x4fc80bd starrocks::ColumnFactory<starrocks::FixedLengthColumnBase<signed char>, starrocks::FixedLengthColumn<signed char>, starrocks::Column>::accept_mutable(starrocks::ColumnVisitorMutable*)
    @          0x519028d starrocks::materialize_column_by_permutation(starrocks::Column*, std::vector<std::shared_ptr<starrocks::Column>, std::allocator<std::shared_ptr<starrocks::Column> > > const&, starrocks::array_view<starrocks::PermutationItem> const&)
    @          0x5191561 starrocks::ColumnVisitorMutableAdapter<starrocks::ColumnAppendPermutation>::visit(starrocks::NullableColumn*)
    @          0x504f9ed starrocks::ColumnFactory<starrocks::Column, starrocks::NullableColumn, starrocks::Column>::accept_mutable(starrocks::ColumnVisitorMutable*)
    @          0x519028d starrocks::materialize_column_by_permutation(starrocks::Column*, std::vector<std::shared_ptr<starrocks::Column>, std::allocator<std::shared_ptr<starrocks::Column> > > const&, starrocks::array_view<starrocks::PermutationItem> const&)
    @          0x5190536 starrocks::materialize_by_permutation(starrocks::Chunk*, std::vector<std::shared_ptr<starrocks::Chunk>, std::allocator<std::shared_ptr<starrocks::Chunk> > > const&, starrocks::array_view<starrocks::PermutationItem> const&)
    @          0x528c105 starrocks::MergeTwoCursor::merge_sorted_intersected_cursor(starrocks::SortedRun&, starrocks::SortedRun&)
    @          0x528d9a1 starrocks::MergeTwoCursor::merge_sorted_cursor_two_way()
    @          0x528eb8c starrocks::MergeTwoCursor::next()
    @          0x528ec62 std::_Function_handler<bool (std::unique_ptr<starrocks::Chunk, std::default_delete<starrocks::Chunk> >*, bool*), starrocks::MergeTwoCursor::MergeTwoCursor(starrocks::SortDescs const&, std::unique_ptr<starrocks::SimpleChunkSortCursor, std::default_delete<stj^P
    @          0x5293947 starrocks::SimpleChunkSortCursor::try_get_next()
    @          0x528e0b3 starrocks::MergeTwoCursor::move_cursor()
    @          0x528eb7d starrocks::MergeTwoCursor::next()
    @          0x528ec62 std::_Function_handler<bool (std::unique_ptr<starrocks::Chunk, std::default_delete<starrocks::Chunk> >*, bool*), starrocks::MergeTwoCursor::MergeTwoCursor(starrocks::SortDescs const&, std::unique_ptr<starrocks::SimpleChunkSortCursor, std::default_delete<stj^P
    @          0x5293947 starrocks::SimpleChunkSortCursor::try_get_next()
    @          0x528bcd4 starrocks::MergeCursorsCascade::try_get_next()
    @          0x5287f5c starrocks::CascadeChunkMerger::get_next(std::unique_ptr<starrocks::Chunk, std::default_delete<starrocks::Chunk> >*, std::atomic<bool>*, bool*)
    @          0x54bb965 starrocks::spill::OrderedInputStream::get_next(starrocks::workgroup::YieldContext&, starrocks::spill::SerdeContext&)
    @          0x612da77 starrocks::StatusOr<std::shared_ptr<starrocks::Chunk> > starrocks::spill::SpillerReader::restore<starrocks::spill::IOTaskExecutor, starrocks::spill::ResourceMemTrackerGuard<std::weak_ptr<starrocks::pipeline::QueryContext>, std::weak_ptr<starrocks::spill::Sj^P
    @          0x612e03b starrocks::StatusOr<std::shared_ptr<starrocks::Chunk> > starrocks::spill::Spiller::restore<starrocks::spill::IOTaskExecutor, starrocks::spill::ResourceMemTrackerGuard<std::weak_ptr<starrocks::pipeline::QueryContext>, std::weak_ptr<starrocks::spill::Spillerj^P
    @          0x611c9dd starrocks::pipeline::SpillableAggregateBlockingSourceOperator::_pull_spilled_chunk(starrocks::RuntimeState*)
    @          0x611cfb6 starrocks::pipeline::SpillableAggregateBlockingSourceOperator::pull_chunk(starrocks::RuntimeState*)
    @          0x4f8e0c0 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
    @          0x79fa3c3 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x872f223 starrocks::ThreadPool::dispatch_thread()
    @          0x87268e9 starrocks::Thread::supervise_thread(void*)
    @     0x7f50bae4cac3 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x94ac2)
    @     0x7f50baedda04 clone
start time: Fri Mar 21 06:00:59 CST 2025, server uptime:  06:00:59 up 59 days,  4:17,  0 users,  load average: 34.59, 7.81, 2.89
log4j:WARN No appenders could be found for logger (org.apache.hadoop.fs.FileSystem).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

fe.audit.log
agg_block_spill.txt (82.7 KB)

【背景】做过哪些操作？
【业务影响】
【是否存算分离】
【StarRocks版本】例如：1.18.2
【集群规模】例如：3fe（1 follower+2observer）+5be（fe与be混部）
【机器信息】CPU虚拟核/内存/网卡，例如：48C/64G/万兆
【联系方式】为了在解决问题过程中能及时联系到您获取一些日志信息，请补充下您的联系方式，例如：社区群4-小李或者邮箱，谢谢
【附件】

京ICP备2022026421号-1