为了更快的定位您的问题,请提供以下信息,谢谢
【详述】be3个节点都直接crash了
【背景】12并发查询,但是查询实际的数据量不大。
【业务影响】导致be-crash了,这个是oom导致的吗?我看监控内存没有明显的上涨,并且三个进程基本同时挂了,看起来有点像是bug
【是否存算分离】
【StarRocks版本】3.32
【集群规模】例如:3fe(1 follower+2observer)+3be(fe与be混部)
【附件】
fe.log:
2025-10-20 10:01:57.851+08:00 INFO (starrocks-mysql-nio-pool-2780|627400) [StmtExecutor.execute():745] execute Exception, sql: SELECT * FROM bi_test.bi_test_table WHERE pt_date = ‘2025-09-15’ AND no in ( ‘183849291392’ ) LIMIT 0,100;, error: Backend node not found. Check if any backend node is down.backend: [10.210.5.77 alive: true inBlacklist: true] [10.210.5.78 alive: true inBlacklist: true] [10.210.5.79 alive: true inBlacklist: true] 2025-10-20 10:01:57.851+08:00 WARN (starrocks-mysql-nio-pool-2780|627400) [DefaultCoordinator.cancel():872] cancel execState of query, this is outside invoke 2025-10-20 10:01:57.877+08:00 WARN (ForkJoinPool.commonPool-worker-109|229) [StmtExecutor.executeStmtWithExecPlan():2521] Failed to execute executeStmtWithExecPlan com.starrocks.qe.scheduler.NonRecoverableException: Backend node not found. Check if any backend node is down.backend: [10.210.5.77 alive: true inBlacklist: true] [10.210.5.78 alive: true inBlacklist: true] [10.210.5.79 alive: true inBlacklist: true]
be.log:
*** Aborted at 1760412311 (unix time) try “date -d @1760412311” if you are using GNU date ***
PC: @ 0x43e6240 phmap::priv::raw_hash_set<phmap::priv::FlatHashSetPolicystarrocks::SliceWithHash, starrocks::HashOnSliceWithHash, starrocks::EqualOnSliceWithHash, starrocks::AggregateStateAllocatorstarrocks::SliceWithHash >::resize(unsigned long)
*** SIGSEGV (@0x0) received by PID 14685 (TID 0x7f53afff76c0) from PID 0; stack trace: ***
@ 0x7f54b4aa1ec3 (/usr/lib/x86_64-linux-gnu/libc.so.6+0xa1ec2)
@ 0x748a940 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
@ 0x7f54b5a5b16d os::Linux::chained_handler(int, siginfo*, void*)
@ 0x7f54b5a60bb5 JVM_handle_linux_signal
@ 0x7f54b5a52ec8 signalHandler(int, siginfo*, void*)
@ 0x7f54b4a45320 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x4531f)
@ 0x43e6240 phmap::priv::raw_hash_set<phmap::priv::FlatHashSetPolicystarrocks::SliceWithHash, starrocks::HashOnSliceWithHash, starrocks::EqualOnSliceWithHash, starrocks::AggregateStateAllocatorstarrocks::SliceWithHash >::resize(unsigned long)
@ 0x43e67a7 phmap::priv::raw_hash_set<phmap::priv::FlatHashSetPolicystarrocks::SliceWithHash, starrocks::HashOnSliceWithHash, starrocks::EqualOnSliceWithHash, starrocks::AggregateStateAllocatorstarrocks::SliceWithHash >::prepare_insert(unsigned long)
@ 0x43e6968 starrocks::DictMergeAggregateFunction::fake_dict_state(starrocks::FunctionContext*) const
@ 0x43e8d12 starrocks::DictMergeAggregateFunction::finalize_to_column(starrocks::FunctionContext*, unsigned char const*, starrocks::Column*) const
@ 0x49cc182 starrocks::NullableAggregateFunctionBase<std::shared_ptrstarrocks::AggregateFunction, starrocks::NullableAggregateFunctionState<starrocks::DictMergeState, false>, false, true, starrocks::AggNonNullPredstarrocks::DictMergeState >::finalize_to_column(stah\Å^Q
@ 0x416b449 starrocks::Aggregator::_finalize_to_chunk(unsigned char const*, std::vector<std::shared_ptrstarrocks::Column, std::allocator<std::shared_ptrstarrocks::Column > > const&)
@ 0x41ad6e0 starrocks::Aggregator::convert_to_chunk_no_groupby(std::shared_ptrstarrocks::Chunk)
@ 0x406c86c starrocks::pipeline::AggregateBlockingSourceOperator::pull_chunk(starrocks::RuntimeState)
@ 0x4039901 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
@ 0x4029d46 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
@ 0x3580a2b starrocks::ThreadPool::dispatch_thread()
@ 0x3579f56 starrocks:
:supervise_thread(void*)
@ 0x7f54b4a9ca94 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x9ca93)
@ 0x7f54b4b29c3c (/usr/lib/x86_64-linux-gnu/libc.so.6+0x129c3b)