为了更快的定位您的问题,请提供以下信息,谢谢
【详述】3.3.2版本存算分离架构,启动任务会导致所有CN同时挂掉。
【背景】执行数据计算任务, 参与计算的数据规模10G以下
【业务影响】是
【是否存算分离】是
【StarRocks版本】3.3.2
【集群规模】例如:3fe(1 follower+2observer)+ 4CN 未混部。
【机器信息】云原生部署, 通过starrocks operator 4C 16G *3 做k8s master和三个FE, 8C32G *4 CN独占。
【联系方式】StarRocks 3.0-存算分离用户群 - netero
【附件】
- cn.out 大量类似这种内容的日志:
3.3.2 RELEASE (build 857dd73)
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
tracker:process consumption: 10646750680
tracker:query_pool consumption: 1302769208
tracker:query_pool/connector_scan consumption: 1782574009
tracker:load consumption: 245013744
tracker:metadata consumption: 71692699
tracker:tablet_metadata consumption: 803728
tracker:rowset_metadata consumption: 0
tracker:segment_metadata consumption: 6003809
tracker:column_metadata consumption: 64885162
tracker:tablet_schema consumption: 803728
tracker:segment_zonemap consumption: 3673817
tracker:short_key_index consumption: 1304831
tracker:column_zonemap_index consumption: 9206402
tracker:ordinal_index consumption: 34663464
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 347465224
tracker:schema_change consumption: 0
tracker:column_pool consumption: 0
tracker:page_cache consumption: 5230860448
tracker:jit_cache consumption: 9136
tracker:update consumption: 0
tracker:chunk_allocator consumption: 2088775488
tracker:clone consumption: 0
tracker:consistency consumption: 0
tracker:datacache consumption: 118929611
tracker:replication consumption: 0
*** Aborted at 1724815202 (unix time) try “date -d @1724815202” if you are using GNU date ***
PC: @ 0x746f8cb starrocks::pipeline::HashJoinerFactory::get_builder(int, int)
*** SIGFPE (@0x746f8cb) received by PID 28 (TID 0x7fd5ebeea640) from PID 122091723; stack trace: ***
@ 0x7fd64ea99ee8 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x99ee7)
@ 0x9eb6839 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
@ 0x7fd64ea42520 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x4251f)
@ 0x746f8cb starrocks::pipeline::HashJoinerFactory::get_builder(int, int)
@ 0x736e3f6 starrocks::pipeline::SpillableHashJoinProbeOperatorFactory::create(int, int)
@ 0x558778f starrocks::pipeline::Pipeline::instantiate_drivers(starrocks::RuntimeState*)
@ 0x55817ac starrocks::pipeline::FragmentContext::iterate_pipeline(std::function<void (starrocks::pipeline::Pipeline*)> const&)
@ 0x85f8f82 starrocks::pipeline::FragmentExecutor::_prepare_pipeline_driver(starrocks::ExecEnv*, starrocks::pipeline::UnifiedExecPlanFragmentParams const&)
@ 0x85fca60 starrocks::pipeline::FragmentExecutor::prepare(starrocks::ExecEnv*, starrocks::TExecPlanFragmentParams const&, starrocks::TExecPlanFragmentParams const&)
@ 0x8744af6 starrocks::PInternalServiceImplBasestarrocks::PInternalService::_exec_plan_fragment_by_pipeline(starrocks::TExecPlanFragmentParams const&, starrocks::TExecPlanFragmentParams const&)
@ 0x874ad85 starrocks::PInternalServiceImplBasestarrocks::PInternalService::_exec_plan_fragment(brpc::Controller*, starrocks::PExecPlanFragmentRequest const*)
@ 0x875597b starrocks::PInternalServiceImplBasestarrocks::PInternalService::_exec_plan_fragment(google::protobuf::RpcController*, starrocks::PExecPlanFragmentRequest const*, starrocks::PExecPlanFragmentResult*, google::protobuf::Closure*)
@ 0x52d9c6d starrocks::PriorityThreadPool::work_thread(int)
@ 0x9e693bb thread_proxy
@ 0x7fd64ea94ac3 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x94ac2)
@ 0x7fd64eb26850 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x12684f)
start time: Wed Aug 28 11:20:26 CST 2024, server uptime: 11:20:26 up 22 days, 10 min, 0 users, load average: 107.45, 34.21, 13.53