为了更快的定位您的问题,请提供以下信息,谢谢
【详述】
【背景】
【业务影响】
【是否存算分离】是
【StarRocks版本】3.1.4
【集群规模】例如:1fe +2be(fe与be混部)
【表模型】例如:主键模型
【导入或者导出方式】 datax
【附件】
W1206 18:58:15.323366 21969 mem_hook.cpp:266] large memory alloc: 1476395024 bytes, stack:
@ 0x4e766b3 malloc
@ 0x873feb5 operator new()
@ 0x45138bd std::vector<>::_M_range_insert<>()
@ 0x451509e starrocks::PrimaryKeyEncoder::encode()
@ 0x47f431d starrocks::lake::CompactionState::_load_segments()
@ 0x47f4963 starrocks::lake::CompactionState::load_segments()
@ 0x47bb8ee starrocks::lake::UpdateManager::publish_primary_compaction()
@ 0x5949086 starrocks::lake::PrimaryKeyTxnLogApplier::apply()
@ 0x593ecfd starrocks::lake::publish_version()
@ 0x4e8c1cd _ZZN9starrocks15LakeServiceImpl15publish_versionEPN6google8protobuf13RpcControllerEPKNS_4lake21PublishVersionRequestEPNS5_22PublishVersionResponseEPNS2_7ClosureEENKUlvE_clEv
@ 0x4f782b2 starrocks::ThreadPool::dispatch_thread()
@ 0x4f72d4a starrocks::supervise_thread()
@ 0x7f8e6b5eaea5 start_thread
@ 0x7f8e6a9ebb0d __clone
@ (nil) (unknown)
W1206 18:58:35.721650 21968 transactions.cpp:104] Fail to apply staros://22664/log/0000000000005888_000000000000F316.log: Memory limit exceeded: Memory of process exceed limit. read and decompress page Used: 13291217648, Limit: 13263024291. Mem usage has exceed the limit of BE
/build/starrocks/be/src/storage/rowset/page_io.cpp:135 CurrentThread::mem_tracker()->check_mem_limit(“read and decompress page”)
/build/starrocks/be/src/storage/rowset/scalar_column_iterator.cpp:292 _reader->read_page(_opts, iter.page(), &handle, &page_body, &footer)
/build/starrocks/be/src/storage/rowset/scalar_column_iterator.cpp:252 _read_data_page(_page_iter)
/build/starrocks/be/src/storage/rowset/scalar_column_iterator.cpp:201 _load_next_page(&eos)
/build/starrocks/be/src/storage/rowset/segment_iterator.cpp:134 _column_iterators[i]->next_batch(range, col.get())
/build/starrocks/be/src/storage/rowset/segment_iterator.cpp:938 _context->read_columns(chunk, range)
/build/starrocks/be/src/storage/rowset/segment_iterator.cpp:1011 _read(chunk, rowid, chunk_capacity - chunk_start)
/build/starrocks/be/src/storage/lake/update_manager.cpp:524 compaction_state->load_segments(output_rowset.get(), *tablet_schema, i)
/build/starrocks/be/src/storage/lake/txn_log_applier.cpp:81 apply_compaction_log(log.op_compaction())
W1206 18:58:35.721772 21968 update_manager.cpp:568] Lake update manager remove primary index cache, tablet_id: 22664 , succ: 1