【详述】主键模型，没有分区，没有开启enable_persistent_index 写磁盘，一次倒入2亿条数据,
导致be挂掉，而且be无法启动，启动后内存迅速涨满，然后be挂掉。
【导入/导出方式】hdfs LOAD 导入
【背景】一次倒入2亿条数据
【业务影响】 测试环境，暂无影响
【StarRocks版本】2.3.0
【集群规模】1fe+3be 混合部署
【机器信息】CPU虚拟核/内存/网卡，16C/64G/万兆
【附件】
- be.out
start time: Tue Nov 8 17:52:44 CST 2022
tcmalloc: large alloc 1568088064 bytes == 0x112882000 @ 0x57b2cff 0x5a4435c 0x2072b38 0x59947f5 0x1c4511a 0x1c454a5 0x7f96390b520b
tcmalloc: large alloc 2089787392 bytes == 0x16fff4000 @ 0x57b2cff 0x5a4435c 0x2072b38 0x59947f5 0x1c4511a 0x1c454a5 0x7f96390b520b
tcmalloc: large alloc 2089213952 bytes == 0x1ed0ee000 @ 0x57b2cff 0x5a4435c 0x2072b38 0x59947f5 0x1c4511a 0x1c454a5 0x7f96390b520b
tcmalloc: large alloc 2000945152 bytes == 0x2a9100000 @ 0x57b2cff 0x5a4435c 0x2072b38 0x59947f5 0x1c4511a 0x1c454a5 0x7f96390b520b
tcmalloc: large alloc 2079457280 bytes == 0x3d9cee000 @ 0x57b2cff 0x5a4435c 0x2072b38 0x59947f5 0x1c4511a 0x1c454a5 0x7f96390b520b
tcmalloc: large alloc 2050834432 bytes == 0x455c0e000 @ 0x57b2cff 0x5a4435c 0x2072b38 0x59947f5 0x1c4511a 0x1c454a5 0x7f96390b520b
terminate called after throwing an instance of ‘std::bad_alloc’
what(): std::bad_alloc
*** Aborted at 1667901243 (unix time) try “date -d @1667901243” if you are using GNU date ***
PC: @ 0x7f9638609387 __GI_raise
*** SIGABRT (@0xa7cb) received by PID 42955 (TID 0x7f962d1eb700) from PID 42955; stack trace: ***
@ 0x3f90ad2 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f96390be630 (unknown)
@ 0x7f9638609387 __GI_raise
@ 0x7f963860aa78 __GI_abort
@ 0x187f1fd _ZN9__gnu_cxx27__verbose_terminate_handlerEv.cold
@ 0x59942a6 __cxxabiv1::__terminate()
@ 0x5994311 std::terminate()
@ 0x5994464 __cxa_throw
@ 0x1c1d905 phmap::priv::raw_hash_set<>::resize()
@ 0x1c1f3f3 phmap::priv::raw_hash_set<>::prepare_insert()
@ 0x1c1ffae starrocks::SliceHashIndex::upsert()
@ 0x1c183d6 starrocks::ShardByLengthSliceHashIndex::upsert()
@ 0x1c0af78 starrocks::PrimaryIndex::upsert()
@ 0x1a92395 starrocks::TabletUpdates::_apply_rowset_commit()
@ 0x1a96463 starrocks::TabletUpdates::do_apply()
@ 0x21294fd starrocks::ThreadPool::dispatch_thread()
@ 0x2124d0a starrocks:
:supervise_thread()
@ 0x7f96390b6ea5 start_thread
@ 0x7f96386d1b0d __clone
@ 0x0 (unknown)
抓取的内存分区情况
curl -XGET -s http://be_ip:8040/metrics | grep “^starrocks_be_.*_mem_bytes|^starrocks_be_tcmalloc_bytes_in_use”
starrocks_be_chunk_allocator_mem_bytes 0
starrocks_be_clone_mem_bytes 0
starrocks_be_column_pool_mem_bytes 0
starrocks_be_compaction_mem_bytes 0
starrocks_be_consistency_mem_bytes 0
starrocks_be_load_mem_bytes 0
starrocks_be_process_mem_bytes 52667726256
starrocks_be_query_mem_bytes 0
starrocks_be_schema_change_mem_bytes 0
starrocks_be_storage_page_cache_mem_bytes 0
starrocks_be_tablet_meta_mem_bytes 24839391
starrocks_be_tcmalloc_bytes_in_use 59575105704
starrocks_be_update_mem_bytes 46712088958