StarRocks版本:3.2.8
查询语句:
select * from hive.dws_XXX.XXX where logdate = ‘20250107’ and gid = ‘90307747’ LIMIT 0, 200
该分区表数据800万+
hive表存储格式TEXTFILE
运行该sql后be直接宕机GC日志如下:
query_id:e9f107f9-cd80-11ef-a5c4-40a6b7b2f9ac, fragment_instance:e9f107f9-cd80-11ef-a5c4-40a6b7b2f9af
Hive file path: 20250108_024329_14119_prbq3_a7f5ddb1-a81a-4a0f-a102-bb4a523af61d.gz, partition id: 0, length: 80121412, offset: 67108864
tracker:process consumption: 46539262950
tracker:query_pool consumption: 14561920
tracker:query_pool/connector_scan consumption: 0
tracker:load consumption: 1069628526
tracker:metadata consumption: 985261090
tracker:tablet_metadata consumption: 66369446
tracker:rowset_metadata consumption: 22227980
tracker:segment_metadata consumption: 41678822
tracker:column_metadata consumption: 854984842
tracker:tablet_schema consumption: 50544422
tracker:segment_zonemap consumption: 35632116
tracker:short_key_index consumption: 2152797
tracker:column_zonemap_index consumption: 88772522
tracker:ordinal_index consumption: 438705064
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 3732992
tracker:schema_change consumption: 0
tracker:column_pool consumption: 0
tracker:page_cache consumption: 39733340384
tracker:update consumption: 64123183
tracker:chunk_allocator consumption: 2147567984
tracker:clone consumption: 0
tracker:consistency consumption: 0
tracker:datacache consumption: 0
tracker:replication consumption: 0
*** Aborted at 1736313904 (unix time) try “date -d @1736313904” if you are using GNU date ***
PC: @ 0x4f329d0 (unknown)
*** SIGSEGV (@0x98) received by PID 483309 (TID 0x7fd83e68e700) from PID 152; stack trace: ***
@ 0x67c6d22 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7fdb0cc897eb os::Linux::chained_handler()
@ 0x7fdb0cc8e27c JVM_handle_linux_signal
@ 0x7fdb0cc81188 signalHandler()
@ 0x7fdb0c350930 (unknown)
@ 0x4f329d0 (unknown)
@ 0x5b8c252 starrocks::HdfsTextScanner::estimated_mem_usage()
@ 0x37eb662 starrocks::pipeline::ConnectorChunkSource::close()
@ 0x37db300 starrocks::pipeline::ScanOperator::_close_chunk_source_unlocked()
@ 0x37da2e8 starrocks::pipeline::ScanOperator::_finish_chunk_source_task()
@ 0x37ded3e _ZZN9starrocks8pipeline12ScanOperator18_trigger_next_scanEPNS_12RuntimeStateEiENKUlvE_clEv
@ 0x38ed221 starrocks::workgroup::ScanExecutor::worker_thread()
@ 0x2e7d84c starrocks::ThreadPool::dispatch_thread()
@ 0x2e774ca starrocks::supervise_thread()
@ 0x7fdb0c345fed (unknown)
@ 0x7fdb0c0cc16f clone
@ 0x0 (unknown)