为了更快的定位您的问题,请提供以下信息,谢谢
【详述】tpc-h测试,执行sql4:
select
o_orderpriority,
count() as order_count
from
hive.temp.orders_orc_partition3
where
o_orderdate >= date ‘1993-07-01’
and o_orderdate < date ‘1993-07-01’ + interval ‘3’ month
and exists (
select
*
from
hive.temp.lineitem_orc_partition3
where
l_orderkey = o_orderkey
and l_commitdate < l_receiptdate
)
group by
o_orderpriority
order by
o_orderpriority;
【背景】做过哪些操作?
【业务影响】
【是否存算分离】是
【StarRocks版本】例如:3.3.2
【集群规模】例如:1fe+3be(fe与be混部)
【机器信息】m7g.4xlarge
【联系方式】社区1群-峻
【附件】
报错
W20240815 02:47:18.310401 252371657293888 mem_hook.cpp:249] large memory alloc, query_id:13e8cd44-a27b-48cb-bb4a-3a576500f901 instance: 13e8cd44-a27b-48cb-bb4a-3a576500f906 acquire:24069709904 bytes, stack:
@ 0x67ae0b8 starrocks::get_stack_traceabi:cxx11
@ 0x7ffff1c malloc
@ 0xd471ddc operator new(unsigned long)
@ 0x51b7458 starrocks::FixedLengthColumnBase::append(starrocks::Column const&, unsigned long, unsigned long)
@ 0x5347bc0 starrocks::NullableColumn::append(starrocks::Column const&, unsigned long, unsigned long)
@ 0x6fe6620 starrocks::JoinHashTable::append_chunk(std::shared_ptrstarrocks::Chunk const&, std::vector<std::shared_ptrstarrocks::Column, std::allocator<std::shared_ptrstarrocks::Column > > const&)
@ 0x6fcef48 starrocks::HashJoinBuilder::append_chunk(std::shared_ptrstarrocks::Chunk const&)
@ 0x6fc1bd8 starrocks::HashJoiner::append_chunk_to_ht(std::shared_ptrstarrocks::Chunk const&)
@ 0x70990f0 starrocks::pipeline::HashJoinBuildOperator::push_chunk(starrocks::RuntimeState, std::shared_ptrstarrocks::Chunk const&)
@ 0x7092ee0 starrocks::pipeline::SpillableHashJoinBuildOperator::push_chunk(starrocks::RuntimeState*, std::shared_ptrstarrocks::Chunk const&)
@ 0x5503520 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
@ 0x7e4e6e8 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
@ 0x81649ec starrocks::ThreadPool::dispatch_thread()
@ 0x815dc5c starrocks::supervise_thread(void*)
@ 0xe58861e8d5c8 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x7d5c7)
@ 0xe58861ef5edc (/usr/lib/aarch64-linux-gnu/libc.so.6+0xe5edb)
W20240815 02:47:18.310401 252371657293888 mem_hook.cpp:249] large memory alloc, query_id:13e8cd44-a27b-48cb-bb4a-3a576500f901 instance: 13e8cd44-a27b-48cb-bb4a-3a576500f906 acquire:24069709904 bytes, stack:
@ 0x67ae0b8 starrocks::get_stack_traceabi:cxx11
@ 0x7ffff1c malloc
@ 0xd471ddc operator new(unsigned long)
@ 0x51b7458 starrocks::FixedLengthColumnBase::append(starrocks::Column const&, unsigned long, unsigned long)
@ 0x5347bc0 starrocks::NullableColumn::append(starrocks::Column const&, unsigned long, unsigned long)
@ 0x6fe6620 starrocks::JoinHashTable::append_chunk(std::shared_ptrstarrocks::Chunk const&, std::vector<std::shared_ptrstarrocks::Column, std::allocator<std::shared_ptrstarrocks::Column > > const&)
@ 0x6fcef48 starrocks::HashJoinBuilder::append_chunk(std::shared_ptrstarrocks::Chunk const&)
@ 0x6fc1bd8 starrocks::HashJoiner::append_chunk_to_ht(std::shared_ptrstarrocks::Chunk const&)
@ 0x70990f0 starrocks::pipeline::HashJoinBuildOperator::push_chunk(starrocks::RuntimeState*, std::shared_ptrstarrocks::Chunk const&)
@ 0x7092ee0 starrocks::pipeline::SpillableHashJoinBuildOperator::push_chunk(starrocks::RuntimeState*, std::shared_ptrstarrocks::Chunk const&)
@ 0x5503520 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
@ 0x7e4e6e8 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
@ 0x81649ec starrocks::ThreadPool::dispatch_thread()
@ 0x815dc5c starrocks::supervise_thread(void*)
@ 0xe58861e8d5c8 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x7d5c7)
@ 0xe58861ef5edc (/usr/lib/aarch64-linux-gnu/libc.so.6+0xe5edb)
E20240815 02:48:11.189389 277936654839872 bfd_parser.cpp:107] set default target to elf64-x86-64 failed.
E20240815 02:48:11.189389 277936654839872 bfd_parser.cpp:107] set default target to elf64-x86-64 failed.
E20240815 02:48:11.189389 277936654839872 bfd_parser.cpp:107] set default target to elf64-x86-64 failed.
W20240815 02:48:12.619732 277936654839872 cache_options.cpp:126] fail to clean residual datacache data, reason: /data/soft/starrocks/be/datacache: No such file or directory
W20240815 02:48:12.619732 277936654839872 cache_options.cpp:126] fail to clean residual datacache data, reason: /data/soft/starrocks/be/datacache: No such file or directory
query_id:80b1baf4-5ab0-11ef-b4e5-06ae1418ac3a, fragment_instance:80b1baf4-5ab0-11ef-b4e5-06ae1418ac40
tracker:process consumption: 28673744960
tracker:query_pool consumption: 28449747728
tracker:query_pool/connector_scan consumption: 750327174
tracker:load consumption: 0
tracker:metadata consumption: 0
tracker:tablet_metadata consumption: 0
tracker:rowset_metadata consumption: 0
tracker:segment_metadata consumption: 0
tracker:column_metadata consumption: 0
tracker:tablet_schema consumption: 0
tracker:segment_zonemap consumption: 0
tracker:short_key_index consumption: 0
tracker:column_zonemap_index consumption: 0
tracker:ordinal_index consumption: 0
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 0
tracker:schema_change consumption: 0
tracker:column_pool consumption: 0
tracker:page_cache consumption: 0
tracker:jit_cache consumption: 0
tracker:update consumption: 0
tracker:chunk_allocator consumption: 0
tracker:clone consumption: 0
tracker:consistency consumption: 0
tracker:datacache consumption: 0
tracker:replication consumption: 0
*** Aborted at 1723690010 (unix time) try “date -d @1723690010” if you are using GNU date ***
PC: @ 0x55802ec starrocks::spill::LogBlockContainer::append_data(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long)
*** SIGSEGV (@0x0) received by PID 6843 (TID 0xf2761a570040) from PID 0; stack trace: ***
@ 0xf276fdf725d4 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x825d3)
@ 0x94841f8 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
@ 0xf276ff3e79d0 ([vdso]+0x9cf)
@ 0x55802ec starrocks::spill::LogBlockContainer::append_data(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long)
@ 0x5585554 starrocks::spill::LogBlock::append(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&)
@ 0x56f5938 starrocks::spill::BlockSpillOutputDataStream::append(starrocks::RuntimeState*, std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long, unsigned long)
@ 0x56ebc0c starrocks::spill::ColumnarSerde::serialize(starrocks::RuntimeState*, starrocks::spill::SerdeContext&, std::shared_ptrstarrocks::Chunk const&, std::shared_ptrstarrocks::spill::SpillOutputDataStream const&, bool)
@ 0x56c6dc8 starrocks::spill::UnorderedMemTable::finalize(starrocks::workgroup::YieldContext&, std::shared_ptrstarrocks::spill::SpillOutputDataStream const&)
@ 0x56bd814 starrocks::spill::PartitionedSpillerWriter::spill_partition(starrocks::workgroup::YieldContext&, starrocks::spill::SerdeContext&, starrocks::spill::SpilledPartition*)
@ 0x56bde70 starrocks::spill::PartitionedSpillerWriter::_spill_input_partitions(starrocks::workgroup::YieldContext&, starrocks::spill::SerdeContext&, std::vector<starrocks::spill::SpilledPartition*, std::allocatorstarrocks::spill::SpilledPartition* > const&)
@ 0x56c2e24 starrocks::spill::PartitionedSpillerWriter::yieldable_flush_task(starrocks::workgroup::YieldContext&, std::vector<starrocks::spill::SpilledPartition*, std::allocatorstarrocks::spill::SpilledPartition* > const&, std::vector<starrocks::spill::SpilledPartit
@ 0x569a07c auto starrocks::spill::PartitionedSpillerWriter::flush<starrocks::spill::IOTaskExecutor, starrocks::spill::ResourceMemTrackerGuard<std::weak_ptrstarrocks::pipeline::QueryContext, std::weak_ptrstarrocks::spill::Spiller >&>(starrocks::RuntimeState*, bool
@ 0x569a298 std::_Function_handler<void (starrocks::workgroup::YieldContext&), starrocks::spill::PartitionedSpillerWriter::flush<starrocks::spill::IOTaskExecutor, starrocks::spill::ResourceMemTrackerGuard<std::weak_ptrstarrocks::pipeline::QueryContext, std::weak_ptr
@ 0x56b9688 starrocks::workgroup::ScanExecutor::worker_thread()
@ 0x81649ec starrocks::ThreadPool::dispatch_thread()
@ 0x815dc5c starrocks::supervise_thread(void*)
@ 0xf276fdf6d5c8 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x7d5c7)
@ 0xf276fdfd5edc (/usr/lib/aarch64-linux-gnu/libc.so.6+0xe5edb)
必现sql
–Q8
select
o_year,
sum(case
when nation = ‘BRAZIL’ then volume
else 0
end) / sum(volume) as mkt_share
from
(
select
extract(year from o_orderdate) as o_year,
l_extendedprice * (1 - l_discount) as volume,
n2.n_name as nation
from
hive.temp.part_orc,
hive.temp.supplier_orc,
hive.temp.lineitem_orc_partition3,
hive.temp.orders_orc_partition3,
hive.temp.customer_orc,
hive.temp.nation_orc n1,
hive.temp.nation_orc n2,
hive.temp.region_orc
where
p_partkey = l_partkey
and s_suppkey = l_suppkey
and l_orderkey = o_orderkey
and o_custkey = c_custkey
and c_nationkey = n1.n_nationkey
and n1.n_regionkey = r_regionkey
and r_name = ‘AMERICA’
and s_nationkey = n2.n_nationkey
and o_orderdate between date ‘1995-01-01’ and date ‘1996-12-31’
and p_type = ‘ECONOMY ANODIZED STEEL’
) as all_nations
group by
o_year
order by
o_year;
遇到了同样的问题,有大佬帮忙看看吗
有保留coredump吗
在pod里,没有coredump,发现开启enable_spill会有这个问题,只要触发落盘就会crash
W20240821 21:30:11.097831 281468227813440 mem_hook.cpp:249] large memory alloc, query_id:5bfba553-5fc1-11ef-bd06-5e997c13d6e7 instance: 5bfba553-5fc1-11ef-bd06-5e997c13d707 acquire:4293943672 bytes, stack:
@ 0x67ae0b8 starrocks::get_stack_traceabi:cxx11
@ 0x7ffff1c malloc
@ 0xd471ddc operator new(unsigned long)
@ 0x51cc08c std::vector<unsigned long, std::allocator >::_M_default_append(unsigned long)
@ 0x51dfcdc starrocks::BinaryColumnBase::upgrade_if_overflow()
@ 0x51a33ec starrocks::Column::upgrade_helper_func(std::shared_ptrstarrocks::Column)
@ 0x5345d34 starrocks::NullableColumn::upgrade_if_overflow()
@ 0x544a8f4 starrocks::Chunk::upgrade_if_overflow()
@ 0x7092808 starrocks::pipeline::SpillableHashJoinBuildOperator::_convert_hash_map_to_chunk()
@ 0x7092f0c starrocks::pipeline::SpillableHashJoinBuildOperator::push_chunk(starrocks::RuntimeState, std::shared_ptrstarrocks::Chunk const&)
@ 0x5503520 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
@ 0x7e4e6e8 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
@ 0x81649ec starrocks::ThreadPool::dispatch_thread()
@ 0x815dc5c starrocks::supervise_thread(void*)
@ 0xffffa79ad5c8 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x7d5c7)
@ 0xffffa7a15edc (/usr/lib/aarch64-linux-gnu/libc.so.6+0xe5edb)
W20240821 21:30:52.868806 281459681919040 socket.cpp:1379] Fail to wait EPOLLOUT of fd=631: Connection timed out [110]
I20240821 21:30:54.642769 281460380467264 olap_server.cpp:908] begin to do tablet meta checkpoint:/starrocks/starrocks-storage
I20240821 21:30:55.109844 281472829096000 daemon.cpp:199] Current memory statistics: process(73403288160), query_pool(72624774944), load(0), metadata(0), compaction(0), schema_change(0), column_pool(0), page_cache(0), update(0), chunk_allocator(7374896), clone(0), consistency(0), datacache(0), jit(0)
3.3.2 RELEASE (build 857dd73)
query_id:5bfba553-5fc1-11ef-bd06-5e997c13d6e7, fragment_instance:5bfba553-5fc1-11ef-bd06-5e997c13d707
tracker:process consumption: 73403287824
tracker:query_pool consumption: 72624775496
tracker:query_pool/connector_scan consumption: 25365469617
tracker:load consumption: 0
tracker:metadata consumption: 0
tracker:tablet_metadata consumption: 0
tracker:rowset_metadata consumption: 0
tracker:segment_metadata consumption: 0
tracker:column_metadata consumption: 0
tracker:tablet_schema consumption: 0
tracker:segment_zonemap consumption: 0
tracker:short_key_index consumption: 0
tracker:column_zonemap_index consumption: 0
tracker:ordinal_index consumption: 0
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 0
tracker:schema_change consumption: 0
tracker:column_pool consumption: 0
tracker:page_cache consumption: 0
tracker:jit_cache consumption: 0
tracker:update consumption: 0
tracker:chunk_allocator consumption: 7374896
tracker:clone consumption: 0
tracker:consistency consumption: 0
tracker:datacache consumption: 0
tracker:replication consumption: 0
*** Aborted at 1724247055 (unix time) try “date -d @1724247055” if you are using GNU date ***
PC: @ 0x55802ec starrocks::spill::LogBlockContainer::append_data(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long)
*** SIGSEGV (@0x0) received by PID 28 (TID 0xfffd099d0040) from PID 0; stack trace: ***
@ 0xffffa79b25d4 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x825d3)
@ 0x94841f8 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
@ 0xffffa8e24850 ([vdso]+0x84f)
@ 0x55802ec starrocks::spill::LogBlockContainer::append_data(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long)
@ 0x5585554 starrocks::spill::LogBlock::append(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&)
@ 0x56f5938 starrocks::spill::BlockSpillOutputDataStream::append(starrocks::RuntimeState*, std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long, unsigned long)
@ 0x56ebc0c starrocks::spill::ColumnarSerde::serialize(starrocks::RuntimeState*, starrocks::spill::SerdeContext&, std::shared_ptrstarrocks::Chunk const&, std::shared_ptrstarrocks::spill::SpillOutputDataStream const&, bool)
@ 0x56c6dc8 starrocks::spill::UnorderedMemTable::finalize(starrocks::workgroup::YieldContext&, std::shared_ptrstarrocks::spill::SpillOutputDataStream const&)
@ 0x56bd814 starrocks::spill::PartitionedSpillerWriter::spill_partition(starrocks::workgroup::YieldContext&, starrocks::spill::SerdeContext&, starrocks::spill::SpilledPartition*)
I20240821 21:30:55.660676 281460773879872 tablet_manager.cpp:990] Report all 0 tablets info. max_tablet_rowset_num:0
I20240821 21:30:55.660882 281460773879872 task_worker_pool.cpp:719] Report tablets successfully, report version: 17242440540000
@ 0x56bde70 starrocks::spill::PartitionedSpillerWriter::_spill_input_partitions(starrocks::workgroup::YieldContext&, starrocks::spill::SerdeContext&, std::vector<starrocks::spill::SpilledPartition*, std::allocatorstarrocks::spill::SpilledPartition* > const&)
@ 0x56c2e24 starrocks::spill::PartitionedSpillerWriter::yieldable_flush_task(starrocks::workgroup::YieldContext&, std::vector<starrocks::spill::SpilledPartition*, std::allocatorstarrocks::spill::SpilledPartition* > const&, std::vector<starrocks::spill::SpilledPartit
@ 0x569a07c auto starrocks::spill::PartitionedSpillerWriter::flush<starrocks::spill::IOTaskExecutor, starrocks::spill::ResourceMemTrackerGuard<std::weak_ptrstarrocks::pipeline::QueryContext, std::weak_ptrstarrocks::spill::Spiller >&>(starrocks::RuntimeState*, bool
@ 0x569a298 std::_Function_handler<void (starrocks::workgroup::YieldContext&), starrocks::spill::PartitionedSpillerWriter::flush<starrocks::spill::IOTaskExecutor, starrocks::spill::ResourceMemTrackerGuard<std::weak_ptrstarrocks::pipeline::QueryContext, std::weak_ptr
@ 0x56b9688 starrocks::workgroup::ScanExecutor::worker_thread()
@ 0x81649ec starrocks::ThreadPool::dispatch_thread()
@ 0x815dc5c starrocks::supervise_thread(void*)
@ 0xffffa79ad5c8 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x7d5c7)
@ 0xffffa7a15edc (/usr/lib/aarch64-linux-gnu/libc.so.6+0xe5edb)
保留个coredump吧,方便排查
另外开启下BE的spill相关日志, be conf 中添加
sys_log_verbose_modules = spill*,serd*,data_stream*,input_stream*
然后把crash时间点附近的be.INFO提供下
另外你们用的不是官方包吧
是官方包啊
I20240822 11:30:07.945579 281461614772288 data_stream.cpp:86] append block[LogBlock:0xfffc8c7609c0[container=/starrocks/local_storage/727008d0-6036-11ef-9a5d-22f03740421a/727008d0-6036-11ef-9a5d-22f037404242-hash-join-build-12-0, offset=0, len=10737280581]], size[141070]
I20240822 11:30:07.945693 281461614772288 data_stream.cpp:104] flush block[LogBlock:0xfffc8c7609c0[container=/starrocks/local_storage/727008d0-6036-11ef-9a5d-22f03740421a/727008d0-6036-11ef-9a5d-22f037404242-hash-join-build-12-0, offset=0, len=10737421651]]
I20240822 11:30:07.945723 281461614772288 spill_components.cpp:481] spill partition[[id=137,bytes=31833927819,mem_size=0,num_rows=312492032,in_mem=false,is_spliting=false]], bytes[105180114] rows[1028096]
I20240822 11:30:07.960735 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312627200,spiller:0xfffb8078c310
I20240822 11:30:07.961130 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312631296,spiller:0xfffb8078c310
I20240822 11:30:07.961883 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312639488,spiller:0xfffb8078c310
I20240822 11:30:07.962644 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312647680,spiller:0xfffb8078c310
I20240822 11:30:07.963011 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312651776,spiller:0xfffb8078c310
I20240822 11:30:07.963384 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312655872,spiller:0xfffb8078c310
I20240822 11:30:07.963753 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312659968,spiller:0xfffb8078c310
I20240822 11:30:07.964113 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312664064,spiller:0xfffb8078c310
I20240822 11:30:07.964488 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312668160,spiller:0xfffb8078c310
I20240822 11:30:07.964851 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312672256,spiller:0xfffb8078c310
I20240822 11:30:07.965248 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312676352,spiller:0xfffb8078c310
I20240822 11:30:07.965613 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312680448,spiller:0xfffb8078c310
I20240822 11:30:07.965981 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312684544,spiller:0xfffb8078c310
I20240822 11:30:07.966348 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312688640,spiller:0xfffb8078c310
I20240822 11:30:07.966740 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312692736,spiller:0xfffb8078c310
I20240822 11:30:07.967111 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312696832,spiller:0xfffb8078c310
I20240822 11:30:07.967473 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312700928,spiller:0xfffb8078c310
I20240822 11:30:07.967845 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312705024,spiller:0xfffb8078c310
I20240822 11:30:07.968213 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312709120,spiller:0xfffb8078c310
I20240822 11:30:07.968581 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312713216,spiller:0xfffb8078c310
I20240822 11:30:07.968947 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312717312,spiller:0xfffb8078c310
I20240822 11:30:07.969325 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312721408,spiller:0xfffb8078c310
I20240822 11:30:07.969688 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312725504,spiller:0xfffb8078c310
I20240822 11:30:07.970060 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312729600,spiller:0xfffb8078c310
I20240822 11:30:07.970426 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312733696,spiller:0xfffb8078c310
I20240822 11:30:07.970790 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312737792,spiller:0xfffb8078c310
I20240822 11:30:07.971157 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312741888,spiller:0xfffb8078c310
I20240822 11:30:07.971525 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312745984,spiller:0xfffb8078c310
I20240822 11:30:07.971892 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312750080,spiller:0xfffb8078c310
I20240822 11:30:07.972263 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312754176,spiller:0xfffb8078c310
I20240822 11:30:07.972632 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312758272,spiller:0xfffb8078c310
I20240822 11:30:07.972995 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312762368,spiller:0xfffb8078c310
I20240822 11:30:07.973372 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312766464,spiller:0xfffb8078c310
I20240822 11:30:07.973732 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312770560,spiller:0xfffb8078c310
I20240822 11:30:07.974088 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312774656,spiller:0xfffb8078c310
I20240822 11:30:07.974448 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312778752,spiller:0xfffb8078c310
I20240822 11:30:07.974803 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312782848,spiller:0xfffb8078c310
I20240822 11:30:07.975159 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312786944,spiller:0xfffb8078c310
I20240822 11:30:07.975529 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312791040,spiller:0xfffb8078c310
I20240822 11:30:07.975884 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312795136,spiller:0xfffb8078c310
I20240822 11:30:07.976244 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312799232,spiller:0xfffb8078c310
I20240822 11:30:07.976620 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312803328,spiller:0xfffb8078c310
I20240822 11:30:07.976981 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312807424,spiller:0xfffb8078c310
I20240822 11:30:07.977347 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312811520,spiller:0xfffb8078c310
I20240822 11:30:07.977710 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312815616,spiller:0xfffb8078c310
I20240822 11:30:07.978073 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312819712,spiller:0xfffb8078c310
I20240822 11:30:07.978431 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312823808,spiller:0xfffb8078c310
I20240822 11:30:07.978795 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312827904,spiller:0xfffb8078c310
I20240822 11:30:07.979168 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312832000,spiller:0xfffb8078c310
I20240822 11:30:07.979534 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312836096,spiller:0xfffb8078c310
I20240822 11:30:07.979906 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312840192,spiller:0xfffb8078c310
I20240822 11:30:07.980262 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312844288,spiller:0xfffb8078c310
I20240822 11:30:07.980621 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312848384,spiller:0xfffb8078c310
I20240822 11:30:07.980984 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312852480,spiller:0xfffb8078c310
I20240822 11:30:07.981374 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312856576,spiller:0xfffb8078c310
I20240822 11:30:07.981740 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312860672,spiller:0xfffb8078c310
I20240822 11:30:07.982109 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312864768,spiller:0xfffb8078c310
I20240822 11:30:07.982483 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312868864,spiller:0xfffb8078c310
I20240822 11:30:07.982852 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312872960,spiller:0xfffb8078c310
I20240822 11:30:07.983227 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312877056,spiller:0xfffb8078c310
I20240822 11:30:07.983594 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312881152,spiller:0xfffb8078c310
I20240822 11:30:07.983968 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312885248,spiller:0xfffb8078c310
I20240822 11:30:07.984342 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312889344,spiller:0xfffb8078c310
I20240822 11:30:07.984719 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312893440,spiller:0xfffb8078c310
I20240822 11:30:07.985109 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312897536,spiller:0xfffb8078c310
I20240822 11:30:07.985493 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312901632,spiller:0xfffb8078c310
I20240822 11:30:07.985866 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312905728,spiller:0xfffb8078c310
I20240822 11:30:07.986226 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312909824,spiller:0xfffb8078c310
I20240822 11:30:07.986616 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312913920,spiller:0xfffb8078c310
I20240822 11:30:07.986980 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312918016,spiller:0xfffb8078c310
I20240822 11:30:07.987349 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312922112,spiller:0xfffb8078c310
I20240822 11:30:07.987729 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312926208,spiller:0xfffb8078c310
I20240822 11:30:07.988112 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312930304,spiller:0xfffb8078c310
I20240822 11:30:07.988494 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312934400,spiller:0xfffb8078c310
I20240822 11:30:07.988869 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312938496,spiller:0xfffb8078c310
I20240822 11:30:07.989238 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312942592,spiller:0xfffb8078c310
I20240822 11:30:07.989601 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312946688,spiller:0xfffb8078c310
I20240822 11:30:07.989971 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312950784,spiller:0xfffb8078c310
I20240822 11:30:07.990337 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312954880,spiller:0xfffb8078c310
I20240822 11:30:07.990705 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312958976,spiller:0xfffb8078c310
I20240822 11:30:07.991073 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312963072,spiller:0xfffb8078c310
I20240822 11:30:07.991433 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312967168,spiller:0xfffb8078c310
I20240822 11:30:07.991805 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312971264,spiller:0xfffb8078c310
I20240822 11:30:07.992173 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312975360,spiller:0xfffb8078c310
I20240822 11:30:07.992543 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312979456,spiller:0xfffb8078c310
I20240822 11:30:07.992903 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312983552,spiller:0xfffb8078c310
I20240822 11:30:07.993285 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312987648,spiller:0xfffb8078c310
I20240822 11:30:07.993660 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312991744,spiller:0xfffb8078c310
I20240822 11:30:07.994033 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312995840,spiller:0xfffb8078c310
I20240822 11:30:07.994395 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:312999936,spiller:0xfffb8078c310
I20240822 11:30:07.994760 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313004032,spiller:0xfffb8078c310
I20240822 11:30:07.995142 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313008128,spiller:0xfffb8078c310
I20240822 11:30:07.995521 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313012224,spiller:0xfffb8078c310
I20240822 11:30:07.995891 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313016320,spiller:0xfffb8078c310
I20240822 11:30:07.996270 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313020416,spiller:0xfffb8078c310
I20240822 11:30:07.996659 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313024512,spiller:0xfffb8078c310
I20240822 11:30:07.997026 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313028608,spiller:0xfffb8078c310
I20240822 11:30:07.997412 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313032704,spiller:0xfffb8078c310
I20240822 11:30:07.997789 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313036800,spiller:0xfffb8078c310
I20240822 11:30:07.998157 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313040896,spiller:0xfffb8078c310
I20240822 11:30:07.998532 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313044992,spiller:0xfffb8078c310
I20240822 11:30:07.998919 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313049088,spiller:0xfffb8078c310
I20240822 11:30:07.999288 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313053184,spiller:0xfffb8078c310
I20240822 11:30:07.999654 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313057280,spiller:0xfffb8078c310
I20240822 11:30:08.000017 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313061376,spiller:0xfffb8078c310
I20240822 11:30:08.000387 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313065472,spiller:0xfffb8078c310
I20240822 11:30:08.000756 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313069568,spiller:0xfffb8078c310
I20240822 11:30:08.001131 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313073664,spiller:0xfffb8078c310
I20240822 11:30:08.001505 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313077760,spiller:0xfffb8078c310
I20240822 11:30:08.001872 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313081856,spiller:0xfffb8078c310
I20240822 11:30:08.002237 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313085952,spiller:0xfffb8078c310
I20240822 11:30:08.002605 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313090048,spiller:0xfffb8078c310
I20240822 11:30:08.002981 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313094144,spiller:0xfffb8078c310
I20240822 11:30:08.003351 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313098240,spiller:0xfffb8078c310
I20240822 11:30:08.003714 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313102336,spiller:0xfffb8078c310
I20240822 11:30:08.004092 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313106432,spiller:0xfffb8078c310
I20240822 11:30:08.004456 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313110528,spiller:0xfffb8078c310
I20240822 11:30:08.004840 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313114624,spiller:0xfffb8078c310
I20240822 11:30:08.005220 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313118720,spiller:0xfffb8078c310
I20240822 11:30:08.005589 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313122816,spiller:0xfffb8078c310
I20240822 11:30:08.005978 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313126912,spiller:0xfffb8078c310
I20240822 11:30:08.006366 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313131008,spiller:0xfffb8078c310
I20240822 11:30:08.006784 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313135104,spiller:0xfffb8078c310
I20240822 11:30:08.007163 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313139200,spiller:0xfffb8078c310
I20240822 11:30:08.007527 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313143296,spiller:0xfffb8078c310
I20240822 11:30:08.007898 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313147392,spiller:0xfffb8078c310
I20240822 11:30:08.008270 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313151488,spiller:0xfffb8078c310
I20240822 11:30:08.008642 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313155584,spiller:0xfffb8078c310
I20240822 11:30:08.009006 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313159680,spiller:0xfffb8078c310
I20240822 11:30:08.009394 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313163776,spiller:0xfffb8078c310
I20240822 11:30:08.009766 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313167872,spiller:0xfffb8078c310
I20240822 11:30:08.010142 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313171968,spiller:0xfffb8078c310
I20240822 11:30:08.010515 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313176064,spiller:0xfffb8078c310
I20240822 11:30:08.010885 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313180160,spiller:0xfffb8078c310
I20240822 11:30:08.011293 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313184256,spiller:0xfffb8078c310
I20240822 11:30:08.011686 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313188352,spiller:0xfffb8078c310
I20240822 11:30:08.012077 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313192448,spiller:0xfffb8078c310
I20240822 11:30:08.012452 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313196544,spiller:0xfffb8078c310
I20240822 11:30:08.012820 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313200640,spiller:0xfffb8078c310
I20240822 11:30:08.013204 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313204736,spiller:0xfffb8078c310
I20240822 11:30:08.013558 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313208832,spiller:0xfffb8078c310
I20240822 11:30:08.013913 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313212928,spiller:0xfffb8078c310
I20240822 11:30:08.014267 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313217024,spiller:0xfffb8078c310
I20240822 11:30:08.014631 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313221120,spiller:0xfffb8078c310
I20240822 11:30:08.015005 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313225216,spiller:0xfffb8078c310
I20240822 11:30:08.015365 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313229312,spiller:0xfffb8078c310
I20240822 11:30:08.015735 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313233408,spiller:0xfffb8078c310
I20240822 11:30:08.016096 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313237504,spiller:0xfffb8078c310
I20240822 11:30:08.016490 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313241600,spiller:0xfffb8078c310
I20240822 11:30:08.016855 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313245696,spiller:0xfffb8078c310
I20240822 11:30:08.017237 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313249792,spiller:0xfffb8078c310
I20240822 11:30:08.017611 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313253888,spiller:0xfffb8078c310
I20240822 11:30:08.017977 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313257984,spiller:0xfffb8078c310
I20240822 11:30:08.018343 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313262080,spiller:0xfffb8078c310
I20240822 11:30:08.018709 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313266176,spiller:0xfffb8078c310
I20240822 11:30:08.019078 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313270272,spiller:0xfffb8078c310
I20240822 11:30:08.019444 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313274368,spiller:0xfffb8078c310
I20240822 11:30:08.019809 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313278464,spiller:0xfffb8078c310
I20240822 11:30:08.020178 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313282560,spiller:0xfffb8078c310
I20240822 11:30:08.020538 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313286656,spiller:0xfffb8078c310
I20240822 11:30:08.020906 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313290752,spiller:0xfffb8078c310
I20240822 11:30:08.021289 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313294848,spiller:0xfffb8078c310
I20240822 11:30:08.021658 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313298944,spiller:0xfffb8078c310
I20240822 11:30:08.022021 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313303040,spiller:0xfffb8078c310
I20240822 11:30:08.022386 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313307136,spiller:0xfffb8078c310
I20240822 11:30:08.022754 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313311232,spiller:0xfffb8078c310
I20240822 11:30:08.023118 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313315328,spiller:0xfffb8078c310
I20240822 11:30:08.023490 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313319424,spiller:0xfffb8078c310
I20240822 11:30:08.023860 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313323520,spiller:0xfffb8078c310
I20240822 11:30:08.024227 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313327616,spiller:0xfffb8078c310
I20240822 11:30:08.024591 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313331712,spiller:0xfffb8078c310
I20240822 11:30:08.024966 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313335808,spiller:0xfffb8078c310
I20240822 11:30:08.025351 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313339904,spiller:0xfffb8078c310
I20240822 11:30:08.025722 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313344000,spiller:0xfffb8078c310
I20240822 11:30:08.026098 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313348096,spiller:0xfffb8078c310
I20240822 11:30:08.026488 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313352192,spiller:0xfffb8078c310
I20240822 11:30:08.026853 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313356288,spiller:0xfffb8078c310
I20240822 11:30:08.027224 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313360384,spiller:0xfffb8078c310
I20240822 11:30:08.027592 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313364480,spiller:0xfffb8078c310
I20240822 11:30:08.027961 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313368576,spiller:0xfffb8078c310
I20240822 11:30:08.028328 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313372672,spiller:0xfffb8078c310
I20240822 11:30:08.028693 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313376768,spiller:0xfffb8078c310
I20240822 11:30:08.029062 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313380864,spiller:0xfffb8078c310
I20240822 11:30:08.029433 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313384960,spiller:0xfffb8078c310
I20240822 11:30:08.029798 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313389056,spiller:0xfffb8078c310
I20240822 11:30:08.030162 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313393152,spiller:0xfffb8078c310
I20240822 11:30:08.030529 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313397248,spiller:0xfffb8078c310
I20240822 11:30:08.030897 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313401344,spiller:0xfffb8078c310
I20240822 11:30:08.031262 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313405440,spiller:0xfffb8078c310
I20240822 11:30:08.031642 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313409536,spiller:0xfffb8078c310
I20240822 11:30:08.032017 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313413632,spiller:0xfffb8078c310
I20240822 11:30:08.032382 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313417728,spiller:0xfffb8078c310
I20240822 11:30:08.032743 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313421824,spiller:0xfffb8078c310
I20240822 11:30:08.033125 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313425920,spiller:0xfffb8078c310
I20240822 11:30:08.033497 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313430016,spiller:0xfffb8078c310
I20240822 11:30:08.033858 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313434112,spiller:0xfffb8078c310
I20240822 11:30:08.034231 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313438208,spiller:0xfffb8078c310
I20240822 11:30:08.034598 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313442304,spiller:0xfffb8078c310
I20240822 11:30:08.034971 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313446400,spiller:0xfffb8078c310
I20240822 11:30:08.035344 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313450496,spiller:0xfffb8078c310
I20240822 11:30:08.035705 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313454592,spiller:0xfffb8078c310
I20240822 11:30:08.036067 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313458688,spiller:0xfffb8078c310
I20240822 11:30:08.036456 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313462784,spiller:0xfffb8078c310
I20240822 11:30:08.036825 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313466880,spiller:0xfffb8078c310
I20240822 11:30:08.037205 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313470976,spiller:0xfffb8078c310
I20240822 11:30:08.037572 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313475072,spiller:0xfffb8078c310
I20240822 11:30:08.037960 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313479168,spiller:0xfffb8078c310
I20240822 11:30:08.038338 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313483264,spiller:0xfffb8078c310
I20240822 11:30:08.038717 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313487360,spiller:0xfffb8078c310
I20240822 11:30:08.039084 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313491456,spiller:0xfffb8078c310
I20240822 11:30:08.039457 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313495552,spiller:0xfffb8078c310
I20240822 11:30:08.039826 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313499648,spiller:0xfffb8078c310
I20240822 11:30:08.040207 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313503744,spiller:0xfffb8078c310
I20240822 11:30:08.040580 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313507840,spiller:0xfffb8078c310
I20240822 11:30:08.040988 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313511936,spiller:0xfffb8078c310
I20240822 11:30:08.041425 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313516032,spiller:0xfffb8078c310
I20240822 11:30:08.041874 281468066267200 spiller.hpp:46] spilled rows:4096,cumulative:313520128,spiller:0xfffb8078c310
I20240822 11:30:08.042239 281461340438592 spill_components.cpp:497] spill input partition[[id=137,bytes=31833927819,mem_size=0,num_rows=313520128,in_mem=false,is_spliting=false]], processing idx[0]
I20240822 11:30:08.042827 281461340438592 data_stream.cpp:86] append block[LogBlock:0xfffc8c7609c0[container=/starrocks/local_storage/727008d0-6036-11ef-9a5d-22f03740421a/727008d0-6036-11ef-9a5d-22f037404242-hash-join-build-12-0, offset=0, len=10737421651]], size[142303]
3.3.2 RELEASE (build 857dd73)
query_id:727008d0-6036-11ef-9a5d-22f03740421a, fragment_instance:727008d0-6036-11ef-9a5d-22f037404242
tracker:process consumption: 92363952968
tracker:query_pool consumption: 88556312768
tracker:query_pool/connector_scan consumption: 731804084
tracker:load consumption: 0
tracker:metadata consumption: 882
tracker:tablet_metadata consumption: 882
tracker:rowset_metadata consumption: 0
tracker:segment_metadata consumption: 0
tracker:column_metadata consumption: 0
tracker:tablet_schema consumption: 882
tracker:segment_zonemap consumption: 0
tracker:short_key_index consumption: 0
tracker:column_zonemap_index consumption: 0
tracker:ordinal_index consumption: 0
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 0
tracker:schema_change consumption: 0
tracker:column_pool consumption: 0
tracker:page_cache consumption: 0
tracker:jit_cache consumption: 5384
tracker:update consumption: 0
tracker:chunk_allocator consumption: 2078877392
tracker:clone consumption: 0
tracker:consistency consumption: 0
tracker:datacache consumption: 3638
tracker:replication consumption: 0
*** Aborted at 1724297408 (unix time) try “date -d @1724297408” if you are using GNU date ***
PC: @ 0x55802ec starrocks::spill::LogBlockContainer::append_data(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long)
*** SIGSEGV (@0x0) received by PID 28 (TID 0xfffcd3370040) from PID 0; stack trace: ***
@ 0xffff8b4b25d4 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x825d3)
@ 0x94841f8 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
@ 0xffff8c921850 ([vdso]+0x84f)
@ 0x55802ec starrocks::spill::LogBlockContainer::append_data(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long)
@ 0x5585554 starrocks::spill::LogBlock::append(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&)
I20240822 11:30:08.091770 281472357236800 daemon.cpp:199] Current memory statistics: process(92363952968), query_pool(88556312768), load(0), metadata(882), compaction(0), schema_change(0), column_pool(0), page_cache(0), update(0), chunk_allocator(2078877392), clone(0), consistency(0), datacache(3638), jit(5384)
@ 0x56f5938 starrocks::spill::BlockSpillOutputDataStream::append(starrocks::RuntimeState*, std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long, unsigned long)
@ 0x56ebc0c starrocks::spill::ColumnarSerde::serialize(starrocks::RuntimeState*, starrocks::spill::SerdeContext&, std::shared_ptrstarrocks::Chunk const&, std::shared_ptrstarrocks::spill::SpillOutputDataStream const&, bool)
@ 0x56c6dc8 starrocks::spill::UnorderedMemTable::finalize(starrocks::workgroup::YieldContext&, std::shared_ptrstarrocks::spill::SpillOutputDataStream const&)
@ 0x56bd814 starrocks::spill::PartitionedSpillerWriter::spill_partition(starrocks::workgroup::YieldContext&, starrocks::spill::SerdeContext&, starrocks::spill::SpilledPartition*)
@ 0x56bde70 starrocks::spill::PartitionedSpillerWriter::_spill_input_partitions(starrocks::workgroup::YieldContext&, starrocks::spill::SerdeContext&, std::vector<starrocks::spill::SpilledPartition*, std::allocatorstarrocks::spill::SpilledPartition* > const&)
@ 0x56c2e24 starrocks::spill::PartitionedSpillerWriter::yieldable_flush_task(starrocks::workgroup::YieldContext&, std::vector<starrocks::spill::SpilledPartition*, std::allocatorstarrocks::spill::SpilledPartition* > const&, std::vector<starrocks::spill::SpilledPartit
@ 0x569a07c auto starrocks::spill::PartitionedSpillerWriter::flush<starrocks::spill::IOTaskExecutor, starrocks::spill::ResourceMemTrackerGuard<std::weak_ptrstarrocks::pipeline::QueryContext, std::weak_ptrstarrocks::spill::Spiller >&>(starrocks::RuntimeState*, bool
@ 0x569a298 std::_Function_handler<void (starrocks::workgroup::YieldContext&), starrocks::spill::PartitionedSpillerWriter::flush<starrocks::spill::IOTaskExecutor, starrocks::spill::ResourceMemTrackerGuard<std::weak_ptrstarrocks::pipeline::QueryContext, std::weak_ptr
@ 0x56b9688 starrocks::workgroup::ScanExecutor::worker_thread()
@ 0x81649ec starrocks::ThreadPool::dispatch_thread()
@ 0x815dc5c starrocks::supervise_thread(void*)
@ 0xffff8b4ad5c8 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x7d5c7)
@ 0xffff8b515edc (/usr/lib/aarch64-linux-gnu/libc.so.6+0xe5edb)
coredump 保留了吗
这个是在哪下载的
部署在k8s上的,目前节点挂了也就没coredump了
输出到控制台的日志
这个应该是你们自己编译的binary,等弄个 coredump,我再远程帮你们看下吧
不是自己编译的,从官方镜像下载的arm架构的包