【详述】3.3.5
【背景】执行load操作,使用*/*导入分区目录数据,状态CANCELLED,报错type:LOAD_RUN_FAIL; msg:Backend node not found. Check if any backend node is down.
【业务影响】
【是否存算分离】否
【StarRocks版本】例如:3.3.5
【集群规模】例如:3fe+3be
【机器信息】CPU虚拟核/内存/网卡,例如:48C/64G/万兆
【联系方式】
【附件】
load语句:
LOAD LABEL label_dim_t_fin_account_${timestamp}
(
DATA INFILE(“s3a://XXX/data/wlas/us_wlrd/t_fin_account//”)
INTO TABLEdim_t_fin_account
COLUMNS TERMINATED BY “\t”
FORMAT AS “orc”
(
id, dealer_id, rzone, is_deleted, create_time, modify_time, creator_id, modifier_id, account_number, account_name, account_status, account_type, account_source, outer_account_id, opened_date, closed_date, restrict_date, last_activty_date, customer_id, account_request_id, customer_type, trade_restrict_type, is_pdt, is_senior_age, age, can_sell_short, can_open_position, first_equity_date, enable_order_router, type_changed_status, fpsl_status, default_exec_broker, limit_income, call_mark, sod_version, default_option_exec_broker, has_htb, can_trade_option, crypto_trade_allowed, option_approval, pfill_merge_enabled, can_open_option_position, can_open_crypto_position, option_credit_status, can_crypto_use_provisional, is_dirty, default_mleg_exec_broker, can_trade_fract, penny_credit_status, org_type, fdid, cat_account_type, account_holder_type, default_router, account_class, account_biz_type,customer_source
)
)
WITH BROKER broker1
(
“fs.s3a.access.key” = “${accessKey}”,
“fs.s3a.secret.key” = “${secretKey}”,
“fs.s3a.endpoint” = “${endPoint}”
)
S3目录如下:
be.out日志:
3.3.5 RELEASE (build 6d81f75)
query_id:eea0d294-7044-4617-8757-4eecfe25e9a5, fragment_instance:eea0d294-7044-4617-8757-4eecfe25e9a6
Load file path: s3a://XXX/data/wlas/us_wlrd/t_fin_account/yyyymmdd=HIVE_DEFAULT_PARTITION/part-00000-5cc8fc1e-db7a-4696-91c7-1fb02e8cc671.c000
tracker:process consumption: 762945001
tracker:jemalloc_metadata consumption: 33021560
tracker:jemalloc_fragmentation consumption: 35438793
tracker:query_pool consumption: 32568616
tracker:query_pool/connector_scan consumption: 88403968
tracker:load consumption: 7072
tracker:metadata consumption: 75323506
tracker:tablet_metadata consumption: 57350500
tracker:rowset_metadata consumption: 16316036
tracker:segment_metadata consumption: 193382
tracker:column_metadata consumption: 1463588
tracker:tablet_schema consumption: 313092
tracker:segment_zonemap consumption: 140294
tracker:short_key_index consumption: 3007
tracker:column_zonemap_index consumption: 244780
tracker:ordinal_index consumption: 301928
tracker:bitmap_index consumption: 1600
tracker:bloom_filter_index consumption: 0
tracker:compaction consumption: 0
tracker:schema_change consumption: 0
tracker:column_pool consumption: 0
tracker:page_cache consumption: 45954528
tracker:jit_cache consumption: 0
tracker:update consumption: 7953206
tracker:chunk_allocator consumption: 0
tracker:clone consumption: 0
tracker:consistency consumption: 0
tracker:datacache consumption: 77640435
tracker:replication consumption: 0
*** Aborted at 1741835277 (unix time) try “date -d @1741835277” if you are using GNU date ***
PC: @ 0x5787c24 starrocks::StringColumnReader::get_next(orc::ColumnVectorBatch*, std::shared_ptrstarrocks::Column&, unsigned long, unsigned long)
*** SIGSEGV (@0x88) received by PID 2401561 (TID 0xea721b000040) from PID 136; stack trace: ***
@ 0xea72a5ed25c4 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x825c3)
@ 0x965a808 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
@ 0xea72a6a37ce8 os::Linux::chained_handler(int, siginfo_t*, void*)
@ 0xea72a6a3d5a8 JVM_handle_linux_signal
@ 0xea72a6a30d9c signalHandler(int, siginfo_t*, void*)
@ 0xea72a72a38f8 ([vdso]+0x8f7)
@ 0x5787c24 starrocks::StringColumnReader::get_next(orc::ColumnVectorBatch*, std::shared_ptrstarrocks::Column&, unsigned long, unsigned long)
@ 0x5776390 starrocks::OrcChunkReader::_fill_chunk(std::shared_ptrstarrocks::Chunk, std::vector<starrocks::SlotDescriptor, std::allocatorstarrocks::SlotDescriptor* > const&, std::vector<int, std::allocator > const*)
@ 0x57769c0 starrocks::OrcChunkReader::fill_chunk(std::shared_ptrstarrocks::Chunk)
@ 0x7406ec8 starrocks::ORCScanner::_next_orc_batch()
@ 0x74070cc starrocks::ORCScanner::_next_orc_chunk()
@ 0x7407a9c starrocks::ORCScanner::get_next()
@ 0x76a85ec starrocks::connector::FileDataSource::get_next(starrocks::RuntimeState, std::shared_ptrstarrocks::Chunk)
@ 0x56b171c starrocks::pipeline::ConnectorChunkSource::_read_chunk(starrocks::RuntimeState, std::shared_ptrstarrocks::Chunk)
@ 0x56b8368 starrocks::pipeline::ChunkSource::buffer_next_batch_chunks_blocking(starrocks::RuntimeState, unsigned long, starrocks::workgroup::WorkGroup const*)
@ 0x56128ec auto starrocks::pipeline::ScanOperator::_trigger_next_scan(starrocks::RuntimeState*, int)::{lambda(auto:1&)#1}::operator()starrocks::workgroup::YieldContext(starrocks::workgroup::YieldContext&) const [clone .constprop.0]
@ 0x53a9b54 starrocks::workgroup::ScanExecutor::worker_thread()
@ 0x82c9024 starrocks::ThreadPool::dispatch_thread()
@ 0x82c101c starrocks::supervise_thread(void*)
@ 0xea72a5ecd5b8 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x7d5b7)
@ 0xea72a5f35edc (/usr/lib/aarch64-linux-gnu/libc.so.6+0xe5edb)