【详述】broker load第一次导入报错,type:ETL_RUN_FAIL; msg:Broker list path exception.第二次导入正常
【背景】无
【业务影响】
【StarRocks版本】例如:1.19.5
【集群规模】例如:3fe(3 follower)+9be(fe与be混部)
【机器信息】
【附件】
导入load:
load label label_user_behavior_stat_v1_20220507_1655082582 ( DATA INFILE("/team/profile/hive_db/profile_v2/user_behavior_stat_v1/dt=20220507/bhv_type=/") INTO TABLE user_behavior_stat_v1 COLUMNS TERMINATED BY “\t” FORMAT AS “parquet” (user_id,bhv_channel,channel_code,bhv_tid,sku_id,search_query,c1id,c2id,c3id,c4id,brand_code,brand_id,quantity,sale_total_amount,regione_id,branch_id_1,branch_id_2,store_id,internet_time,shop_id,is_pop,business_entity_code,order_state_buy,is_discounts,order_state_submit,order_id,behavior_time,dept_no,category_line_code,on_c1id,on_c2id,on_c3id,s_app_version,external_channel,view_page_count,view_goods_count,sales_amount,use_time_long,session_id,view_type) COLUMNS FROM PATH AS (dt,bhv_type) ) WITH BROKER ‘broker1’ ( “dfs.nameservices” = “xxx”, “dfs.ha.namenodes.grampus” = “xxx”, “dfs.namenode.rpc-address.grampus.nn1” = “xxxx”, “dfs.namenode.rpc-address.grampus.nn3” = “xxxx”, “dfs.client.failover.proxy.provider.grampus” = “org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider”, “hadoop.security.authentication” = “xxx”, “kerberos_principal” = “xxx”, “kerberos_keytab” = “xxx” ) PROPERTIES ( “timeout” = “3600” );
第一次导入失败错误:
JobId: 35036102
Label: label_user_behavior_stat_v1_20220507_1655082582
State: CANCELLED
Progress: ETL:N/A; LOAD:N/A
Type: BROKER
EtlInfo: NULL
TaskInfo: cluster:N/A; timeout(s):3600; max_filter_ratio:0.0
ErrorMsg: type:ETL_RUN_FAIL; msg:Broker list path exception. path=/team/profile/hive_db/profile_v2/user_behavior_stat_v1/dt=20220507/bhv_type=/, broker=TNetworkAddress(hostname:xxx, port:8000)
CreateTime: 2022-06-13 09:09:42
EtlStartTime: 2022-06-13 09:09:47
EtlFinishTime: 2022-06-13 09:09:47
LoadStartTime: 2022-06-13 09:09:47
LoadFinishTime: 2022-06-13 09:11:07
URL: NULL
JobDetails: {“Unfinished backends”:{},“ScannedRows”:0,“TaskNumber”:0,“All backends”:{},“FileNumber”:0,“FileSize”:0}
第二次导入正确: