【详述】在访问hive外表时,be节点大量掉落(节点掉落4个,后续又掉落两个)
【背景】做过哪些操作?
hive建表语句:
CREATE TABLE HEMSS.SFK_ASSET_RISK_LVL_Z
( LATN_NAME STRING,
ASSET_ROW_ID STRING,
ACCS_NBR STRING,
RISK_RULE_ID INT,
RISK_GRADE STRING,
STAT_FLG INT)
PARTITIONED BY (DATE_CD STRING)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘\u0007’ ;
hive外表建表语句:
CREATE EXTERNAL TABLE HEMSS.SFK_ASSET_RISK_LVL_Z_JFHIVE (
LATN_NAME STRING,
ASSET_ROW_ID STRING,
ACCS_NBR STRING,
RISK_RULE_ID INT,
RISK_GRADE STRING,
STAT_FLG INT,
DATE_CD STRING
) ENGINE=HIVE
COMMENT “PARTITION BY ()”
PROPERTIES (
“database” = “HEMSS”,
“table” = “SFK_ASSET_RISK_LVL_Z”,
“resource” = “jfhive”,
“hive.metastore.uris” = “************”
);
【业务影响】
【StarRocks版本】例如:2.2.2
【集群规模】例如:3fe+9be
【机器信息】CPU虚拟核/内存/网卡,例如:48C/64G/万兆
【附件】
- fe.warn.log/be.warn.log/相应截图
fe.warning.log
be.warning.log
- 慢查询:
- Profile信息
- 并行度:show variables like ‘%parallel_fragment_exec_instance_num%’;
- cbo是否开启:show variables like ‘%cbo%’;
- be节点cpu和内存使用率截图


