3.1.2主键模型部分列更新失败
【详述】问题详细描述
在标签画像场景中,希望把多个单标签表,通过spark connector部分列更新功能,将单标签数据导入到标签宽表。但始终导入失败,报错如下:
【背景】做过哪些操作?
建表语句:
CREATE TABLE
label_model
(dt
date NOT NULL COMMENT “数据统计时间,yyyy-mm-dd”,id
bigint NOT NULL COMMENT “用户id”,enable
tinyint(4) NULL DEFAULT “1” COMMENT “模型是否可用,未删除则为可用,1-可用,0-不可用”,published
tinyint(4) NULL DEFAULT “1” COMMENT “模型是否被公开, 1-公开,0-非公开”,external
tinyint(4) NULL DEFAULT “0” COMMENT “模型是否为外部搬用而来,1-搬运模型,0-非搬用模型”) ENGINE=OLAP
PRIMARY KEY(
dt
, id
)COMMENT “用户域标签表”
PARTITION BY RANGE(
dt
)(PARTITION p20231001 VALUES [(“2023-10-01”), (“2023-10-02”)),
PARTITION p20231002 VALUES [(“2023-10-02”), (“2023-10-03”)),
PARTITION p20231003 VALUES [(“2023-10-03”), (“2023-10-04”)),
PARTITION p20231004 VALUES [(“2023-10-04”), (“2023-10-05”)),
PARTITION p20231005 VALUES [(“2023-10-05”), (“2023-10-06”)),
PARTITION p20231006 VALUES [(“2023-10-06”), (“2023-10-07”)),
PARTITION p20231007 VALUES [(“2023-10-07”), (“2023-10-08”)),
PARTITION p20231008 VALUES [(“2023-10-08”), (“2023-10-09”)),
PARTITION p20231009 VALUES [(“2023-10-09”), (“2023-10-10”)),
PARTITION p20231010 VALUES [(“2023-10-10”), (“2023-10-11”)),
PARTITION p20231011 VALUES [(“2023-10-11”), (“2023-10-12”)),
PARTITION p20231012 VALUES [(“2023-10-12”), (“2023-10-13”)),
PARTITION p20231013 VALUES [(“2023-10-13”), (“2023-10-14”)),
PARTITION p20231014 VALUES [(“2023-10-14”), (“2023-10-15”)),
PARTITION p20231015 VALUES [(“2023-10-15”), (“2023-10-16”)),
PARTITION p20231016 VALUES [(“2023-10-16”), (“2023-10-17”)),
PARTITION p20231017 VALUES [(“2023-10-17”), (“2023-10-18”)),
PARTITION p20231018 VALUES [(“2023-10-18”), (“2023-10-19”)),
PARTITION p20231019 VALUES [(“2023-10-19”), (“2023-10-20”)),
PARTITION p20231020 VALUES [(“2023-10-20”), (“2023-10-21”)),
PARTITION p20231021 VALUES [(“2023-10-21”), (“2023-10-22”)),
PARTITION p20231022 VALUES [(“2023-10-22”), (“2023-10-23”)),
PARTITION p20231023 VALUES [(“2023-10-23”), (“2023-10-24”)),
PARTITION p20231024 VALUES [(“2023-10-24”), (“2023-10-25”)),
PARTITION p20231025 VALUES [(“2023-10-25”), (“2023-10-26”)),
PARTITION p20231026 VALUES [(“2023-10-26”), (“2023-10-27”)),
PARTITION p20231027 VALUES [(“2023-10-27”), (“2023-10-28”)))
DISTRIBUTED BY HASH(
id
) BUCKETS 3PROPERTIES (
“replication_num” = “3”,
“dynamic_partition.enable” = “false”,
“dynamic_partition.time_unit” = “DAY”,
“dynamic_partition.time_zone” = “UTC”,
“dynamic_partition.start” = “-30”,
“dynamic_partition.end” = “2”,
“dynamic_partition.prefix” = “p”,
“dynamic_partition.history_partition_num” = “0”,
“datacache.enable” = “true”,
“storage_volume” = “builtin_storage_volume”,
“enable_async_write_back” = “false”,
“enable_persistent_index” = “true”,
“compression” = “LZ4”
);
【业务影响】
【StarRocks版本】
3.1.2
【集群规模】
10.50.50.37:8c16g=>fe+be
10.50.50.38:8c16g=>be
10.50.50.39:8c16g=>be
10.50.180.187:8c16g=>fe
【机器信息】
【联系方式】
社区群5-不惑
【附件】
fe.log报错日志:
be.INFO报错日志:
还有个问题:show tablet查看tablet分布,为什么都集中在1台节点上,表是3副本表?
show tablet from label_model;
而且show backends也看不到tablet数量和数据用量
监控上也没有数据用量