为了更快的定位您的问题,请提供以下信息,谢谢
【详述】问题详细描述
自动分区表中,云存储导入数据,会报以下异常。
Error: The row create partition failed since Runtime error: failed to analyse partition value:[624001010897169077998210880640093]. Row: [622495675809398055583933545583709, 19, 3, 6, ‘张三’, 190, 2023-09-27, ‘-’, 2023-09-28 09:40:57]
相关执行语句如下:
CREATE TABLE dup_stu_info8
(
_row_id
largeint(40) NOT NULL DEFAULT (uuid_numeric()) COMMENT “唯一标识”,
app_id
int(11) NOT NULL COMMENT “app_id”,
svip_level
smallint(6) NOT NULL COMMENT “svip_level”,
svip_remain
bigint(20) NOT NULL COMMENT “svip_remain”,
name
varchar(120) NOT NULL COMMENT “名称”,
money
double NOT NULL COMMENT “money”,
cdate
date NOT NULL COMMENT “cdate”,
_scod
varchar(12) NULL COMMENT “批次号”,
_timestamp
datetime NOT NULL DEFAULT CURRENT_TIMESTAMP COMMENT “当前时间”
) ENGINE=OLAP
DUPLICATE KEY(_row_id
)
COMMENT “OLAP”
PARTITION BY date_trunc(‘day’, cdate)
DISTRIBUTED BY HASH(_row_id
) BUCKETS 10
PROPERTIES (
“replication_num” = “1”,
“datacache.partition_duration” = “7 days”,
“datacache.enable” = “true”,
“storage_volume” = “builtin_storage_volume”,
“enable_async_write_back” = “false”,
“compression” = “ZLIB”
);
SUBMIT TASK TqxHK208 AS
INSERT INTO dup_stu_info8(app_id,svip_level,svip_remain,name,money,cdate) SELECT * FROM FILES( “path” = “s3://hisdata/data_stuinfo.parquet”, “format” = “parquet”, “aws.s3.endpoint” = “oss.cn-north-3.inspurcloudoss.com”, “aws.s3.access_key” = “NzhjY2YyYWQtMWFkNS00ZDFlLTgwZjEtYzIzZTU0MGM2NmYz”, “aws.s3.secret_key” = “#####”, “aws.s3.region” = “cn-north-3”);
如果不采用不分区或其它分区,导入不会出现异常。
还有一个特殊情况,就是在自动分区表中第一行后面增加一个字段,也不会报错。
如:
CREATE TABLE dup_stu_info7
(
_row_id
largeint(40) NOT NULL DEFAULT (uuid_numeric()) COMMENT “唯一标识”,
_scod
varchar(12) NULL COMMENT “批次号”,
app_id
int(11) NOT NULL COMMENT “app_id”,
svip_level
smallint(6) NOT NULL COMMENT “svip_level”,
svip_remain
bigint(20) NOT NULL COMMENT “svip_remain”,
name
varchar(120) NOT NULL COMMENT “名称”,
money
double NOT NULL COMMENT “money”,
cdate
date NOT NULL COMMENT “cdate”,
_timestamp
datetime NOT NULL DEFAULT CURRENT_TIMESTAMP COMMENT “当前时间”
) ENGINE=OLAP
DUPLICATE KEY(_row_id
)
COMMENT “OLAP”
PARTITION BY date_trunc(‘day’, cdate)
DISTRIBUTED BY HASH(_row_id
) BUCKETS 10
PROPERTIES (
“replication_num” = “1”,
“datacache.partition_duration” = “7 days”,
“datacache.enable” = “true”,
“storage_volume” = “builtin_storage_volume”,
“enable_async_write_back” = “false”,
“compression” = “ZLIB”
);
SUBMIT TASK TqxHK207 AS
INSERT INTO dup_stu_info7(app_id,svip_level,svip_remain,name,money,cdate) SELECT * FROM FILES( “path” = “s3://hisdata/data_stuinfo.parquet”, “format” = “parquet”, “aws.s3.endpoint” = “oss.cn-north-3.inspurcloudoss.com”, “aws.s3.access_key” = “NzhjY2YyYWQtMWFkNS00ZDFlLTgwZjEtYzIzZTU0MGM2NmYz”, “aws.s3.secret_key” = “###”, “aws.s3.region” = “cn-north-3”);
会导入成功。