Stream load 导入使用ignore_json_size:true" 引起all partitions have no load data异常 ,去掉该配置后可以正常导入
- 1.导入语句
curl -v --location-trusted -u root:123456 -H “strict_mode: true” -H “Expect:100-continue” -H “Connection: close” -H “format: json” -H “strip_outer_array:true” H “ignore_json_size:true”\ -T REPAIR_DETAILS.json -XPUT \http://starrocks1-dev.dcsy.catarc.info:8030/api/tbrat_test/czmk_mg_REPAIR_DETAILS/_stream_load - 2.建表语句
CREATE TABLE czmk_mg_REPAIR_DETAILS
(
_id
varchar(32) NOT NULL COMMENT “”,
authCode
varchar(20) NOT NULL COMMENT “权限编码”,
authName
varchar(255) NULL COMMENT “权限名称”,
authType
varchar(3) NULL COMMENT “权限类型”,
createTime
varchar(50) NULL COMMENT “创建时间”,
destinationUnitCode
varchar(255) NULL COMMENT “目标单位编码”,
destinationUnitName
varchar(255) NULL COMMENT “目标单位名称”,
isNewModel
varchar(3) NULL COMMENT “是否为新模型”,
newCode
varchar(255) NULL COMMENT “新编码”,
oldCode
varchar(255) NULL COMMENT “旧编码”,
replaceDate
varchar(255) NULL COMMENT “更换日期”,
structureType
varchar(255) NULL COMMENT “结构类型”,
type
varchar(3) NULL COMMENT “”,
vin
varchar(50) NULL COMMENT “”,
upList
json NULL COMMENT “”,
downList
json NULL COMMENT “”,
sink_date
datetime NULL DEFAULT CURRENT_TIMESTAMP COMMENT “”
) ENGINE=OLAP
PRIMARY KEY(_id
)
COMMENT “”
DISTRIBUTED BY HASH(_id
) BUCKETS 32
PROPERTIES (
“replication_num” = “1”,
“in_memory” = “false”,
“storage_format” = “DEFAULT”,
“enable_persistent_index” = “false”,
“compression” = “LZ4”
);
- 3.测试数据
REPAIR_DETAILS.json (132.6 KB)
对应be日志
【业务影响】
【是否存算分离】否
【StarRocks版本】2.5.16
【集群规模】例如:3fe+3be(fe与be混部)
【机器信息】CPU虚拟核/内存/网卡,例如:48C/64G/万兆
【表模型】例如:主键模型