【详述】starrocks从1.19升级到2.1后,设置了json_root的routine load出错
Error: Data quality error: Failed to filter row with jsonroot. code=16, error=The JSON element does not have the requested type.
/root/starrocks/be/src/exec/vectorized/json_scanner.cpp:489 _filter_row_with_jsonroot(row). Row: {“authCode”:“2021TENANT_1771122144440v4M3UBY1”,“orderId”:“16600771”,“shareDiscount”:0,“saleListNo”:“124396”,“casherCode”:“9991”,“pay”:[{“authCode”:“2021TENANT_1771122144440v4M3UBY1”,“orderId”:“16600771”,“saleListNo”:“124396”,“casherCode”:“9991”,“cardNo”:"1201210320220330141945 ",“payValue”:“2.90000000”,“businessDate”:“2022-03-30 00:00:00 000”,“payType”:“R”,“dailyDate”:“2022-03-30 00:00:00 000”,“posCode”:“2103”,“time”:“141931 “,“storeCode”:“1201”,“timestamp”:1648621801}],“topName”:“ireportOrder”,“channelcode”:“myshop”,“goodsDiscount”:0.0,“salesAmt”:2.9,“businessDate”:“2022-03-30 14:19:31 000”,“couponDiscount”:0,“dailyDate”:“2022-03-30 00:00:00 000”,“posCode”:“2103”,“billno”:“120116600771”,“memberId”:””,“orderdetail”:[{“amount”:2.9,“authCode”:“2021TENANT_1771122144440v4M3UBY1”,“shareDiscount”:0,“orderId”:“16600771”,“itemCode”:“2077”,“saleListNo”:“124396”,“barCode”:"6921294305012 ",“goodsDiscount”:0.0,“couponDiscount”:0,“businessDate”:“2022-03-30 14:19:31 000”,“price”:2.9,“qty”:1.0,“dailyDate”:“2022-03-30 00:00:00 000”,“normalPrice”:2.9,“posCode”:“2103”,“storeCode”:“1201”,“timestamp”:1648621801}],“storeCode”:“1201”,“timestamp”:1648621801}
routine load:
CREATE ROUTINE LOAD load_order_pay ON order_pay
PROPERTIES
(
“desired_concurrent_number”=“3”,
“max_batch_interval” = “20”,
“strict_mode” = “false”,
“format” = “json”,
“json_root”="$.pay",
“strip_outer_array” = “true”
)
FROM KAFKA
(
“kafka_broker_list” = “******:9092”,
“kafka_topic” = “ireportOrder”,
“property.group.id” = “group_load_order_pay”,
“kafka_partitions” = “0”,
“kafka_offsets” = “OFFSET_BEGINNING”
);
【背景】starrocks升级
【业务影响】无法导入数据
【StarRocks版本】2.1.3
【集群规模】
【机器信息】
【附件】