flink-connector-starrocks导入问题

【StarRocks版本】例如:2.2.5
【集群规模】例如:1fe +1be(fe与be混部)
【机器信息】CPU虚拟核/内存/网卡,例如:48C/64G/万兆
【flink版本】1.15.1
【依赖包】

com.starrocks
flink-connector-starrocks
1.2.5_flink-1.15

建表语句:
CREATE TABLE test1 (
id int(11) NOT NULL COMMENT “用户 ID”,
name varchar(65533) NULL COMMENT “用户姓名”
) ENGINE=OLAP
PRIMARY KEY(id)
COMMENT “test表”
DISTRIBUTED BY HASH(id) BUCKETS 4
PROPERTIES (
“replication_num” = “1”,
“in_memory” = “false”,
“storage_format” = “DEFAULT”
);
代码:


报错信息:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: com.starrocks.data.load.stream.exception.StreamLoadFailException: {
“TxnId”: 287295,
“Label”: “f6e814b2-e805-44c9-9eec-ee349462ef66”,
“Status”: “Fail”,
“Message”: “all partitions have no load data”,
“NumberTotalRows”: 0,
“NumberLoadedRows”: 0,
“NumberFilteredRows”: 0,
“NumberUnselectedRows”: 0,
“LoadBytes”: 56,
“LoadTimeMs”: 42,
“BeginTxnTimeMs”: 0,
“StreamLoadPutTimeMs”: 0,
“ReadDataTimeMs”: 0,
“WriteDataTimeMs”: 2,
“CommitAndPublishTimeMs”: 0
}
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) ~[?:1.8.0_362]
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928) ~[?:1.8.0_362]
at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.quiesceTimeServiceAndFinishOperator(StreamOperatorWrapper.java:192) ~[flink-streaming-java-1.15.1.jar:1.15.1]
at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.finish(StreamOperatorWrapper.java:152) ~[flink-streaming-java-1.15.1.jar:1.15.1]
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.finishOperators(RegularOperatorChain.java:115) ~[flink-streaming-java-1.15.1.jar:1.15.1]
at org.apache.flink.streaming.runtime.tasks.StreamTask.endData(StreamTask.java:574) ~[flink-streaming-java-1.15.1.jar:1.15.1]
at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:536) ~[flink-streaming-java-1.15.1.jar:1.15.1]
at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:203) ~[flink-streaming-java-1.15.1.jar:1.15.1]
at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:804) ~[flink-streaming-java-1.15.1.jar:1.15.1]
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:753) ~[flink-streaming-java-1.15.1.jar:1.15.1]
at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948) ~[flink-runtime-1.15.1.jar:1.15.1]
at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) ~[flink-runtime-1.15.1.jar:1.15.1]
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741) ~[flink-runtime-1.15.1.jar:1.15.1]
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563) ~[flink-runtime-1.15.1.jar:1.15.1]

请问一下1.15版本这个是什么问题,1.13版本是正常的

同样的数据源1.13版本没问题?看报错提示应该是分区内没有数据

同样的数据源1.13版本没有问题,表并不是分区表呀

默认sink v2 报错:all partitions have no load data
使用sink v1 实测写入有效
.withProperty(“sink.version”,“V1”)

是版本兼容问题吗?

你好,这块有一个bug,已经修复了https://github.com/StarRocks/starrocks-connector-for-apache-flink/pull/174,原因是connector 1.2.4/1.2.5默认使用http chunk的方式导入,而SR 2.2及之前的版本json不支持http chunk,因此会报错 “all partitions have no load data“