flink 同步报错

💬 StarRocks 用户问答 数据导入与导出
#1

使用flink 同步mysql 数据到 starrocks，
starrocks的建表
CREATE TABLE scoreinfo (
cid INT,
sid INT,
name STRING,
cls STRING,
score INT,
PRIMARY KEY (cid) NOT ENFORCED
) WITH (
‘connector’ = ‘doris’,
‘fenodes’ = ‘10.1.50.11:9030’ ,
‘table.identifier’ = ‘test.scoreinfo’,
‘username’ = ‘root’,
‘password’=’’
);

报
2022-05-31 14:17:33,049 WARN org.apache.doris.flink.table.DorisDynamicOutputFormat [] - Connect to doris http://10.1.50.11:9030/rest/v1/system?path=//backends failed.
java.io.IOException: Failed to get response from Doris
at org.apache.doris.flink.rest.RestService.parseResponse(RestService.java:186) ~[doris-flink-1.0-SNAPSHOT.jar:?]
at org.apache.doris.flink.rest.RestService.getConnectionGet(RestService.java:179) ~[doris-flink-1.0-SNAPSHOT.jar:?]
at org.apache.doris.flink.rest.RestService.send(RestService.java:121) ~[doris-flink-1.0-SNAPSHOT.jar:?]
at org.apache.doris.flink.rest.RestService.getBackends(RestService.java:278) ~[doris-flink-1.0-SNAPSHOT.jar:?]
at org.apache.doris.flink.rest.RestService.randomBackend(RestService.java:253) ~[doris-flink-1.0-SNAPSHOT.jar:?]
at org.apache.doris.flink.table.DorisDynamicOutputFormat.getBackend(DorisDynamicOutputFormat.java:192) ~[doris-flink-1.0-SNAPSHOT.jar:?]
at org.apache.doris.flink.table.DorisDynamicOutputFormat.open(DorisDynamicOutputFormat.java:87) ~[doris-flink-1.0-SNAPSHOT.jar:?]
at org.apache.flink.streaming.api.functions.sink.OutputFormatSinkFunction.open(OutputFormatSinkFunction.java:65) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:34) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:102) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.table.runtime.operators.sink.SinkOperator.open(SinkOperator.java:58) ~[flink-table-blink_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.streaming.runtime.tasks.OperatorChain.initializeStateAndOpenOperators(OperatorChain.java:442) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:585) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.streaming.runtime.tasks.StreamTask.executeRestore(StreamTask.java:565) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:650) [flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:540) [flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:759) [flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) [flink-dist_2.12-1.13.6.jar:1.13.6]

#2

http://10.1.50.11:8030/backend，这个是能访问的

#3

StarRocks-2.2.0 这个版本

#4

用的什么工具，flink同步mysql数据到SR请参考这篇https://docs.starrocks.com/zh-cn/main/loading/Flink-connector-starrocks 建议使用官方提供的数据和工具

#5

就是用的flink

#6

[INFO] Submitting SQL update statement to the cluster…
Loading class com.mysql.jdbc.Driver'. This is deprecated. The new driver class is com.mysql.cj.jdbc.Driver’. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
[ERROR] Could not execute SQL statement. Reason:
java.lang.IllegalArgumentException: Couldn’t get the sink table’s column info.

Shutting down the session…
done.

#7

用官方的工具报这个错

京ICP备2022026421号-1