flink写入StarRocks I/O异常，帮忙分析下原因

U_1680574046323_1500 · 2023年04月4日 02:20

【详述】flink写入数据I/O异常
【StarRocks版本】2.4.0
[I/O client dispatch - 6ab84355-4d7a-46ea-bd7f-f40e26c631fc] ERROR com.starrocks.data.load.stream.DefaultStreamLoader - Stream load failed unknown, label : d9aadc9c-f5e1-415a-a5f2-781f3bb5fe89
java.lang.NullPointerException
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:257)
at com.starrocks.data.load.stream.DefaultStreamLoader.lambda$send$2(DefaultStreamLoader.java:113)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
[I/O client dispatch - 6ab84355-4d7a-46ea-bd7f-f40e26c631fc] ERROR com.starrocks.data.load.stream.DefaultStreamLoader - Stream load failed, thread : I/O client dispatch - 6ab84355-4d7a-46ea-bd7f-f40e26c631fc
java.lang.NullPointerException
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:257)
at com.starrocks.data.load.stream.DefaultStreamLoader.lambda$send$2(DefaultStreamLoader.java:113)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
[I/O client dispatch - 6ab84355-4d7a-46ea-bd7f-f40e26c631fc] ERROR com.starrocks.data.load.stream.DefaultStreamLoadManager - Stream load failed
java.lang.NullPointerException
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:257)
at com.starrocks.data.load.stream.DefaultStreamLoader.lambda$send$2(DefaultStreamLoader.java:113)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
[StarRocks-Sink-Manager] INFO com.starrocks.data.load.stream.DefaultStreamLoadManager - manager report, current Bytes : 283121655, waitQ : 0, prepareQ : 1, commitQ : 0
[Sink: Unnamed (1/1)] ERROR com.starrocks.data.load.stream.DefaultStreamLoadManager - catch exception, wait rollback
java.lang.NullPointerException
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:257)
at com.starrocks.data.load.stream.DefaultStreamLoader.lambda$send$2(DefaultStreamLoader.java:113)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
[Sink: Unnamed (1/1)] INFO com.starrocks.data.load.stream.DefaultStreamLoadManager - Stream load manger close, current bytes : 283121655, flush rows : 691129, numberTotalRows : 691129, numberLoadRows : 691129
[Sink: Unnamed (1/1)] WARN com.starrocks.data.load.stream.DefaultStreamLoader - Default Stream loader closed
[pool-4-thread-1] INFO com.alibaba.ververica.connectors.datahub.source.DatahubRecordReader - call next() cost time :[0]ms
[Sink: Unnamed (1/1)] INFO com.starrocks.data.load.stream.DefaultStreamLoadManager - Stream load manager flush
[Sink: Unnamed (1/1)] ERROR com.starrocks.data.load.stream.DefaultStreamLoadManager - catch exception, wait rollback
java.lang.NullPointerException
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:257)
at com.starrocks.data.load.stream.DefaultStreamLoader.lambda$send$2(DefaultStreamLoader.java:113)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
[Sink: Unnamed (1/1)] ERROR org.apache.flink.streaming.runtime.tasks.StreamTask - Error during disposal of stream operator.
java.lang.RuntimeException: java.lang.NullPointerException
at com.starrocks.data.load.stream.DefaultStreamLoadManager.AssertNotException(DefaultStreamLoadManager.java:333)
at com.starrocks.data.load.stream.DefaultStreamLoadManager.flush(DefaultStreamLoadManager.java:262)
at com.starrocks.connector.flink.table.StarRocksDynamicSinkFunctionV2.close(StarRocksDynamicSinkFunctionV2.java:176)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.dispose(AbstractUdfStreamOperator.java:117)
at org.apache.flink.streaming.runtime.tasks.StreamTask.disposeAllOperators(StreamTask.java:703)
at org.apache.flink.streaming.runtime.tasks.StreamTask.cleanUpInvoke(StreamTask.java:635)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:542)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:721)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:546)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at com.starrocks.data.load.stream.DefaultStreamLoader.send(DefaultStreamLoader.java:257)
at com.starrocks.data.load.stream.DefaultStreamLoader.lambda$send$2(DefaultStreamLoader.java:113)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
… 1 more

JiangLai · 2023年04月4日 03:12

您好，IO异常的监控截图帮忙看下呢？写入有什么具体的报错吗？

U_1680574046323_1500 · 2023年04月4日 07:26

IO 监控截图

U_1680574046323_1500 · 2023年04月4日 07:27

flink 写入程序直接报这个错误，没有其它具体得报错信息了

llppff · 2023年04月11日 03:31

connector用的什么版本？是稳定复现的吗

llppff · 2023年04月11日 03:31

可以加个微信交流一下吗

U_1680574046323_1500 · 2023年04月4日 09:16

可以的，您微信多少了，我加您把

llppff · 2023年04月11日 03:30

ll_pp_ff

U_1680574046323_1500 · 2023年04月11日 03:32

多谢帮忙解决。
connector 升级为1.2.6解决此问题，pom文件如下

<dependency>
            <groupId>com.starrocks</groupId>
            <artifactId>flink-connector-starrocks</artifactId>
            <version>1.2.6_flink-1.11_2.11</version>
</dependency>

U_1702446232729_8617 · 2023年12月13日 05:44

hi，大佬。想问一下有这个缺陷的修复commit和对应的原因/背景吗