【详述】Flink-connector读取sr数据报错, 不清楚原因是什么
2022-12-26 10:42:24,801 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: Custom Source -> Map (32/32) (957ed2aa776795ff767c3c93f473d1cd) switched from RUNNING to FAILED on container_e30_1662455985151_5017_01_000007 @ bigdata-online-prod-34.chj.cloud (dataPort=27907).
java.lang.RuntimeException: Failed to get next from be -> ip:[172.21.33.53] CANCELLED msg:[canceled state]
at com.starrocks.connector.flink.table.source.StarRocksSourceBeReader.startToRead(StarRocksSourceBeReader.java:147) ~[ilad_rengine-1.0.0-starRocks15min.jar:?]
at com.starrocks.connector.flink.table.source.StarRocksSourceBeReader.getNext(StarRocksSourceBeReader.java:173) ~[ilad_rengine-1.0.0-starRocks15min.jar:?]
at com.starrocks.connector.flink.table.source.StarRocksDynamicSourceFunction.lambda$run$1(StarRocksDynamicSourceFunction.java:158) ~[ilad_rengine-1.0.0-starRocks15min.jar:?]
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) ~[?:1.8.0_162]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) ~[?:1.8.0_162]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_162]
at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:291) ~[?:1.8.0_162]
at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731) ~[?:1.8.0_162]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) ~[?:1.8.0_162]
at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401) ~[?:1.8.0_162]
at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734) ~[?:1.8.0_162]
at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:160) ~[?:1.8.0_162]
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:174) ~[?:1.8.0_162]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233) ~[?:1.8.0_162]
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) ~[?:1.8.0_162]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:583) ~[?:1.8.0_162]
at com.starrocks.connector.flink.table.source.StarRocksDynamicSourceFunction.run(StarRocksDynamicSourceFunction.java:156) ~[ilad_rengine-1.0.0-starRocks15min.jar:?]
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110) ~[flink-dist_2.11-1.14.3.jar:1.14.3]
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:67) ~[flink-dist_2.11-1.14.3.jar:1.14.3]
at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:323) ~[flink-dist_2.11-1.14.3.jar:1.14.3]
【背景】做过哪些操作?
【业务影响】
【StarRocks版本】例如:2.4.0
【集群规模】例如:3fe(1 follower+2observer)+3be(fe与be混部)
【机器信息】
【附件】
be 172.21.33.53 warn日志
W1226 10:32:12.158354 84998 fragment_mgr.cpp:182] Fail to open fragment b843775e-183f-1abb-8dd1-1500f2662db8: Cancelled: canceled state
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:328 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:216 _get_next_internal_vectorized(&chunk)
E1226 10:42:23.834690 84924 olap_scan_node.cpp:267] [TUniqueId(hi=5233543580642462982, lo=-7401493544392045322)] Cancelled: canceled state
E1226 10:42:23.958492 84903 olap_scan_node.cpp:267] [TUniqueId(hi=5233543580642462982, lo=-7401493544392045322)] Cancelled: canceled state
W1226 10:42:24.388871 84987 fragment_mgr.cpp:182] Fail to open fragment 1541f653-74b7-3a2d-1065-0b1156b8a486: Cancelled: canceled state
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:328 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:216 _get_next_internal_vectorized(&chunk)
W1226 10:42:24.397516 84978 fragment_mgr.cpp:182] Fail to open fragment ee43ae44-e95c-231e-aca2-a911f4fde68d: Cancelled: canceled state
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:328 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:216 _get_next_internal_vectorized(&chunk)
W1226 10:42:24.786478 154263 backend_base.cpp:200] fragment_instance_id [ee43ae44-e95c-231e-aca2-a911f4fde68d] fetch result status [Cancelled: canceled state
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:328 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:216 _get_next_internal_vectorized(&chunk)
/root/starrocks/be/src/runtime/result_queue_mgr.cpp:56 queue->status()]
E1226 10:42:24.811822 84908 olap_scan_node.cpp:267] [TUniqueId(hi=5233543580642462982, lo=-7401493544392045322)] Cancelled: canceled state
W1226 10:42:24.815052 85002 fragment_mgr.cpp:182] Fail to open fragment d4418c6e-7b28-7ef4-7104-3812ae0388b4: Cancelled: canceled state
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:328 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:216 _get_next_internal_vectorized(&chunk)
E1226 10:42:24.815712 84915 olap_scan_node.cpp:267] [TUniqueId(hi=5233543580642462982, lo=-7401493544392045322)] Cancelled: canceled state
W1226 10:42:24.818475 84985 fragment_mgr.cpp:182] Fail to open fragment 8e4ad6d6-5765-8a1c-7796-c545f13f95bf: Cancelled: canceled state
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:328 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:216 _get_next_internal_vectorized(&chunk)
E1226 10:42:24.824208 84896 olap_scan_node.cpp:267] [TUniqueId(hi=5233543580642462982, lo=-7401493544392045322)] Cancelled: canceled state
W1226 10:42:24.827116 84975 fragment_mgr.cpp:182] Fail to open fragment 864cc46c-2d4d-cba3-ea74-cb15a1cb0181: Cancelled: canceled state
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:328 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:216 _get_next_internal_vectorized(&chunk)