spark connector 读数据时报错： Set cancelled by MemoryScratchSinkOperator

💬 StarRocks 用户问答 常见 FAQ
#42

正在修复，如果急需，可以临时打个Patch

#43

想问下3.1.2中有修复吗？

#44

3.1.2还没有修复，急的话，可以给你打个临时包

#45
1赞
#46

你好，请问这个能给出个3.1版本临时的镜像嘛

#47

3.1的哪个版本？

#48

3.1最新的吧，我看前几天github上出了3.1.3的tag了，缩减了镜像大小，感谢

#49

请问这个修复的包什么时候会打出来- -

#50

你当前用的是哪个版本

#51

现在用的是2.5.8

#52

2.5.13明天或后天就要发了，等下吧

#53

想问下3.1.3包含了这个fix吗？

#54

没有，3.1.4才会修复这个问题

#55

请问3.1.4预计什么时候发布

#56

我们公司有一张超过800GB的表，同步还是报错。

300GB的表是可以正常同步的。

#57

什么版本？可以调下这个: starrocks.exec.mem.limit

#58

3.1.4 已经调整到200GB还是报错。。

#59

BE对应的报错信息发下

#60

你这个表有多少列

#61

这个表13列，17亿行，16个分区32个分桶，860GB

BE报错信息：
W1116 20:57:31.535277 67852 pipeline_driver_poller.cpp:84] [Driver] Timeout, query_id=fba54fb4-b5ca-4ffa-958a-1c5db6756941, instance_id=244fa809-2318-a519-c43f-e8e1616eeb9d
W1116 20:57:31.543238 17598 backend_base.cpp:222] fragment_instance_id [244fa809-2318-a519-c43f-e8e1616eeb9d] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 20:57:31.543579 17598 backend_base.cpp:222] fragment_instance_id [244fa809-2318-a519-c43f-e8e1616eeb9d] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 20:57:31.543730 17598 backend_base.cpp:222] fragment_instance_id [244fa809-2318-a519-c43f-e8e1616eeb9d] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 21:56:00.896315 67852 pipeline_driver_poller.cpp:84] [Driver] Timeout, query_id=071a7e95-16d3-4a0d-9797-82df48805aee, instance_id=434b8db2-9c11-fec9-5244-d0f4be067ab2
W1116 21:56:01.644635 31812 backend_base.cpp:222] fragment_instance_id [434b8db2-9c11-fec9-5244-d0f4be067ab2] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 21:56:01.645083 31812 backend_base.cpp:222] fragment_instance_id [434b8db2-9c11-fec9-5244-d0f4be067ab2] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 21:56:01.645217 31812 backend_base.cpp:222] fragment_instance_id [434b8db2-9c11-fec9-5244-d0f4be067ab2] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 21:57:40.898286 67852 pipeline_driver_poller.cpp:84] [Driver] Timeout, query_id=fba54fb4-b5ca-4ffa-958a-1c5db6756941, instance_id=2442ac3c-2bbc-f52f-aed6-66a8482da680
W1116 21:57:40.900354 32210 backend_base.cpp:222] fragment_instance_id [2442ac3c-2bbc-f52f-aed6-66a8482da680] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 21:57:40.900701 32210 backend_base.cpp:222] fragment_instance_id [2442ac3c-2bbc-f52f-aed6-66a8482da680] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 21:57:40.900821 32210 backend_base.cpp:222] fragment_instance_id [2442ac3c-2bbc-f52f-aed6-66a8482da680] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 23:00:47.450327 67852 pipeline_driver_poller.cpp:84] [Driver] Timeout, query_id=fa565017-92d0-40fa-8cbf-769893affa7a, instance_id=e7453a6f-d5b9-50e4-09d0-1397d78c93bb
W1116 23:00:48.786464 47660 backend_base.cpp:222] fragment_instance_id [e7453a6f-d5b9-50e4-09d0-1397d78c93bb] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 23:00:48.787473 47660 backend_base.cpp:222] fragment_instance_id [e7453a6f-d5b9-50e4-09d0-1397d78c93bb] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1116 23:00:48.787747 47660 backend_base.cpp:222] fragment_instance_id [e7453a6f-d5b9-50e4-09d0-1397d78c93bb] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 00:01:05.212294 67852 pipeline_driver_poller.cpp:84] [Driver] Timeout, query_id=fa565017-92d0-40fa-8cbf-769893affa7a, instance_id=774bb3a1-b42a-16e0-cdb2-8b2729c858a0
W1117 00:01:05.226876 62488 backend_base.cpp:222] fragment_instance_id [774bb3a1-b42a-16e0-cdb2-8b2729c858a0] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 00:01:05.227465 62488 backend_base.cpp:222] fragment_instance_id [774bb3a1-b42a-16e0-cdb2-8b2729c858a0] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 00:01:05.227638 62488 backend_base.cpp:222] fragment_instance_id [774bb3a1-b42a-16e0-cdb2-8b2729c858a0] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 01:01:20.316291 67852 pipeline_driver_poller.cpp:84] [Driver] Timeout, query_id=fa565017-92d0-40fa-8cbf-769893affa7a, instance_id=fb432760-b71c-2747-5ae9-102a9f315da2
W1117 01:01:20.353539 81020 backend_base.cpp:222] fragment_instance_id [fb432760-b71c-2747-5ae9-102a9f315da2] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 01:01:20.353950 81020 backend_base.cpp:222] fragment_instance_id [fb432760-b71c-2747-5ae9-102a9f315da2] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 01:01:20.354086 81020 backend_base.cpp:222] fragment_instance_id [fb432760-b71c-2747-5ae9-102a9f315da2] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 02:01:42.930302 67852 pipeline_driver_poller.cpp:84] [Driver] Timeout, query_id=fa565017-92d0-40fa-8cbf-769893affa7a, instance_id=e143bbf5-4685-a57c-a571-b38dad2390ad
W1117 02:01:42.930775 95835 backend_base.cpp:222] fragment_instance_id [e143bbf5-4685-a57c-a571-b38dad2390ad] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 02:01:42.931143 95835 backend_base.cpp:222] fragment_instance_id [e143bbf5-4685-a57c-a571-b38dad2390ad] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]
W1117 02:01:42.931282 95835 backend_base.cpp:222] fragment_instance_id [e143bbf5-4685-a57c-a571-b38dad2390ad] fetch result status [Cancelled: Set cancelled by MemoryScratchSinkOperator
/build/starrocks/be/src/runtime/result_queue_mgr.cpp:68 queue->status()]

京ICP备2022026421号-1