为了更快的定位您的问题,请提供以下信息,谢谢
【详述】创建异步物化视图,运行了一段时间后,刷新停止,并无报错
【背景】一个base表,创建了3个物化试图,其中2个refresh时间为5分钟,一个为2分钟;其中2分钟的异步物化试图在运行几天后会出现刷新暂停的问题
【业务影响】
【是否存算分离】
【StarRocks版本】3.3.3
【集群规模】例如:3fe +15be(fe与be混部)
【机器信息】CPU虚拟核/内存/网卡,例如:40C/64G/万兆
【联系方式】邮箱sa517544@mail.ustc.edu.cn
【附件】
2分钟刷新异步物化试图如下
刷新失效的物化试图,在2025-04-11 15:55:00 停止了
fe.log如下,可以发现2分钟的定时任务还在执行
但从下面的fe日志看,traffic_consume_realtime_ocpc发现对于 d_show_click_realtime 这个base表的分区检测,一直停留在了2025-04-11 15点的分区
2025-04-17 10:04:58.962+08:00 INFO (starrocks-taskrun-pool-79543|333549408) [PartitionBasedMvRefreshProcessor.updateMeta():758] start to update meta for mv: traffic_consume_realtime_ocpc
2025-04-17 10:04:58.962+08:00 INFO (starrocks-taskrun-pool-79543|333549408) [MVVersionManager.updateMetaForOlapTable():84] update meta for mv traffic_consume_realtime_ocpc with olap tables:[TableSnapshotInfo{baseTableInfo=default_catalog.12058.11778639, baseTable=d_show_click_realtime, refreshedPartitionInfos={p2025041115=BasePartitionInfo{id=38615498, version=571, lastRefreshTime=1744383085112}}}], refBaseTableIds:[11778639]
2025-04-17 10:04:58.962+08:00 INFO (starrocks-taskrun-pool-79543|333549408) [MVVersionManager.updateMetaForOlapTable():115] Update materialized view traffic_consume_realtime_ocpc meta for base table d_show_click_realtime with partitions info: {p2025041115=BasePartitionInfo{id=38615498, version=571, lastRefreshTime=1744383085112}}, old partition infos:{p2025041114=BasePartitionInfo{id=38604074, version=391, lastRefreshTime=1744354886941}, p2025041115=BasePartitionInfo{id=38615498, version=571, lastRefreshTime=1744383085112}, p2025041110=BasePartitionInfo{id=38559011, version=539, lastRefreshTime=1744357288296}, p2025041111=BasePartitionInfo{id=38569624, version=511, lastRefreshTime=1744357288296}, p2025041112=BasePartitionInfo{id=38577535, version=451, lastRefreshTime=1744357288296}, p2025041113=BasePartitionInfo{id=38591110, version=421, lastRefreshTime=1744357288296}, p2025041107=BasePartitionInfo{id=38529457, version=603, lastRefreshTime=1744357288296}, p2025041108=BasePartitionInfo{id=38536423, version=583, lastRefreshTime=1744357288296}, p2025041109=BasePartitionInfo{id=38545627, version=565, lastRefreshTime=1744357288296}, p2025041103=BasePartitionInfo{id=38504455, version=630, lastRefreshTime=1744357288296}, p2025041104=BasePartitionInfo{id=38510279, version=631, lastRefreshTime=1744357288296}, p2025041105=BasePartitionInfo{id=38516385, version=630, lastRefreshTime=1744357288296}, p2025041106=BasePartitionInfo{id=38522777, version=621, lastRefreshTime=1744357288296}, p2025041100=BasePartitionInfo{id=38486437, version=633, lastRefreshTime=1744357288296}, p2025041101=BasePartitionInfo{id=38493387, version=634, lastRefreshTime=1744357288296}, p2025041102=BasePartitionInfo{id=38498918, version=634, lastRefreshTime=1744357288296}, p2025041019=BasePartitionInfo{id=38387542, version=481, lastRefreshTime=1744296985599}, p2025041015=BasePartitionInfo{id=38331210, version=631, lastRefreshTime=1744296985599}, p2025041016=BasePartitionInfo{id=38346559, version=571, lastRefreshTime=1744296985599}, p2025041017=BasePartitionInfo{id=38361898, version=541, lastRefreshTime=1744296985599}, p2025041018=BasePartitionInfo{id=38373170, version=511, lastRefreshTime=1744296985599}, p2025041011=BasePartitionInfo{id=38285453, version=776, lastRefreshTime=1744296985599}, p2025041012=BasePartitionInfo{id=38295610, version=732, lastRefreshTime=1744296985599}, p2025041013=BasePartitionInfo{id=38306138, version=703, lastRefreshTime=1744296985599}, p2025041014=BasePartitionInfo{id=38318815, version=661, lastRefreshTime=1744296985599}, p2025041010=BasePartitionInfo{id=38272907, version=807, lastRefreshTime=1744296985599}, p2025041022=BasePartitionInfo{id=38435812, version=391, lastRefreshTime=1744297284880}, p2025041023=BasePartitionInfo{id=38454125, version=391, lastRefreshTime=1744300884387}, p2025041020=BasePartitionInfo{id=38405847, version=451, lastRefreshTime=1744296985599}, p2025041021=BasePartitionInfo{id=38416631, version=391, lastRefreshTime=1744293685426}}
2025-04-17 10:04:58.967+08:00 INFO (starrocks-taskrun-pool-79543|333549408) [MVVersionManager.updateEditLogAfterVersionMetaChanged():251] update edit log after version changed for mv traffic_consume_realtime_ocpc , maxChangedTableRefreshTime:1744383085112
下面是基于相同base表另一个物化试图traffic_consume_realtime_source
可以发现,改试图对于base表d_show_click_realtime的分区检查时没有问题的