为了更快的定位您的问题,请提供以下信息,谢谢
【详述】
Starrocks 升级扩容后,所有的视图都不再自动更新,手动刷新是可以更新数据的。
【背景】
1)对Starrocks升级,由之前的 3.2.3 至 3.3.1。
2)新增CN节点,由之前的 1 个增加至 3 个。
【业务影响】
所有的视图都不再自动更新数据,影响视图相关的数据查询。
【是否存算分离】
是
【StarRocks版本】
3.3.1
【集群规模】
1fe + 3cn
【日志信息】
所有的 task 信息,都停留在升级之前的
- fe.log/beINFO
2024-08-01 10:07:43.082+08:00 INFO (pool-23-thread-1|126) [TaskRunManager.checkRunningTaskRun():224] Task run is done from state RUNNING to FAILED, TaskRun{taskId=1739334, type=PERIODICAL, uuid=d48cda8a-4faa-11ef-b7ad-9606ba57320e, task_state=FAILED, properties={datacache.enable=true, replicated_storage=true, mvId=1739329, enable_async_write_back=false, replication_num=3, compression=LZ4, warehouse=default_warehouse, in_memory=false}, extra_message ={“forceRefresh”:false,“mvPartitionsToRefresh”:[“ads_alert_message_dept_view”],“refBasePartitionsToRefreshMap”:{},“basePartitionsToRefreshMap”:{},“processStartTime”:1722478061082,“executeOption”:{“priority”:0,“taskRunProperties”:{“datacache.enable”:“true”,“mvId”:“1739329”,“enable_async_write_back”:“false”,“replication_num”:“3”,“in_memory”:“false”},“isMergeRedundant”:true,“isManual”:false,“isSync”:false,“isReplay”:false}}}
2024-08-01 10:07:45.639+08:00 INFO (TaskCleaner|87) [TaskManager.dropTasks():387] drop tasks:[]
2024-08-01 10:07:45.640+08:00 INFO (TaskCleaner|87) [DatabaseTransactionMgr.beginTransaction():184] begin transaction: txn_id: 987664 with label insert_d7dceff0-4faa-11ef-b7ad-9606ba57320e from coordinator FE: devops-starrocks-fe-0.devops-starrocks-fe-search.starrocks.svc.cluster.local, listner id: -1
2024-08-01 10:07:45.647+08:00 INFO (TaskCleaner|87) [QeProcessorImpl.registerQuery():108] register query id = d7dceff0-4faa-11ef-b7ad-9606ba57320e
2024-08-01 10:07:45.647+08:00 INFO (TaskCleaner|87) [DefaultCoordinator.prepareProfile():553] dispatch load job: d7dceff0-4faa-11ef-b7ad-9606ba57320e to [2974338]
2024-08-01 10:07:45.731+08:00 INFO (TaskCleaner|87) [DatabaseTransactionMgr.abortTransaction():550] transaction:[TransactionState. txn_id: 987664, label: insert_d7dceff0-4faa-11ef-b7ad-9606ba57320e, db id: 10004, table id list: 2974037, callback id: -1, coordinator: FE: devops-starrocks-fe-0.devops-starrocks-fe-search.starrocks.svc.cluster.local, transaction status: ABORTED, error replicas num: 0, replica ids: , prepare time: 1722478065640, write end time: -1, allow commit time: -1, commit time: -1, finish time: 1722478065726, total cost: 86ms, reason: filter data in strict mode, tracking sql = select tracking_log from information_schema.load_tracking_logs where job_id=2988704] successfully rollback
2024-08-01 10:07:45.732+08:00 INFO (TaskCleaner|87) [QueryRuntimeProfile.finishAllInstances():239] unfinished instances: []
2024-08-01 10:07:45.732+08:00 INFO (TaskCleaner|87) [QeProcessorImpl.unregisterQuery():149] deregister query id = d7dceff0-4faa-11ef-b7ad-9606ba57320e
2024-08-01 10:07:45.742+08:00 INFO (TaskCleaner|87) [TaskRunHistory.archiveHistory():181] archive task-run history, 1 records took 102ms
2024-08-01 10:07:48.105+08:00 INFO (autovacuum-pool1-t16276|16884) [AutovacuumDaemon.vacuumPartitionImpl():208] Vacuumed otel_dw.ads_billing_amount_1m.1474428 hasError=false vacuumedFiles=26 vacuumedFileSize=0 visibleVersion=556 minRetainVersion=556 minActiveTxnId=986395 cost=126ms
2024-08-01 10:07:50.034+08:00 INFO (autovacuum-pool1-t16277|16885) [AutovacuumDaemon.vacuumPartitionImpl():208] Vacuumed otel_dw.ads_billing_amount_daily.2629287 hasError=false vacuumedFiles=28 vacuumedFileSize=160780 visibleVersion=143 minRetainVersion=143 minActiveTxnId=986395 cost=52ms
2024-08-01 10:07:53.652+08:00 INFO (colocate group clone checker|123) [ColocateTableBalancer.matchGroups():932] finished to match colocate group. cost: 0 ms, in lock time: 0 ms
2024-08-01 10:07:53.873+08:00 INFO (leaderCheckpointer|115) [BDBJEJournal.getFinalizedJournalId():272] database names: 11797792
2024-08-01 10:07:53.873+08:00 INFO (leaderCheckpointer|115) [Checkpoint.runAfterCatalogReady():101] checkpoint imageVersion 11797791, logVersion 0
2024-08-01 10:07:57.189+08:00 INFO (TableKeeper|88) [TableKeeper.correctTable():111] not enough backends in the cluster, expected 3 but got 0
2024-08-01 10:07:57.229+08:00 INFO (autovacuum-pool1-t16271|16879) [AutovacuumDaemon.vacuumPartitionImpl():208] Vacuumed otel_dw.ads_app_http_qps_1s.2871013 hasError=false vacuumedFiles=4150 vacuumedFileSize=21698 visibleVersion=1017 minRetainVersion=1017 minActiveTxnId=986395 cost=1240ms
2024-08-01 10:07:57.748+08:00 INFO (nioEventLoopGroup-7-6|230) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0
2024-08-01 10:07:57.748+08:00 INFO (nioEventLoopGroup-7-7|231) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3
2024-08-01 10:07:57.748+08:00 WARN (nioEventLoopGroup-7-6|230) [NodeSelector.seqChooseBackendIds():112] failed to find any backend, needAvailable=true
2024-08-01 10:07:57.748+08:00 WARN (nioEventLoopGroup-7-7|231) [NodeSelector.seqChooseBackendIds():112] failed to find any backend, needAvailable=true
2024-08-01 10:07:57.748+08:00 INFO (nioEventLoopGroup-7-6|230) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-0.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_http_qps_1s, op: TXN_BEGIN, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0
2024-08-01 10:07:57.748+08:00 INFO (nioEventLoopGroup-7-7|231) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-1.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_http_error, op: TXN_BEGIN, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3
2024-08-01 10:07:57.752+08:00 INFO (thrift-server-pool-91754|135611) [FrontendServiceImpl.loadTxnBegin():1232] receive txn begin request, db: otel_dw, tbl: ads_app_http_error, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3, backend: 10.88.16.80
2024-08-01 10:07:57.752+08:00 INFO (thrift-server-pool-91754|135611) [DatabaseTransactionMgr.beginTransaction():184] begin transaction: txn_id: 987665 with label flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3 from coordinator BE: 10.88.16.80, listner id: -1
2024-08-01 10:07:57.754+08:00 INFO (nioEventLoopGroup-7-1|221) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3
2024-08-01 10:07:57.754+08:00 INFO (nioEventLoopGroup-7-1|221) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-1.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_http_error, op: TXN_LOAD, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3
2024-08-01 10:07:57.757+08:00 INFO (thrift-server-pool-91755|135612) [FrontendServiceImpl.streamLoadPut():1688] receive stream load put request. db:otel_dw, tbl: ads_app_http_error, txn_id: 987665, load id: 6a452c6c-6588-78c6-6018-4499b73dc5a1, backend: 10.88.16.80
2024-08-01 10:07:57.759+08:00 INFO (thrift-server-pool-91755|135612) [StreamLoadPlanner.plan():301] load job id: 6a452c6c-6588-78c6-6018-4499b73dc5a1, txn id: 987665, parallel: 0, compress: NO_COMPRESSION, replicated: true, quorum: MAJORITY
2024-08-01 10:07:57.767+08:00 INFO (nioEventLoopGroup-7-3|224) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3
2024-08-01 10:07:57.768+08:00 INFO (nioEventLoopGroup-7-3|224) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-1.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_http_error, op: TXN_PREPARE, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3
2024-08-01 10:07:57.772+08:00 INFO (thrift-server-pool-91764|135622) [FrontendServiceImpl.loadTxnBegin():1232] receive txn begin request, db: otel_dw, tbl: ads_app_http_qps_1s, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0, backend: 10.88.1.185
2024-08-01 10:07:57.772+08:00 INFO (thrift-server-pool-91764|135622) [DatabaseTransactionMgr.beginTransaction():184] begin transaction: txn_id: 987666 with label flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0 from coordinator BE: 10.88.1.185, listner id: -1
2024-08-01 10:07:57.775+08:00 INFO (nioEventLoopGroup-7-5|229) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0
2024-08-01 10:07:57.775+08:00 INFO (nioEventLoopGroup-7-5|229) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-0.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_http_qps_1s, op: TXN_LOAD, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0
2024-08-01 10:07:57.791+08:00 INFO (thrift-server-pool-91760|135618) [FrontendServiceImpl.streamLoadPut():1688] receive stream load put request. db:otel_dw, tbl: ads_app_http_qps_1s, txn_id: 987666, load id: ca4fea65-e0e8-5f2a-19de-5148947e23a9, backend: 10.88.1.185
2024-08-01 10:07:57.793+08:00 INFO (thrift-server-pool-91760|135618) [StreamLoadPlanner.plan():301] load job id: ca4fea65-e0e8-5f2a-19de-5148947e23a9, txn id: 987666, parallel: 0, compress: NO_COMPRESSION, replicated: true, quorum: MAJORITY
2024-08-01 10:07:57.887+08:00 INFO (star mgr LeaderCheckpointer|100) [BDBJEJournal.getFinalizedJournalId():272] database names: 2046436
2024-08-01 10:07:57.887+08:00 INFO (star mgr LeaderCheckpointer|100) [Checkpoint.runAfterCatalogReady():101] checkpoint imageVersion 2046435, logVersion 0
2024-08-01 10:07:57.974+08:00 INFO (nioEventLoopGroup-7-8|232) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7
2024-08-01 10:07:57.974+08:00 WARN (nioEventLoopGroup-7-8|232) [NodeSelector.seqChooseBackendIds():112] failed to find any backend, needAvailable=true
2024-08-01 10:07:57.974+08:00 INFO (nioEventLoopGroup-7-8|232) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-2.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_dubbo_qps_1s, op: TXN_BEGIN, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7
2024-08-01 10:07:57.975+08:00 INFO (nioEventLoopGroup-7-1|221) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a
2024-08-01 10:07:57.975+08:00 WARN (nioEventLoopGroup-7-1|221) [NodeSelector.seqChooseBackendIds():112] failed to find any backend, needAvailable=true
2024-08-01 10:07:57.975+08:00 INFO (nioEventLoopGroup-7-1|221) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-0.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_dubbo_error, op: TXN_BEGIN, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a
2024-08-01 10:07:57.976+08:00 INFO (thrift-server-pool-91744|135600) [FrontendServiceImpl.loadTxnBegin():1232] receive txn begin request, db: otel_dw, tbl: ads_app_dubbo_error, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a, backend: 10.88.1.185
2024-08-01 10:07:57.976+08:00 INFO (thrift-server-pool-91744|135600) [DatabaseTransactionMgr.beginTransaction():184] begin transaction: txn_id: 987667 with label flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a from coordinator BE: 10.88.1.185, listner id: -1
2024-08-01 10:07:57.978+08:00 INFO (thrift-server-pool-91727|135581) [FrontendServiceImpl.loadTxnBegin():1232] receive txn begin request, db: otel_dw, tbl: ads_app_dubbo_qps_1s, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7, backend: 10.88.16.92
2024-08-01 10:07:57.979+08:00 INFO (thrift-server-pool-91727|135581) [DatabaseTransactionMgr.beginTransaction():184] begin transaction: txn_id: 987668 with label flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7 from coordinator BE: 10.88.16.92, listner id: -1
2024-08-01 10:07:57.981+08:00 INFO (nioEventLoopGroup-7-3|224) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7
2024-08-01 10:07:57.981+08:00 INFO (nioEventLoopGroup-7-3|224) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-2.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_dubbo_qps_1s, op: TXN_LOAD, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7
2024-08-01 10:07:57.993+08:00 INFO (nioEventLoopGroup-7-5|229) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a
2024-08-01 10:07:57.993+08:00 INFO (nioEventLoopGroup-7-5|229) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-0.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_dubbo_error, op: TXN_LOAD, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a
2024-08-01 10:07:57.995+08:00 INFO (thrift-server-pool-91761|135619) [FrontendServiceImpl.streamLoadPut():1688] receive stream load put request. db:otel_dw, tbl: ads_app_dubbo_error, txn_id: 987667, load id: 004867c7-29e7-23d0-6301-5a232aa07caf, backend: 10.88.1.185
2024-08-01 10:07:57.996+08:00 INFO (thrift-server-pool-91761|135619) [StreamLoadPlanner.plan():301] load job id: 004867c7-29e7-23d0-6301-5a232aa07caf, txn id: 987667, parallel: 0, compress: NO_COMPRESSION, replicated: true, quorum: MAJORITY
2024-08-01 10:07:58.009+08:00 INFO (nioEventLoopGroup-7-7|231) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a
2024-08-01 10:07:58.009+08:00 INFO (nioEventLoopGroup-7-7|231) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-0.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_dubbo_error, op: TXN_PREPARE, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a
2024-08-01 10:07:58.018+08:00 INFO (thrift-server-pool-91742|135598) [FrontendServiceImpl.streamLoadPut():1688] receive stream load put request. db:otel_dw, tbl: ads_app_dubbo_qps_1s, txn_id: 987668, load id: 604f69c3-0d27-23a9-675b-340a643d4294, backend: 10.88.16.92
2024-08-01 10:07:58.020+08:00 INFO (thrift-server-pool-91742|135598) [StreamLoadPlanner.plan():301] load job id: 604f69c3-0d27-23a9-675b-340a643d4294, txn id: 987668, parallel: 0, compress: NO_COMPRESSION, replicated: true, quorum: MAJORITY
2024-08-01 10:07:58.024+08:00 INFO (thrift-server-pool-91741|135597) [FrontendServiceImpl.loadTxnPrepare():1532] receive txn prepare request. db: otel_dw, tbl: ads_app_http_error, txn_id: 987665, backend: 10.88.16.80
2024-08-01 10:07:58.029+08:00 INFO (thrift-server-pool-91741|135597) [DatabaseTransactionMgr.prepareTransaction():366] transaction:[TransactionState. txn_id: 987665, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3, db id: 10421, table id list: 2889386, callback id: -1, coordinator: BE: 10.88.16.80, transaction status: PREPARED, error replicas num: 0, replica ids: , prepare time: 1722478077752, write end time: 1722478078024, allow commit time: -1, commit time: -1, finish time: -1, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@1011a020 tabletCommitInfos size: 10] successfully prepare
2024-08-01 10:07:58.032+08:00 INFO (nioEventLoopGroup-7-1|221) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3
2024-08-01 10:07:58.037+08:00 INFO (nioEventLoopGroup-7-1|221) [DatabaseTransactionMgr.commitPreparedTransaction():466] transaction:[TransactionState. txn_id: 987665, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3, db id: 10421, table id list: 2889386, callback id: -1, coordinator: BE: 10.88.16.80, transaction status: COMMITTED, error replicas num: 0, replica ids: , prepare time: 1722478077752, write end time: 1722478078024, allow commit time: -1, commit time: 1722478078033, finish time: -1, write cost: 281ms, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@1011a020 tabletCommitInfos size: 10] successfully committed
2024-08-01 10:07:58.202+08:00 INFO (thrift-server-pool-91763|135621) [FrontendServiceImpl.loadTxnPrepare():1532] receive txn prepare request. db: otel_dw, tbl: ads_app_dubbo_error, txn_id: 987667, backend: 10.88.1.185
2024-08-01 10:07:58.227+08:00 INFO (lake-publish-task-22831|135626) [LoadJobMVListener.triggerToRefreshRelatedMVs():93] Skip to trigger refresh related materialized views in publish version phase because base table ads_app_http_error is a materialized view.
2024-08-01 10:07:58.228+08:00 INFO (lake-publish-task-22831|135626) [DatabaseTransactionMgr.finishTransaction():1183] finish transaction TransactionState. txn_id: 987665, label: flink-fe49628e-9944-41c5-9f9c-a8c0fa3070e3, db id: 10421, table id list: 2889386, callback id: -1, coordinator: BE: 10.88.16.80, transaction status: VISIBLE, error replicas num: 0, replica ids: , prepare time: 1722478077752, write end time: 1722478078024, allow commit time: -1, commit time: 1722478078033, finish time: 1722478078194, write cost: 281ms, publish total cost: 161ms, total cost: 442ms, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@1011a020 tabletCommitInfos size: 10 successfully
2024-08-01 10:07:58.231+08:00 INFO (nioEventLoopGroup-7-3|224) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0
2024-08-01 10:07:58.231+08:00 INFO (nioEventLoopGroup-7-3|224) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-0.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_http_qps_1s, op: TXN_PREPARE, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0
2024-08-01 10:07:58.232+08:00 INFO (thrift-server-pool-91763|135621) [DatabaseTransactionMgr.prepareTransaction():366] transaction:[TransactionState. txn_id: 987667, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a, db id: 10421, table id list: 2889656, callback id: -1, coordinator: BE: 10.88.1.185, transaction status: PREPARED, error replicas num: 0, replica ids: , prepare time: 1722478077976, write end time: 1722478078202, allow commit time: -1, commit time: -1, finish time: -1, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@7057215c tabletCommitInfos size: 10] successfully prepare
2024-08-01 10:07:58.293+08:00 INFO (nioEventLoopGroup-7-5|229) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a
2024-08-01 10:07:58.298+08:00 INFO (nioEventLoopGroup-7-5|229) [DatabaseTransactionMgr.commitPreparedTransaction():466] transaction:[TransactionState. txn_id: 987667, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a, db id: 10421, table id list: 2889656, callback id: -1, coordinator: BE: 10.88.1.185, transaction status: COMMITTED, error replicas num: 0, replica ids: , prepare time: 1722478077976, write end time: 1722478078202, allow commit time: -1, commit time: 1722478078293, finish time: -1, write cost: 317ms, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@7057215c tabletCommitInfos size: 10] successfully committed
2024-08-01 10:07:58.416+08:00 INFO (lake-publish-task-22832|135627) [LoadJobMVListener.triggerToRefreshRelatedMVs():93] Skip to trigger refresh related materialized views in publish version phase because base table ads_app_dubbo_error is a materialized view.
2024-08-01 10:07:58.416+08:00 INFO (lake-publish-task-22832|135627) [DatabaseTransactionMgr.finishTransaction():1183] finish transaction TransactionState. txn_id: 987667, label: flink-6e55ce15-e417-4024-a640-1a0aea2a7f1a, db id: 10421, table id list: 2889656, callback id: -1, coordinator: BE: 10.88.1.185, transaction status: VISIBLE, error replicas num: 0, replica ids: , prepare time: 1722478077976, write end time: 1722478078202, allow commit time: -1, commit time: 1722478078293, finish time: 1722478078411, write cost: 317ms, publish total cost: 118ms, total cost: 435ms, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@7057215c tabletCommitInfos size: 10 successfully
2024-08-01 10:07:58.548+08:00 INFO (nioEventLoopGroup-7-7|231) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7
2024-08-01 10:07:58.548+08:00 INFO (nioEventLoopGroup-7-7|231) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-2.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_app_dubbo_qps_1s, op: TXN_PREPARE, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7
2024-08-01 10:08:00.008+08:00 INFO (autovacuum-pool1-t16275|16883) [AutovacuumDaemon.vacuumPartitionImpl():208] Vacuumed otel_dw.ads_slow_sql_1d.1406151 hasError=false vacuumedFiles=1 vacuumedFileSize=0 visibleVersion=3046 minRetainVersion=3046 minActiveTxnId=986395 cost=13ms
2024-08-01 10:08:00.111+08:00 INFO (thrift-server-pool-91761|135619) [FrontendServiceImpl.loadTxnPrepare():1532] receive txn prepare request. db: otel_dw, tbl: ads_app_http_qps_1s, txn_id: 987666, backend: 10.88.1.185
2024-08-01 10:08:00.116+08:00 INFO (thrift-server-pool-91761|135619) [DatabaseTransactionMgr.prepareTransaction():366] transaction:[TransactionState. txn_id: 987666, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0, db id: 10421, table id list: 2871015, callback id: -1, coordinator: BE: 10.88.1.185, transaction status: PREPARED, error replicas num: 0, replica ids: , prepare time: 1722478077772, write end time: 1722478080111, allow commit time: -1, commit time: -1, finish time: -1, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@6d4a9e65 tabletCommitInfos size: 10] successfully prepare
2024-08-01 10:08:00.120+08:00 INFO (nioEventLoopGroup-7-2|222) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0
2024-08-01 10:08:00.125+08:00 INFO (nioEventLoopGroup-7-2|222) [DatabaseTransactionMgr.commitPreparedTransaction():466] transaction:[TransactionState. txn_id: 987666, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0, db id: 10421, table id list: 2871015, callback id: -1, coordinator: BE: 10.88.1.185, transaction status: COMMITTED, error replicas num: 0, replica ids: , prepare time: 1722478077772, write end time: 1722478080111, allow commit time: -1, commit time: 1722478080120, finish time: -1, write cost: 2348ms, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@6d4a9e65 tabletCommitInfos size: 10] successfully committed
2024-08-01 10:08:00.216+08:00 INFO (lake-publish-task-22833|135629) [LoadJobMVListener.triggerToRefreshRelatedMVs():93] Skip to trigger refresh related materialized views in publish version phase because base table ads_app_http_qps_1s is a materialized view.
2024-08-01 10:08:00.216+08:00 INFO (lake-publish-task-22833|135629) [DatabaseTransactionMgr.finishTransaction():1183] finish transaction TransactionState. txn_id: 987666, label: flink-d6f7c0d3-8fbc-4405-924f-abf5386c8ec0, db id: 10421, table id list: 2871015, callback id: -1, coordinator: BE: 10.88.1.185, transaction status: VISIBLE, error replicas num: 0, replica ids: , prepare time: 1722478077772, write end time: 1722478080111, allow commit time: -1, commit time: 1722478080120, finish time: 1722478080210, write cost: 2348ms, publish total cost: 90ms, total cost: 2438ms, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@6d4a9e65 tabletCommitInfos size: 10 successfully
2024-08-01 10:08:01.123+08:00 INFO (thrift-server-pool-91756|135613) [FrontendServiceImpl.loadTxnPrepare():1532] receive txn prepare request. db: otel_dw, tbl: ads_app_dubbo_qps_1s, txn_id: 987668, backend: 10.88.16.92
2024-08-01 10:08:01.128+08:00 INFO (thrift-server-pool-91756|135613) [DatabaseTransactionMgr.prepareTransaction():366] transaction:[TransactionState. txn_id: 987668, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7, db id: 10421, table id list: 2831183, callback id: -1, coordinator: BE: 10.88.16.92, transaction status: PREPARED, error replicas num: 0, replica ids: , prepare time: 1722478077979, write end time: 1722478081123, allow commit time: -1, commit time: -1, finish time: -1, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@72f78c3e tabletCommitInfos size: 10] successfully prepare
2024-08-01 10:08:01.131+08:00 INFO (nioEventLoopGroup-7-5|229) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7
2024-08-01 10:08:01.136+08:00 INFO (nioEventLoopGroup-7-5|229) [DatabaseTransactionMgr.commitPreparedTransaction():466] transaction:[TransactionState. txn_id: 987668, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7, db id: 10421, table id list: 2831183, callback id: -1, coordinator: BE: 10.88.16.92, transaction status: COMMITTED, error replicas num: 0, replica ids: , prepare time: 1722478077979, write end time: 1722478081123, allow commit time: -1, commit time: 1722478081132, finish time: -1, write cost: 3153ms, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@72f78c3e tabletCommitInfos size: 10] successfully committed
2024-08-01 10:08:01.230+08:00 INFO (lake-publish-task-22834|135630) [LoadJobMVListener.triggerToRefreshRelatedMVs():93] Skip to trigger refresh related materialized views in publish version phase because base table ads_app_dubbo_qps_1s is a materialized view.
2024-08-01 10:08:01.230+08:00 INFO (lake-publish-task-22834|135630) [DatabaseTransactionMgr.finishTransaction():1183] finish transaction TransactionState. txn_id: 987668, label: flink-ed07ad28-5767-471c-8121-7c8b0cdf6be7, db id: 10421, table id list: 2831183, callback id: -1, coordinator: BE: 10.88.16.92, transaction status: VISIBLE, error replicas num: 0, replica ids: , prepare time: 1722478077979, write end time: 1722478081123, allow commit time: -1, commit time: 1722478081132, finish time: 1722478081224, write cost: 3153ms, publish total cost: 92ms, total cost: 3245ms, reason: attachment: com.starrocks.load.loadv2.ManualLoadTxnCommitAttachment@72f78c3e tabletCommitInfos size: 10 successfully
2024-08-01 10:08:01.792+08:00 INFO (autovacuum-pool1-t16270|16878) [AutovacuumDaemon.vacuumPartitionImpl():208] Vacuumed otel_dw.ads_app_http_qps_1s.2938937 hasError=false vacuumedFiles=12707 vacuumedFileSize=542351373 visibleVersion=1296 minRetainVersion=1296 minActiveTxnId=986395 cost=3799ms
2024-08-01 10:08:02.027+08:00 INFO (autovacuum-pool1-t16261|16869) [AutovacuumDaemon.vacuumPartitionImpl():208] Vacuumed otel_dw.ads_slow_sql_1w.1927415 hasError=false vacuumedFiles=4 vacuumedFileSize=0 visibleVersion=1000 minRetainVersion=1000 minActiveTxnId=986395 cost=28ms
2024-08-01 10:08:02.347+08:00 INFO (nioEventLoopGroup-7-7|231) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-1d50445d-b2d2-427a-a071-dd83c65cde38
2024-08-01 10:08:02.347+08:00 INFO (nioEventLoopGroup-7-7|231) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-2.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_all_dubbo, op: TXN_LOAD, label: flink-1d50445d-b2d2-427a-a071-dd83c65cde38
2024-08-01 10:08:02.822+08:00 INFO (nioEventLoopGroup-7-1|221) [TransactionWithoutChannelHandler.handle():65] Handle transaction without channel info, label: flink-1d50445d-b2d2-427a-a071-dd83c65cde38
2024-08-01 10:08:02.823+08:00 INFO (nioEventLoopGroup-7-1|221) [TransactionLoadAction.executeTransaction():239] Redirect transaction action to destination=TNetworkAddress(hostname:devops-starrocks-cn-2.devops-starrocks-cn-search.starrocks.svc.cluster.local, port:8040), db: otel_dw, table: ads_all_dubbo, op: TXN_PREPARE, label: flink-1d50445d-b2d2-427a-a071-dd83c65cde38
…