为了更快的定位您的问题,请提供以下信息,谢谢
【详述】SR3.2.3 使用 跨集群数据迁移工具,将源集群SR2.0.0-GA版本库表数据同步到SR3.2.3,开启同步脚本时,目标集群SR3.2.3库中的表一直出现删除,再创建的操作,SR2.0.0-GA库表中的数据未同步到目标集群SR3.2.3
【背景】SR3.2.3搭建 跨集群数据迁移工具同步异常
【业务影响】
【是否存算分离】否
【StarRocks版本】源集群SR2.0.0-GA 目标集群SR3.2.3
【集群规模】3fe(1 leader+2follower)+3be(fe与be混部)
【机器信息】32C/100G/万兆
【联系方式】社区群3-小蚂蚁,谢谢
【附件】
- 日志信息如下:
24/02/20 16:07:24 INFO [source-cluster-meta-collector] lambda$updateDbMeta$24(ClusterMetaKeeper.java:934): Updated 1 databases on the SOURCE cluster.
24/02/20 16:07:24 WARN [source-cluster-meta-collector] lambda$updateTableMeta$17(ClusterMetaKeeper.java:781): Failed to get PartitionType of table litest.demo_test, use RANGE according to PartitionColumnName start_date
24/02/20 16:07:24 INFO [source-cluster-meta-collector] lambda$updateTableMeta$17(ClusterMetaKeeper.java:790): Updated 1 tables. database->litest on the SOURCE cluster.
24/02/20 16:07:24 INFO [meta-collector-18] lambda$updateTableMeta$19(ClusterMetaKeeper.java:837): Updated 33 columns. database->litest, table->demo_test.
24/02/20 16:07:24 INFO [meta-collector-20] lambda$updatePartitionMeta$13(ClusterMetaKeeper.java:663): Updated 26 partitions. database->litest, table->demo_test on the SOURCE cluster.
…
24/02/20 16:07:24 INFO [meta-collector-10] lambda$updateTabletMeta$9(ClusterMetaKeeper.java:557): Updated 24 tablets and 72 replicas. database->litest, table->demo_test, partition->p202307, index->demo_test on the SOURCE cluster.
24/02/20 16:07:24 INFO [source-cluster-meta-collector] lambda$updateClusterMeta$0(ClusterMetaKeeper.java:62): Source cluster metadata synchronization completed, elapsed: 0 minutes and 2 seconds.
24/02/20 16:07:37 INFO [ddl-handler] execDDLJob(Utils.java:135): Executing DDL on the TARGET cluster: CREATE TABLEdemo_test
(
…
24/02/20 16:10:24 INFO [target-cluster-meta-collector] lambda$updateClusterMeta$1(ClusterMetaKeeper.java:74): Target cluster metadata synchronization completed, elapsed: 0 minutes and 1 seconds.
24/02/20 16:10:24 INFO [meta-collector-2] lambda$updateTableMeta$19(ClusterMetaKeeper.java:837): Updated 33 columns. database->litest, table->demo_test.
24/02/20 16:10:24 INFO [source-cluster-meta-collector] lambda$updateClusterMeta$0(ClusterMetaKeeper.java:62): Source cluster metadata synchronization completed, elapsed: 0 minutes and 1 seconds.
24/02/20 16:10:24 WARN [meta-handler] schemaEqual(Table.java:160): Schema change: the column type decimal64(16,2) is different from decimal(16,2) for table demo_test.
24/02/20 16:10:37 INFO [ddl-handler] execDDLJob(Utils.java:135): Executing DDL on the TARGET cluster: DROP TABLE IF EXISTS litest.demo_test FORCE
24/02/20 16:10:51 INFO [sync-reporter] report(SyncJob.java:191): DDL job queue size: 0
24/02/20 16:10:51 INFO [sync-reporter] report(SyncJob.java:193): Replication job queue size: 0
24/02/20 16:10:51 INFO [sync-reporter] report(SyncJob.java:198): Total estimated size of data pending synchronization: 0
24/02/20 16:10:51 INFO [sync-reporter] reportDbProgress(ClusterMetaKeeper.java:1041): Databases pending synchronization: []
24/02/20 16:10:51 INFO [sync-reporter] reportDbProgress(ClusterMetaKeeper.java:1042): Databases that only exist in the target cluster: []
24/02/20 16:10:51 INFO [sync-reporter] reportDbProgress(ClusterMetaKeeper.java:1061): Database litest, source size: 0.000 B, target size: 0.000 B, diff: 0.000 B
24/02/20 16:10:51 INFO [sync-reporter] reportDbProgress(ClusterMetaKeeper.java:1073): Database litest , source running txn: 0, source finished txn: 0, target running txn: 0, target finished txn: 0
24/02/20 16:10:51 INFO [sync-reporter] reportDbProgress(ClusterMetaKeeper.java:1077): Total source size: 0.000 B, total target size: 0.000 B, total diff: 0.000 B
24/02/20 16:10:51 INFO [sync-reporter] reportDbProgress(ClusterMetaKeeper.java:1080): Total source running txn: 0, total source finished txn: 0, total target running txn: 0, total target finished txn: 0
24/02/20 16:10:51 INFO [sync-reporter] report(SyncJob.java:238): Sync progress: 0.00%, total: 0, ddlPending: 0, ddlRunning: 0, jobPending: 0, sent: 0, jobRunning: 0, finished: 0, failed: 0, unknown: 0
…