2.5.17版本 com.google.gson.JsonSyntaxException: duplicate key: 835746800

为了更快的定位您的问题,请提供以下信息,谢谢
【详述】雾化视图执行失败报错
【背景】修改依赖的物化视图表
【业务影响】物化视图执行失败
【是否存算分离】否
【StarRocks版本】例如:2.5.17
【集群规模】例如:3fe+18be
【机器信息】CPU虚拟核/内存/网卡,例如:48C/64G/万兆

2024-02-21 13:08:15,534 WARN (starrocks-taskrun-pool-36982|21439068) [DeepCopy.copyWithGson():91] failed to copy object.
com.google.gson.JsonSyntaxException: duplicate key: 835746800
at com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:190) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:145) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:514) ~[starrocks-fe.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:131) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:222) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:514) ~[starrocks-fe.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:131) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:222) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:514) ~[starrocks-fe.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:131) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:222) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:514) ~[starrocks-fe.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:963) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:928) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:877) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:848) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.common.io.DeepCopy.copyWithGson(DeepCopy.java:89) ~[starrocks-fe.jar:?]
at com.starrocks.catalog.MaterializedView.selectiveCopy(MaterializedView.java:633) ~[starrocks-fe.jar:?]
at com.starrocks.catalog.MaterializedView.selectiveCopy(MaterializedView.java:73) ~[starrocks-fe.jar:?]
at com.starrocks.server.LocalMetastore.getCopiedTable(LocalMetastore.java:5133) ~[starrocks-fe.jar:?]
at com.starrocks.server.LocalMetastore.createTempPartitionsFromPartitions(LocalMetastore.java:5178) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.createTempPartitionsFromPartitions(GlobalStateMgr.java:3409) ~[starrocks-fe.jar:?]
at com.starrocks.load.PartitionUtils.createAndAddTempPartitionsForTable(PartitionUtils.java:34) ~[starrocks-fe.jar:?]
at com.starrocks.load.InsertOverwriteJobRunner.createTempPartitions(InsertOverwriteJobRunner.java:222) ~[starrocks-fe.jar:?]
at com.starrocks.load.InsertOverwriteJobRunner.doLoad(InsertOverwriteJobRunner.java:136) ~[starrocks-fe.jar:?]
at com.starrocks.load.InsertOverwriteJobRunner.handle(InsertOverwriteJobRunner.java:118) ~[starrocks-fe.jar:?]
at com.starrocks.load.InsertOverwriteJobRunner.transferTo(InsertOverwriteJobRunner.java:178) ~[starrocks-fe.jar:?]
at com.starrocks.load.InsertOverwriteJobRunner.prepare(InsertOverwriteJobRunner.java:198) ~[starrocks-fe.jar:?]
at com.starrocks.load.InsertOverwriteJobRunner.handle(InsertOverwriteJobRunner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.load.InsertOverwriteJobRunner.run(InsertOverwriteJobRunner.java:103) ~[starrocks-fe.jar:?]
at com.starrocks.load.InsertOverwriteJobManager.executeJob(InsertOverwriteJobManager.java:67) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.handleInsertOverwrite(StmtExecutor.java:1301) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.handleDMLStmtImpl(StmtExecutor.java:1344) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.handleDMLStmt(StmtExecutor.java:1307) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.refreshMaterializedView(PartitionBasedMvRefreshProcessor.java:959) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.doMvRefresh(PartitionBasedMvRefreshProcessor.java:186) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.processTaskRun(PartitionBasedMvRefreshProcessor.java:128) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.TaskRun.executeTaskRun(TaskRun.java:135) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.TaskRunExecutor.lambda$executeTaskRun$0(TaskRunExecutor.java:36) ~[starrocks-fe.jar:?]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_282]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_282]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_282]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_282]

@StarRocks小助手 @trueeyu 好像是触发了bug,大佬查看一下,这是异常栈信息

查询物化视图报错还是物化视图刷新报错,可以发下报错期间完整一点的fe.log么

物化视图刷新的时候,报错。这是日志 @dongquan
fe.zip (47.6 MB)


在这里已经有解决方案 @dongquan

1赞