为了更快的定位您的问题,请提供以下信息,谢谢
【详述】starrocks从3.1.15降级到3.0.8
【背景】
【业务影响】
【是否存算分离】
【StarRocks版本】3.1.15
【集群规模】例如:1fe +3be
报错日志:
2024-11-13 17:14:00,722 ERROR (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [StarRocksFE.start():192] StarRocksFE start failed
com.google.gson.JsonParseException: cannot deserialize class com.starrocks.transaction.TxnCommitAttachment subtype named ReplicationTxnCommitAttachment; did you forget to register a subtype?
at com.starrocks.persist.gson.RuntimeTypeAdapterFactory$1.read(RuntimeTypeAdapterFactory.java:383) ~[starrocks-fe.jar:?]
at com.google.gson.TypeAdapter$1.read(TypeAdapter.java:199) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:131) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:222) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:658) ~[starrocks-fe.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:963) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:928) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:877) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:848) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.metablock.SRMetaBlockReader.readJson(SRMetaBlockReader.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.transaction.GlobalTransactionMgr.loadTransactionStateV2(GlobalTransactionMgr.java:832) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.loadImage(GlobalStateMgr.java:1567) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.initialize(GlobalStateMgr.java:1112) ~[starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.start(StarRocksFE.java:135) ~[starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.main(StarRocksFE.java:84) ~[starrocks-fe.jar:?]
3.1.15降级到3.0.8,对比一下使用的je jar包的版本和spark-dpp jar包的版本
不建议降级到3.0.x版本,可以考虑升级到3.2的最新版本
3.1.15
spark-dpp-1.0.0.jar
starrocks-bdb-je-18.3.16.jar
3.0.8版本:
spark-dpp-1.0.0.jar
starrocks-bdb-je-18.3.16.jar
发一下完整的fe日志
2024-11-14 15:25:11,572 INFO (main|1) [StarRocksFE.start():124] StarRocks FE starting, version: 3.0.8-1975985
2024-11-14 15:25:11,583 INFO (main|1) [FrontendOptions.analyzePriorityCidrs():299] configured prior_cidrs value: 10.11.18.0/24
2024-11-14 15:25:11,587 INFO (main|1) [FrontendOptions.initAddrUseIp():249] Use IP init local addr, IP: /10.11.18.21
2024-11-14 15:25:11,872 INFO (main|1) [Auth.grantRoleInternal():835] grant operator to ‘root’@’%’, isReplay = true
2024-11-14 15:25:11,902 INFO (main|1) [AuthorizationMgr.initBuiltinRoleUnlocked():277] create built-in role root[-1]
2024-11-14 15:25:11,907 INFO (main|1) [AuthorizationMgr.initBuiltinRoleUnlocked():277] create built-in role db_admin[-2]
2024-11-14 15:25:11,908 INFO (main|1) [AuthorizationMgr.initBuiltinRoleUnlocked():277] create built-in role cluster_admin[-3]
2024-11-14 15:25:11,908 INFO (main|1) [AuthorizationMgr.initBuiltinRoleUnlocked():277] create built-in role user_admin[-4]
2024-11-14 15:25:11,908 INFO (main|1) [AuthorizationMgr.initBuiltinRoleUnlocked():277] create built-in role public[-5]
2024-11-14 15:25:11,909 INFO (main|1) [GlobalStateMgr.initAuth():1059] using new privilege framework…
2024-11-14 15:25:12,132 INFO (main|1) [NodeMgr.getHelperNodes():656] get helper nodes: [10.11.18.21:9010]
2024-11-14 15:25:12,149 INFO (main|1) [NodeMgr.getClusterIdAndRoleOnStartup():449] Current run_mode is null
2024-11-14 15:25:12,149 INFO (main|1) [NodeMgr.getClusterIdAndRoleOnStartup():456] Got cluster id: 943854262, role: FOLLOWER, node name: 10.11.18.21_9010_1656653386598 and run_mode: null
2024-11-14 15:25:12,150 INFO (main|1) [BDBEnvironment.ensureHelperInLocal():340] skip check local environment because helper node and local node are identical.
2024-11-14 15:25:12,183 INFO (main|1) [BDBEnvironment.setupEnvironment():269] start to setup bdb environment for 1 times
2024-11-14 15:25:12,714 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [StateChangeExecutor.notifyNewFETypeTransfer():62] notify new FE type transfer: UNKNOWN
2024-11-14 15:25:12,742 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [BDBEnvironment.setupEnvironment():280] replicated environment is all set, wait for state change…
2024-11-14 15:25:12,742 WARN (RepNode 10.11.18.21_9010_1656653386598(-1)|67) [StateChangeExecutor.notifyNewFETypeTransfer():62] notify new FE type transfer: LEADER
2024-11-14 15:25:12,743 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [BDBEnvironment.setupEnvironment():288] state change done, current role LEADER
2024-11-14 15:25:12,749 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [BDBEnvironment.setupEnvironment():292] end setup bdb environment after 1 times
2024-11-14 15:25:12,756 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1384] start load image from /home/shared/starrocks/meta/image/image.25142265. is ckpt: false
2024-11-14 15:25:13,065 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadHeaderV2():1660] finished to replay header from image
2024-11-14 15:25:13,082 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 1 from image
2024-11-14 15:25:23,357 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 2 from image
2024-11-14 15:25:23,357 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 3 from image
2024-11-14 15:25:23,362 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 4 from image
2024-11-14 15:25:23,375 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 5 from image
2024-11-14 15:25:23,378 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 6 from image
2024-11-14 15:25:23,378 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 7 from image
2024-11-14 15:25:23,849 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [HdfsService.checkPathExist():85] receive a check path request, path: hdfs://f04:8020/repo_dir/backup/__palo_repository_repo
2024-11-14 15:25:23,852 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [HdfsFsManager.getDistributedFileSystem():444] could not find file system for path hdfs://f04:8020/repo_dir/backup/__palo_repository_repo create a new one
2024-11-14 15:25:24,140 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [NativeCodeLoader.():60] Unable to load native-hadoop library for your platform… using builtin-java classes where applicable
2024-11-14 15:25:25,277 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 8 from image
2024-11-14 15:25:25,287 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalStateMgr.loadImage():1448] Success load StarRocks meta block 9 from image
2024-11-14 15:25:25,317 INFO (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [GlobalTransactionMgr.loadTransactionStateV2():780] discard expired transaction state: TransactionState. txn_id: 895009, label: delete_c6ea8328-9ffb-11ef-b7fa-f8f21ea3d198, db id: 10025, table id list: 1872002, callback id: -1, coordinator: FE: 10.11.18.21, transaction status: VISIBLE, error replicas num: 0, replica ids: , prepare time: 1731308919467, commit time: 1731308919479, finish time: 1731308919482, write cost: 12ms, publish total cost: 3ms, total cost: 15ms, reason: attachment: com.starrocks.transaction.InsertTxnCommitAttachment@6870cfac
2024-11-14 15:25:25,352 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():110] Meta block for 10 read 1150 json < total 1158 json, will skip the rest 8 json
2024-11-14 15:25:25,352 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():113] skip 0 json: {“dd”:3294215,“tl”:[3303757],“tx”:895698,“lb”:“REPLICATION_3294215_3303757_1731351293397-24”,“ci”:{“3303757”:{“td”:3303757,“pc”:{“3315724”:{“partitionId”:3315724,“version”:57,“versionTime”:1731351297083,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]}}}},“tc”:{“st”:“FE”,“ip”:“10.11.18.21”},“ts”:“VISIBLE”,“st”:“REPLICATION”,“pt”:1731351296681,“ct”:1731351297083,“ft”:1731351297106,“rs”:"",“nf”:false,“er”:[],“cb”:-1,“to”:3600000,“ta”:{“clazz”:“ReplicationTxnCommitAttachment”,“partitionVersions”:{“3315724”:57},“s”:“REPLICATION”}}
2024-11-14 15:25:25,352 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():113] skip 1 json: {“dd”:3294215,“tl”:[3303757],“tx”:895704,“lb”:“REPLICATION_3294215_3303757_1731351473519-25”,“ci”:{“3303757”:{“td”:3303757,“pc”:{“3315724”:{“partitionId”:3315724,“version”:332,“versionTime”:1731351477126,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]}}}},“tc”:{“st”:“FE”,“ip”:“10.11.18.21”},“ts”:“VISIBLE”,“st”:“REPLICATION”,“pt”:1731351476723,“ct”:1731351477126,“ft”:1731351477362,“rs”:"",“nf”:false,“er”:[],“cb”:-1,“to”:3600000,“ta”:{“clazz”:“ReplicationTxnCommitAttachment”,“partitionVersions”:{“3315724”:332},“s”:“REPLICATION”}}
2024-11-14 15:25:25,352 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():113] skip 2 json: {“dd”:3294215,“tl”:[3294441],“tx”:895832,“lb”:“REPLICATION_3294215_3294441_1731359218721-26”,“ci”:{“3294441”:{“td”:3294441,“pc”:{“3299952”:{“partitionId”:3299952,“version”:3,“versionTime”:1731359227056,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]}}}},“tc”:{“st”:“FE”,“ip”:“10.11.18.21”},“ts”:“VISIBLE”,“st”:“REPLICATION”,“pt”:1731359226753,“ct”:1731359227056,“ft”:1731359227070,“rs”:"",“nf”:false,“er”:[],“cb”:-1,“to”:3600000,“ta”:{“clazz”:“ReplicationTxnCommitAttachment”,“partitionVersions”:{“3299952”:3},“s”:“REPLICATION”}}
2024-11-14 15:25:25,352 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():113] skip 3 json: {“dd”:3294215,“tl”:[3294441],“tx”:897333,“lb”:“REPLICATION_3294215_3294441_1731427483634-27”,“ci”:{“3294441”:{“td”:3294441,“pc”:{“3328326”:{“partitionId”:3328326,“version”:3,“versionTime”:1731427487436,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]}}}},“tc”:{“st”:“FE”,“ip”:“10.11.18.21”},“ts”:“VISIBLE”,“st”:“REPLICATION”,“pt”:1731427487234,“ct”:1731427487436,“ft”:1731427487451,“rs”:"",“nf”:false,“er”:[],“cb”:-1,“to”:3600000,“ta”:{“clazz”:“ReplicationTxnCommitAttachment”,“partitionVersions”:{“3328326”:3},“s”:“REPLICATION”}}
2024-11-14 15:25:25,353 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():113] skip 4 json: {“dd”:3294215,“tl”:[3303757],“tx”:897495,“lb”:“REPLICATION_3294215_3303757_1731437389534-28”,“ci”:{“3303757”:{“td”:3303757,“pc”:{“3319666”:{“partitionId”:3319666,“version”:182,“versionTime”:1731437397796,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]}}}},“tc”:{“st”:“FE”,“ip”:“10.11.18.21”},“ts”:“VISIBLE”,“st”:“REPLICATION”,“pt”:1731437397294,“ct”:1731437397796,“ft”:1731437397822,“rs”:"",“nf”:false,“er”:[],“cb”:-1,“to”:3600000,“ta”:{“clazz”:“ReplicationTxnCommitAttachment”,“partitionVersions”:{“3319666”:182},“s”:“REPLICATION”}}
2024-11-14 15:25:25,353 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():113] skip 5 json: {“dd”:3294215,“tl”:[3303757],“tx”:897500,“lb”:“REPLICATION_3294215_3303757_1731437569649-29”,“ci”:{“3303757”:{“td”:3303757,“pc”:{“3319666”:{“partitionId”:3319666,“version”:372,“versionTime”:1731437577600,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]}}}},“tc”:{“st”:“FE”,“ip”:“10.11.18.21”},“ts”:“VISIBLE”,“st”:“REPLICATION”,“pt”:1731437577279,“ct”:1731437577600,“ft”:1731437577832,“rs”:"",“nf”:false,“er”:[],“cb”:-1,“to”:3600000,“ta”:{“clazz”:“ReplicationTxnCommitAttachment”,“partitionVersions”:{“3319666”:372},“s”:“REPLICATION”}}
2024-11-14 15:25:25,353 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():113] skip 6 json: {“dd”:3294215,“tl”:[3294441],“tx”:897630,“lb”:“REPLICATION_3294215_3294441_1731445495381-30”,“ci”:{“3294441”:{“td”:3294441,“pc”:{“3303896”:{“partitionId”:3303896,“version”:3,“versionTime”:1731445497565,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]}}}},“tc”:{“st”:“FE”,“ip”:“10.11.18.21”},“ts”:“VISIBLE”,“st”:“REPLICATION”,“pt”:1731445497362,“ct”:1731445497565,“ft”:1731445497585,“rs”:"",“nf”:false,“er”:[],“cb”:-1,“to”:3600000,“ta”:{“clazz”:“ReplicationTxnCommitAttachment”,“partitionVersions”:{“3303896”:3},“s”:“REPLICATION”}}
2024-11-14 15:25:25,353 WARN (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [SRMetaBlockReader.close():113] skip 7 json: {“dd”:3294215,“tl”:[3328634],“tx”:898220,“lb”:“insert_78ae94f7-a18e-11ef-b7fa-f8f21ea3d198”,“ci”:{“3328634”:{“td”:3328634,“pc”:{“3328562”:{“partitionId”:3328562,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328563”:{“partitionId”:3328563,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328560”:{“partitionId”:3328560,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328561”:{“partitionId”:3328561,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328566”:{“partitionId”:3328566,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328567”:{“partitionId”:3328567,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328564”:{“partitionId”:3328564,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328565”:{“partitionId”:3328565,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328570”:{“partitionId”:3328570,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328571”:{“partitionId”:3328571,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328568”:{“partitionId”:3328568,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328569”:{“partitionId”:3328569,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328574”:{“partitionId”:3328574,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328575”:{“partitionId”:3328575,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328572”:{“partitionId”:3328572,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328573”:{“partitionId”:3328573,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328546”:{“partitionId”:3328546,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328547”:{“partitionId”:3328547,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328544”:{“partitionId”:3328544,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328545”:{“partitionId”:3328545,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328550”:{“partitionId”:3328550,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328551”:{“partitionId”:3328551,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328548”:{“partitionId”:3328548,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328549”:{“partitionId”:3328549,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328554”:{“partitionId”:3328554,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328555”:{“partitionId”:3328555,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328552”:{“partitionId”:3328552,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328553”:{“partitionId”:3328553,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328558”:{“partitionId”:3328558,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328559”:{“partitionId”:3328559,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328556”:{“partitionId”:3328556,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328557”:{“partitionId”:3328557,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328530”:{“partitionId”:3328530,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328531”:{“partitionId”:3328531,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328534”:{“partitionId”:3328534,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328535”:{“partitionId”:3328535,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328532”:{“partitionId”:3328532,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328533”:{“partitionId”:3328533,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328538”:{“partitionId”:3328538,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328539”:{“partitionId”:3328539,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328536”:{“partitionId”:3328536,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328537”:{“partitionId”:3328537,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328542”:{“partitionId”:3328542,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328543”:{“partitionId”:3328543,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328540”:{“partitionId”:3328540,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328541”:{“partitionId”:3328541,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328626”:{“partitionId”:3328626,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328627”:{“partitionId”:3328627,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328624”:{“partitionId”:3328624,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328625”:{“partitionId”:3328625,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328628”:{“partitionId”:3328628,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328629”:{“partitionId”:3328629,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328610”:{“partitionId”:3328610,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328611”:{“partitionId”:3328611,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328608”:{“partitionId”:3328608,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328609”:{“partitionId”:3328609,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328614”:{“partitionId”:3328614,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328615”:{“partitionId”:3328615,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328612”:{“partitionId”:3328612,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328613”:{“partitionId”:3328613,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328618”:{“partitionId”:3328618,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328619”:{“partitionId”:3328619,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328616”:{“partitionId”:3328616,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328617”:{“partitionId”:3328617,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328622”:{“partitionId”:3328622,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328623”:{“partitionId”:3328623,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328620”:{“partitionId”:3328620,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328621”:{“partitionId”:3328621,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328594”:{“partitionId”:3328594,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328595”:{“partitionId”:3328595,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328592”:{“partitionId”:3328592,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328593”:{“partitionId”:3328593,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328598”:{“partitionId”:3328598,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328599”:{“partitionId”:3328599,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328596”:{“partitionId”:3328596,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328597”:{“partitionId”:3328597,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328602”:{“partitionId”:3328602,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328603”:{“partitionId”:3328603,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328600”:{“partitionId”:3328600,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328601”:{“partitionId”:3328601,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328606”:{“partitionId”:3328606,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328607”:{“partitionId”:3328607,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328604”:{“partitionId”:3328604,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328605”:{“partitionId”:3328605,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328578”:{“partitionId”:3328578,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328579”:{“partitionId”:3328579,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328576”:{“partitionId”:3328576,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328577”:{“partitionId”:3328577,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328582”:{“partitionId”:3328582,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328583”:{“partitionId”:3328583,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328580”:{“partitionId”:3328580,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328581”:{“partitionId”:3328581,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328586”:{“partitionId”:3328586,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328587”:{“partitionId”:3328587,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328584”:{“partitionId”:3328584,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328585”:{“partitionId”:3328585,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328590”:{“partitionId”:3328590,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328591”:{“partitionId”:3328591,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328588”:{“partitionId”:3328588,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]},“3328589”:{“partitionId”:3328589,“version”:2,“versionTime”:1731481917875,“invalidColumns”:[],“validColumns”:[],“DictCollectedVersion”:[]}}}},“tc”:{“st”:“FE”,“ip”:“10.11.18.21”},“ts”:“VISIBLE”,“st”:“INSERT_STREAMING”,“pt”:1731481875395,“ct”:1731481917875,“ft”:1731481919100,“rs”:"",“nf”:false,“er”:[],“cb”:-1,“to”:300000,“ta”:{“clazz”:“InsertTxnCommitAttachment”,“loadedRows”:265324669,“s”:“INSERT_STREAMING”}}
2024-11-14 15:25:25,354 ERROR (UNKNOWN 10.11.18.21_9010_1656653386598(-1)|1) [StarRocksFE.start():184] StarRocksFE start failed
com.google.gson.JsonParseException: cannot deserialize class com.starrocks.transaction.TxnCommitAttachment subtype named ReplicationTxnCommitAttachment; did you forget to register a subtype?
at com.starrocks.persist.gson.RuntimeTypeAdapterFactory$1.read(RuntimeTypeAdapterFactory.java:383) ~[starrocks-fe.jar:?]
at com.google.gson.TypeAdapter$1.read(TypeAdapter.java:199) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:131) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:222) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.gson.GsonUtils$ProcessHookTypeAdapterFactory$1.read(GsonUtils.java:646) ~[starrocks-fe.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:963) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:928) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:877) ~[spark-dpp-1.0.0.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:848) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.persist.metablock.SRMetaBlockReader.readJson(SRMetaBlockReader.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.transaction.GlobalTransactionMgr.loadTransactionStateV2(GlobalTransactionMgr.java:778) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.loadImage(GlobalStateMgr.java:1447) ~[starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.initialize(GlobalStateMgr.java:1033) ~[starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.start(StarRocksFE.java:130) ~[starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.main(StarRocksFE.java:82) ~[starrocks-fe.jar:?]
fe.conf 里面添加参数 ignore_unknown_log_id = true
试一下是否可以正常启动。
试过了,启动失败。
试一下先回滚到3.0.9