【sr版本】2.0.0
【场景】部署sr的服务器断电重启了
我依次启动be启动成功
【遇到的问题】
麻烦大佬帮忙看下现在应该怎么办
但是启动fe时三台只启动成功一台
并且成功这台的日志显示
2022-09-13 09:33:41,106 INFO (UNKNOWN 10.1.10.20_9010_1642494932047(-1)|1) [Catalog.waitForReady():910] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2022-09-13 09:33:43,107 INFO (UNKNOWN 10.1.10.20_9010_1642494932047(-1)|1) [Catalog.waitForReady():910] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2022-09-13 09:33:45,108 INFO (UNKNOWN 10.1.10.20_9010_1642494932047(-1)|1) [Catalog.waitForReady():910] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2022-09-13 09:33:47,108 INFO (UNKNOWN 10.1.10.20_9010_1642494932047(-1)|1) [Catalog.waitForReady():910] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2022-09-13 09:33:49,109 INFO (UNKNOWN 10.1.10.20_9010_1642494932047(-1)|1) [Catalog.waitForReady():910] wait catalog to be ready. FE type: UNKNOWN. is ready: false
就这样一直刷这个 大概已经二十分钟了
其他两台未启动成功 下面是其他两台的完整报错日志
2022-09-13 09:30:39,159 INFO (main|1) [StarRocksFE.start():104] StarRocks FE starting…
2022-09-13 09:30:39,163 INFO (main|1) [FrontendOptions.init():98] local address: /10.1.10.19.
2022-09-13 09:30:39,396 INFO (main|1) [Catalog.getHelperNodes():1230] get helper nodes: [10.1.10.19:9010]
2022-09-13 09:30:39,408 INFO (main|1) [Catalog.getClusterIdAndRole():1104] finished to get cluster id: 540503395, role: FOLLOWER and node name: 10.1.10.19_9010_1642494274737
2022-09-13 09:30:39,414 INFO (main|1) [Catalog.loadImage():1538] start load image from /data/StarRocks/fe/meta/image/image.10394146. is ckpt: false
2022-09-13 09:30:39,414 INFO (main|1) [Catalog.loadHeader():1682] finished replay header from image
2022-09-13 09:30:39,414 INFO (main|1) [Catalog.loadMasterInfo():1693] finished replay masterInfo from image
2022-09-13 09:30:39,526 INFO (main|1) [Catalog.loadDb():1736] finished replay databases from image
2022-09-13 09:30:39,532 INFO (main|1) [Catalog.loadLoadJob():1767] finished replay loadJob from image
2022-09-13 09:30:39,544 INFO (main|1) [Catalog.loadAlterJob():1799] finished replay alterJob from image
2022-09-13 09:30:39,545 INFO (main|1) [Catalog.loadRecycleBin():1956] finished replay recycleBin from image
2022-09-13 09:30:39,556 INFO (main|1) [Catalog.loadGlobalVariable():2267] finished replay globalVariable from image
2022-09-13 09:30:39,558 INFO (main|1) [Catalog.loadCluster():6791] finished replay cluster from image
2022-09-13 09:30:39,560 INFO (main|1) [Catalog.loadBrokers():6976] finished replay brokerMgr from image
2022-09-13 09:30:39,566 INFO (main|1) [Catalog.loadResources():1988] finished replay resources from image
2022-09-13 09:30:39,566 INFO (main|1) [Catalog.loadExportJob():1784] finished replay exportJob from image
2022-09-13 09:30:39,566 INFO (main|1) [Catalog.loadBackupHandler():1886] finished replay backupHandler from image
2022-09-13 09:30:39,568 INFO (main|1) [Catalog.loadAuth():1928] finished replay auth from image
2022-09-13 09:30:39,580 INFO (main|1) [Catalog.loadTransactionState():1937] finished replay transactionState from image
2022-09-13 09:30:39,580 INFO (main|1) [Catalog.loadColocateTableIndex():1964] finished replay colocateTableIndex from image
2022-09-13 09:30:39,580 INFO (main|1) [Catalog.loadRoutineLoadJobs():1972] finished replay routineLoadJobs from image
2022-09-13 09:30:39,587 INFO (main|1) [Catalog.loadLoadJobsV2():1980] finished replay loadJobsV2 from image
2022-09-13 09:30:39,588 INFO (main|1) [Catalog.loadSmallFiles():1996] finished replay smallFiles from image
2022-09-13 09:30:39,588 INFO (main|1) [Catalog.loadPlugins():7497] finished replay plugins from image
2022-09-13 09:30:39,671 INFO (main|1) [Catalog.loadDeleteHandler():1899] finished replay deleteHandler from image
2022-09-13 09:30:39,673 INFO (main|1) [Catalog.loadAnalyze():7533] finished replay analyze job from image
2022-09-13 09:30:39,675 INFO (main|1) [Catalog.loadWorkGroups():1906] finished replaying WorkGroups from image
2022-09-13 09:30:39,675 INFO (main|1) [Catalog.loadImage():1589] finished to load image in 261 ms
2022-09-13 09:30:40,116 WARN (main|1) [BDBEnvironment.setup():219] database exception
com.sleepycat.je.EnvironmentFailureException: (JE 7.3.7) 10.1.10.19_9010_1642494274737(-1):/data/StarRocks/fe/meta/bdb recoveryTracker should overlap or follow on disk last VLSN of 23,687,211 recoveryFirst= 23,687,213 UNEXPECTED_STATE_FATAL: Unexpected internal state, unable to continue. Environment is invalid and must be closed.
at com.sleepycat.je.EnvironmentFailureException.unexpectedState(EnvironmentFailureException.java:443) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.merge(VLSNIndex.java:1573) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.init(VLSNIndex.java:1483) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.(VLSNIndex.java:422) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.impl.RepImpl.preRecoveryCheckpointInit(RepImpl.java:567) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.recovery.RecoveryManager.recover(RecoveryManager.java:461) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.EnvironmentImpl.finishInit(EnvironmentImpl.java:841) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:222) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:267) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.(Environment.java:252) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:607) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:466) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:540) ~[je-7.3.7.jar:7.3.7]
at com.starrocks.journal.bdbje.BDBEnvironment.setup(BDBEnvironment.java:179) [starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBJEJournal.open(BDBJEJournal.java:272) [starrocks-fe.jar:?]
at com.starrocks.persist.EditLog.open(EditLog.java:835) [starrocks-fe.jar:?]
at com.starrocks.catalog.Catalog.initialize(Catalog.java:885) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.start(StarRocksFE.java:110) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.main(StarRocksFE.java:65) [starrocks-fe.jar:?]
2022-09-13 09:30:45,277 WARN (main|1) [BDBEnvironment.setup():219] database exception
com.sleepycat.je.EnvironmentFailureException: (JE 7.3.7) 10.1.10.19_9010_1642494274737(-1):/data/StarRocks/fe/meta/bdb recoveryTracker should overlap or follow on disk last VLSN of 23,687,211 recoveryFirst= 23,687,213 UNEXPECTED_STATE_FATAL: Unexpected internal state, unable to continue. Environment is invalid and must be closed.
at com.sleepycat.je.EnvironmentFailureException.unexpectedState(EnvironmentFailureException.java:443) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.merge(VLSNIndex.java:1573) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.init(VLSNIndex.java:1483) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.(VLSNIndex.java:422) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.impl.RepImpl.preRecoveryCheckpointInit(RepImpl.java:567) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.recovery.RecoveryManager.recover(RecoveryManager.java:461) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.EnvironmentImpl.finishInit(EnvironmentImpl.java:841) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:222) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:267) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.(Environment.java:252) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:607) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:466) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:540) ~[je-7.3.7.jar:7.3.7]
at com.starrocks.journal.bdbje.BDBEnvironment.setup(BDBEnvironment.java:179) [starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBJEJournal.open(BDBJEJournal.java:272) [starrocks-fe.jar:?]
at com.starrocks.persist.EditLog.open(EditLog.java:835) [starrocks-fe.jar:?]
at com.starrocks.catalog.Catalog.initialize(Catalog.java:885) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.start(StarRocksFE.java:110) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.main(StarRocksFE.java:65) [starrocks-fe.jar:?]
2022-09-13 09:30:50,410 WARN (main|1) [BDBEnvironment.setup():219] database exception
com.sleepycat.je.EnvironmentFailureException: (JE 7.3.7) 10.1.10.19_9010_1642494274737(-1):/data/StarRocks/fe/meta/bdb recoveryTracker should overlap or follow on disk last VLSN of 23,687,211 recoveryFirst= 23,687,213 UNEXPECTED_STATE_FATAL: Unexpected internal state, unable to continue. Environment is invalid and must be closed.
at com.sleepycat.je.EnvironmentFailureException.unexpectedState(EnvironmentFailureException.java:443) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.merge(VLSNIndex.java:1573) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.init(VLSNIndex.java:1483) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.(VLSNIndex.java:422) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.impl.RepImpl.preRecoveryCheckpointInit(RepImpl.java:567) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.recovery.RecoveryManager.recover(RecoveryManager.java:461) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.EnvironmentImpl.finishInit(EnvironmentImpl.java:841) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:222) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:267) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.(Environment.java:252) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:607) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:466) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:540) ~[je-7.3.7.jar:7.3.7]
at com.starrocks.journal.bdbje.BDBEnvironment.setup(BDBEnvironment.java:179) [starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBJEJournal.open(BDBJEJournal.java:272) [starrocks-fe.jar:?]
at com.starrocks.persist.EditLog.open(EditLog.java:835) [starrocks-fe.jar:?]
at com.starrocks.catalog.Catalog.initialize(Catalog.java:885) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.start(StarRocksFE.java:110) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.main(StarRocksFE.java:65) [starrocks-fe.jar:?]
2022-09-13 09:30:50,411 ERROR (main|1) [BDBEnvironment.setup():227] error to open replicated environment. will exit.
com.sleepycat.je.EnvironmentFailureException: (JE 7.3.7) 10.1.10.19_9010_1642494274737(-1):/data/StarRocks/fe/meta/bdb recoveryTracker should overlap or follow on disk last VLSN of 23,687,211 recoveryFirst= 23,687,213 UNEXPECTED_STATE_FATAL: Unexpected internal state, unable to continue. Environment is invalid and must be closed.
at com.sleepycat.je.EnvironmentFailureException.unexpectedState(EnvironmentFailureException.java:443) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.merge(VLSNIndex.java:1573) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.init(VLSNIndex.java:1483) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.(VLSNIndex.java:422) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.impl.RepImpl.preRecoveryCheckpointInit(RepImpl.java:567) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.recovery.RecoveryManager.recover(RecoveryManager.java:461) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.EnvironmentImpl.finishInit(EnvironmentImpl.java:841) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:222) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:267) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.(Environment.java:252) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:607) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:466) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:540) ~[je-7.3.7.jar:7.3.7]
at com.starrocks.journal.bdbje.BDBEnvironment.setup(BDBEnvironment.java:179) [starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBJEJournal.open(BDBJEJournal.java:272) [starrocks-fe.jar:?]
at com.starrocks.persist.EditLog.open(EditLog.java:835) [starrocks-fe.jar:?]
at com.starrocks.catalog.Catalog.initialize(Catalog.java:885) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.start(StarRocksFE.java:110) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.main(StarRocksFE.java:65) [starrocks-fe.jar:?]