为了更快的定位您的问题,请提供以下信息,谢谢
【详述】3 fe节点集群,重启后一个fe后一直报Environment invalid because of previous exception,节点一重启就自动退出。新增节点加入集群也报同样的错。
【背景】查询fe配置,重启fe。
【业务影响】暂无
【StarRocks版本】2.5.5
【集群规模】3fe + 4be
【机器信息】16C/128G/千兆
【联系方式】社区群16-牧云
【附件】
- fe.log/beINFO/
2023-09-14 14:26:23,070 ERROR (main|1) [BDBEnvironment.ensureHelperInLocal():371] failed to check if helper in local after retried 1 times
com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 7.3.7) 1684310343907(-1):/data/sr-meta/bdb recoveryTracker should overlap or follow on disk last VLSN of 202,159,028 recoveryFirst= 202,159,030 UNEXPECTED_STATE_FATAL: Unexpected internal state, unable to continue. Environment is invalid and must be closed.
at com.sleepycat.je.EnvironmentFailureException.unexpectedState(EnvironmentFailureException.java:443) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.merge(VLSNIndex.java:1573) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.init(VLSNIndex.java:1483) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.(VLSNIndex.java:422) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.impl.RepImpl.preRecoveryCheckpointInit(RepImpl.java:567) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.recovery.RecoveryManager.recover(RecoveryManager.java:461) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.EnvironmentImpl.finishInit(EnvironmentImpl.java:841) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:222) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:267) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.(Environment.java:252) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:607) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:466) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:540) ~[je-7.3.7.jar:7.3.7]
at com.starrocks.journal.bdbje.BDBEnvironment.ensureHelperInLocal(BDBEnvironment.java:350) [starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBEnvironment.setup(BDBEnvironment.java:160) [starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBEnvironment.initBDBEnvironment(BDBEnvironment.java:140) [starrocks-fe.jar:?]
at com.starrocks.journal.JournalFactory.create(JournalFactory.java:18) [starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.initJournal(GlobalStateMgr.java:991) [starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.initialize(GlobalStateMgr.java:941) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.start(StarRocksFE.java:116) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.main(StarRocksFE.java:68) [starrocks-fe.jar:?]
2023-09-14 14:26:28,214 ERROR (main|1) [BDBEnvironment.ensureHelperInLocal():371] failed to check if helper in local after retried 2 times
com.sleepycat.je.EnvironmentFailureException: Environment invalid because of previous exception: (JE 7.3.7) 684310343907(-1):/data/sr-meta/bdb recoveryTracker should overlap or follow on disk last VLSN of 202,159,028 recoveryFirst= 202,159,030 UNEXPECTED_STATE_FATAL: Unexpected internal state, unable to continue. Environment is invalid and must be closed.
at com.sleepycat.je.EnvironmentFailureException.unexpectedState(EnvironmentFailureException.java:443) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.merge(VLSNIndex.java:1573) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.init(VLSNIndex.java:1483) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.vlsn.VLSNIndex.(VLSNIndex.java:422) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.impl.RepImpl.preRecoveryCheckpointInit(RepImpl.java:567) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.recovery.RecoveryManager.recover(RecoveryManager.java:461) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.EnvironmentImpl.finishInit(EnvironmentImpl.java:841) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:222) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:267) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.Environment.(Environment.java:252) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:607) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:466) ~[je-7.3.7.jar:7.3.7]
at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:540) ~[je-7.3.7.jar:7.3.7]
at com.starrocks.journal.bdbje.BDBEnvironment.ensureHelperInLocal(BDBEnvironment.java:350) [starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBEnvironment.setup(BDBEnvironment.java:160) [starrocks-fe.jar:?]
at com.starrocks.journal.bdbje.BDBEnvironment.initBDBEnvironment(BDBEnvironment.java:140) [starrocks-fe.jar:?]
at com.starrocks.journal.JournalFactory.create(JournalFactory.java:18) [starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.initJournal(GlobalStateMgr.java:991) [starrocks-fe.jar:?]
at com.starrocks.server.GlobalStateMgr.initialize(GlobalStateMgr.java:941) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.start(StarRocksFE.java:116) [starrocks-fe.jar:?]
at com.starrocks.StarRocksFE.main(StarRocksFE.java:68) [starrocks-fe.jar:?]
2023-0