【详述】
虚拟机安装1节点FE1节点BE存算一体集群
【背景】
根据官网文档安装存储一体架构
【业务影响】影响验证和测试
【是否存算分离】否
【StarRocks版本】3.3.2
【集群规模】
1FE 1BE
【机器信息】CPU虚拟核/内存/网卡:
8核16G内存
【联系方式】为了在解决问题过程中能及时联系到您获取一些日志信息,请补充下您的联系方式,例如:社区群4-小李或者邮箱,谢谢
【附件】
- fe.log/be.INFO/相应截图
2024-08-16 14:47:55.621+08:00 INFO (leaderCheckpointer|89) [TaskManager.dropTasks():387] drop tasks:[]
2024-08-16 14:47:55.621+08:00 INFO (leaderCheckpointer|89) [GlobalStateMgr.saveImage():1619] start save image to /opt/starrocks-3.3.2/fe/meta/image/image.ckpt. is ckpt: true
2024-08-16 14:47:55.615+08:00 WARN (Thread-40|55) [TemporaryTableCleaner.runAfterCatalogReady():88] listSessions return error from 192.168.1.111:9020, skip clean temporary tables
org.apache.thrift.TException: java.net.ConnectException: Connection refused (Connection refused)
at com.starrocks.rpc.ThriftRPCRequestExecutor.call(ThriftRPCRequestExecutor.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.rpc.ThriftRPCRequestExecutor.call(ThriftRPCRequestExecutor.java:33) ~[starrocks-fe.jar:?]
at com.starrocks.server.TemporaryTableCleaner.runAfterCatalogReady(TemporaryTableCleaner.java:70) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.FrontendDaemon.runOneCycle(FrontendDaemon.java:72) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.Daemon.run(Daemon.java:107) ~[starrocks-fe.jar:?]
2024-08-16 14:47:55.639+08:00 INFO (leaderCheckpointer|89) [AuthenticationMgr.saveV2():617] saved 1 users
2024-08-16 14:47:55.647+08:00 INFO (leaderCheckpointer|89) [TaskManager.saveTasksV2():588] saveTasksV2, nameToTaskMap size:0, runStatusList size: 0
2024-08-16 14:47:55.649+08:00 INFO (leaderCheckpointer|89) [GlobalStateMgr.saveImage():1662] Finished save meta block /opt/starrocks-3.3.2/fe/meta/image/image.ckpt in 28 ms.
2024-08-16 14:47:55.650+08:00 INFO (leaderCheckpointer|89) [GlobalStateMgr.saveImage():1600] Move /opt/starrocks-3.3.2/fe/meta/image/image.ckpt to /opt/starrocks-3.3.2/fe/meta/image/image.399
2024-08-16 14:47:55.650+08:00 INFO (leaderCheckpointer|89) [Checkpoint.replayAndGenerateGlobalStateMgrImage():217] checkpoint finished save image.399
2024-08-16 14:47:55.651+08:00 INFO (leaderCheckpointer|89) [BDBJEJournal.deleteJournals():247] existing database names: 367 400 , deleteToJournalId is 400
2024-08-16 14:47:55.651+08:00 INFO (leaderCheckpointer|89) [BDBJEJournal.deleteJournals():253] delete database name 367
2024-08-16 14:47:55.658+08:00 INFO (leaderCheckpointer|89) [BDBEnvironment.removeDatabase():457] remove database 367 from replicatedEnvironment successfully
2024-08-16 14:47:55.658+08:00 INFO (leaderCheckpointer|89) [Checkpoint.deleteOldJournals():154] journals <= 399 with prefix [] are deleted. image version 399, other nodes min version 9223372036854775807
2024-08-16 14:47:55.659+08:00 INFO (leaderCheckpointer|89) [MetaCleaner.clean():78] /opt/starrocks-3.3.2/fe/meta/image/image.366 deleted.
2024-08-16 14:47:55.767+08:00 ERROR (TableKeeper|87) [RepoExecutor.executeDDL():125] execute DDL error: CREATE TABLE IF NOT EXISTS statistics.task_run_history (task_id bigint NOT NULL, task_run_id string NOT NULL, create_time datetime NOT NULL, task_name string NOT NULL, task_state STRING NOT NULL, finish_time datetime NOT NULL, expire_time datetime NOT NULL, history_content_json JSON NOT NULL)PRIMARY KEY (task_id, task_run_id, create_time) PARTITION BY date_trunc(‘DAY’, create_time) DISTRIBUTED BY HASH(task_id) BUCKETS 8 PROPERTIES( ‘replication_num’ = ‘1’, ‘partition_live_number’ = ‘7’)
com.starrocks.sql.analyzer.SemanticException: Getting analyzing error. Detail message: Cluster has no available capacity.
at com.starrocks.system.SystemInfoService.checkClusterCapacity(SystemInfoService.java:1137) ~[starrocks-fe.jar:?]
at com.starrocks.server.LocalMetastore.createTable(LocalMetastore.java:829) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.createTable(MetadataMgr.java:304) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.lambda$visitCreateTableStatement$4(DDLStmtExecutor.java:273) ~[starrocks-fe.jar:?]
at com.starrocks.common.ErrorReport.wrapWithRuntimeException(ErrorReport.java:113) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.visitCreateTableStatement(DDLStmtExecutor.java:272) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.visitCreateTableStatement(DDLStmtExecutor.java:181) ~[starrocks-fe.jar:?]
at com.starrocks.sql.ast.CreateTableStmt.accept(CreateTableStmt.java:350) ~[starrocks-fe.jar:?]
at com.starrocks.sql.ast.AstVisitor.visit(AstVisitor.java:71) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor.execute(DDLStmtExecutor.java:167) ~[starrocks-fe.jar:?]
at com.starrocks.load.pipe.filelist.RepoExecutor.executeDDL(RepoExecutor.java:121) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper.createTable(TableKeeper.java:99) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper.run(TableKeeper.java:74) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper$TableKeeperDaemon.runAfterCatalogReady(TableKeeper.java:248) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.FrontendDaemon.runOneCycle(FrontendDaemon.java:72) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.Daemon.run(Daemon.java:107) ~[starrocks-fe.jar:?]
2024-08-16 14:47:55.768+08:00 ERROR (TableKeeper|87) [TableKeeper.run():83] error happens in Keeper: com.starrocks.sql.analyzer.SemanticException: Getting analyzing error. Detail message: Cluster has no available capacity.
java.lang.RuntimeException: com.starrocks.sql.analyzer.SemanticException: Getting analyzing error. Detail message: Cluster has no available capacity.
at com.starrocks.load.pipe.filelist.RepoExecutor.executeDDL(RepoExecutor.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper.createTable(TableKeeper.java:99) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper.run(TableKeeper.java:74) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper$TableKeeperDaemon.runAfterCatalogReady(TableKeeper.java:248) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.FrontendDaemon.runOneCycle(FrontendDaemon.java:72) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.Daemon.run(Daemon.java:107) ~[starrocks-fe.jar:?]
Caused by: com.starrocks.sql.analyzer.SemanticException: Getting analyzing error. Detail message: Cluster has no available capacity.
at com.starrocks.system.SystemInfoService.checkClusterCapacity(SystemInfoService.java:1137) ~[starrocks-fe.jar:?]
at com.starrocks.server.LocalMetastore.createTable(LocalMetastore.java:829) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.createTable(MetadataMgr.java:304) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.lambda$visitCreateTableStatement$4(DDLStmtExecutor.java:273) ~[starrocks-fe.jar:?]
at com.starrocks.common.ErrorReport.wrapWithRuntimeException(ErrorReport.java:113) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.visitCreateTableStatement(DDLStmtExecutor.java:272) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.visitCreateTableStatement(DDLStmtExecutor.java:181) ~[starrocks-fe.jar:?]
at com.starrocks.sql.ast.CreateTableStmt.accept(CreateTableStmt.java:350) ~[starrocks-fe.jar:?]
at com.starrocks.sql.ast.AstVisitor.visit(AstVisitor.java:71) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor.execute(DDLStmtExecutor.java:167) ~[starrocks-fe.jar:?]
at com.starrocks.load.pipe.filelist.RepoExecutor.executeDDL(RepoExecutor.java:121) ~[starrocks-fe.jar:?]
… 5 more
2024-08-16 14:47:57.372+08:00 INFO (UNKNOWN 192.168.1.111_9010_1723789481448(-1)|1) [GlobalStateMgr.waitForReady():1134] wait globalStateMgr to be ready. FE type: LEADER. is ready: true
2024-08-16 14:47:57.372+08:00 INFO (UNKNOWN 192.168.1.111_9010_1723789481448(-1)|1) [GlobalStateMgr.waitForReady():1128] globalStateMgr is ready. FE type: LEADER
2024-08-16 14:47:57.387+08:00 INFO (UNKNOWN 192.168.1.111_9010_1723789481448(-1)|1) [Xnio.():95] XNIO version 3.8.10.Final
2024-08-16 14:47:57.401+08:00 INFO (UNKNOWN 192.168.1.111_9010_1723789481448(-1)|1) [NioXnio.():58] XNIO NIO Implementation Version 3.8.10.Final
2024-08-16 14:47:57.653+08:00 INFO (UNKNOWN 192.168.1.111_9010_1723789481448(-1)|1) [FrontendThriftServer.start():65] thrift server started with port 9020.
2024-08-16 14:47:57.660+08:00 INFO (UNKNOWN 192.168.1.111_9010_1723789481448(-1)|1) [NMysqlServer.start():90] Open mysql server success on 9030
2024-08-16 14:47:57.661+08:00 INFO (UNKNOWN 192.168.1.111_9010_1723789481448(-1)|1) [QeService.start():78] QE service start.
2024-08-16 14:47:57.661+08:00 INFO (UNKNOWN 192.168.1.111_9010_1723789481448(-1)|1) [StarRocksFE.start():178] FE started successfully
2024-08-16 14:47:57.743+08:00 INFO (FE Http Server|160) [HttpServer$HttpServerThread.run():285] HttpServer started with port 8030
2024-08-16 14:48:05.545+08:00 WARN (Routine load task scheduler|43) [RoutineLoadTaskScheduler.process():117] no available be slot to scheduler tasks, wait for 10 seconds to scheduler again, you can set max_routine_load_task_num_per_be bigger in fe.conf, current value is 5
。。。
2024-08-16 14:48:25.555+08:00 WARN (Routine load task scheduler|43) [RoutineLoadTaskScheduler.process():117] no available be slot to scheduler tasks, wait for 10 seconds to scheduler again, you can set max_routine_load_task_num_per_be bigger in fe.conf, current value is 5
2024-08-16 14:48:25.773+08:00 ERROR (TableKeeper|87) [RepoExecutor.executeDDL():125] execute DDL error: CREATE TABLE IF NOT EXISTS statistics.task_run_history (task_id bigint NOT NULL, task_run_id string NOT NULL, create_time datetime NOT NULL, task_name string NOT NULL, task_state STRING NOT NULL, finish_time datetime NOT NULL, expire_time datetime NOT NULL, history_content_json JSON NOT NULL)PRIMARY KEY (task_id, task_run_id, create_time) PARTITION BY date_trunc(‘DAY’, create_time) DISTRIBUTED BY HASH(task_id) BUCKETS 8 PROPERTIES( ‘replication_num’ = ‘1’, ‘partition_live_number’ = ‘7’)
com.starrocks.sql.analyzer.SemanticException: Getting analyzing error. Detail message: Cluster has no available capacity.
at com.starrocks.system.SystemInfoService.checkClusterCapacity(SystemInfoService.java:1137) ~[starrocks-fe.jar:?]
at com.starrocks.server.LocalMetastore.createTable(LocalMetastore.java:829) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.createTable(MetadataMgr.java:304) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.lambda$visitCreateTableStatement$4(DDLStmtExecutor.java:273) ~[starrocks-fe.jar:?]
at com.starrocks.common.ErrorReport.wrapWithRuntimeException(ErrorReport.java:113) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.visitCreateTableStatement(DDLStmtExecutor.java:272) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.visitCreateTableStatement(DDLStmtExecutor.java:181) ~[starrocks-fe.jar:?]
at com.starrocks.sql.ast.CreateTableStmt.accept(CreateTableStmt.java:350) ~[starrocks-fe.jar:?]
at com.starrocks.sql.ast.AstVisitor.visit(AstVisitor.java:71) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor.execute(DDLStmtExecutor.java:167) ~[starrocks-fe.jar:?]
at com.starrocks.load.pipe.filelist.RepoExecutor.executeDDL(RepoExecutor.java:121) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper.createTable(TableKeeper.java:99) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper.run(TableKeeper.java:74) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper$TableKeeperDaemon.runAfterCatalogReady(TableKeeper.java:248) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.FrontendDaemon.runOneCycle(FrontendDaemon.java:72) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.Daemon.run(Daemon.java:107) ~[starrocks-fe.jar:?]
2024-08-16 14:48:25.774+08:00 ERROR (TableKeeper|87) [TableKeeper.run():83] error happens in Keeper: com.starrocks.sql.analyzer.SemanticException: Getting analyzing error. Detail message: Cluster has no available capacity.
java.lang.RuntimeException: com.starrocks.sql.analyzer.SemanticException: Getting analyzing error. Detail message: Cluster has no available capacity.
at com.starrocks.load.pipe.filelist.RepoExecutor.executeDDL(RepoExecutor.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper.createTable(TableKeeper.java:99) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper.run(TableKeeper.java:74) ~[starrocks-fe.jar:?]
at com.starrocks.scheduler.history.TableKeeper$TableKeeperDaemon.runAfterCatalogReady(TableKeeper.java:248) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.FrontendDaemon.runOneCycle(FrontendDaemon.java:72) ~[starrocks-fe.jar:?]
at com.starrocks.common.util.Daemon.run(Daemon.java:107) ~[starrocks-fe.jar:?]
Caused by: com.starrocks.sql.analyzer.SemanticException: Getting analyzing error. Detail message: Cluster has no available capacity.
at com.starrocks.system.SystemInfoService.checkClusterCapacity(SystemInfoService.java:1137) ~[starrocks-fe.jar:?]
at com.starrocks.server.LocalMetastore.createTable(LocalMetastore.java:829) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.createTable(MetadataMgr.java:304) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.lambda$visitCreateTableStatement$4(DDLStmtExecutor.java:273) ~[starrocks-fe.jar:?]
at com.starrocks.common.ErrorReport.wrapWithRuntimeException(ErrorReport.java:113) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.visitCreateTableStatement(DDLStmtExecutor.java:272) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor$StmtExecutorVisitor.visitCreateTableStatement(DDLStmtExecutor.java:181) ~[starrocks-fe.jar:?]
at com.starrocks.sql.ast.CreateTableStmt.accept(CreateTableStmt.java:350) ~[starrocks-fe.jar:?]
at com.starrocks.sql.ast.AstVisitor.visit(AstVisitor.java:71) ~[starrocks-fe.jar:?]
at com.starrocks.qe.DDLStmtExecutor.execute(DDLStmtExecutor.java:167) ~[starrocks-fe.jar:?]
at com.starrocks.load.pipe.filelist.RepoExecutor.executeDDL(RepoExecutor.java:121) ~[starrocks-fe.jar:?]
… 5 more
2024-08-16 14:48:35.546+08:00 INFO (colocate group clone checker|97) [ColocateTableBalancer.matchGroups():939] finished to match colocate group. cost: 0 ms, in lock time: 0 ms
2024-08-16 14:48:35.562+08:00 WARN (Routine load task scheduler|43) [RoutineLoadTaskScheduler.process():117] no available be slot to scheduler tasks, wait for 10 seconds to scheduler again, you can set max_routine_load_task_num_per_be bigger in fe.conf, current value is 5