为了更快的定位您的问题，请提供以下信息，谢谢
【详述】一天内多个时间点某个BE节点会发生crash
【背景】BE节点都为整点宕机，在查看日志时候发现每次be发生crash时，be.WARN的都有相同的连接MySQL报错，报错信息在后面有贴出；后查看是在StarRocks中有建立了与MySQL相关的外部表，MySQL的用户信息有问题；外部表的逻辑是将StarRocks中的数据插入到该表中；
外部表语句
CREATE EXTERNAL TABLE ext_wastagecustomer_create_tmp (
create_time varchar(20) NULL COMMENT “”,
create_num varchar(20) NULL COMMENT “”
) ENGINE=MYSQL
COMMENT “MYSQL”
PROPERTIES (
“host” = “192.168.2”,
“port” = “3306”,
“user” = “hive_azkaban”,
“password” = “”,
“database” = “datacenter”,
“table” = “dm_analysis_ixin_wastagecustomer_create_tmp”
);
【业务影响】没有影响
【是否存算分离】没有
【StarRocks版本】例如：2.5.5
【集群规模】例如：3fe（1 follower+2observer）+3be（fe与be混部）
【机器信息】CPU虚拟核/内存/网卡，例如：48C/128G/万兆
【联系方式】archer_66@126.com
【附件】
- fe.log/beINFO/相应截图
- 外表查询报错
------ be.out
start time: 2023年 05月 08日 星期一 18:34:49 CST
start time: Wed May 17 08:35:56 CST 2023
start time: Mon Jun 12 14:08:08 CST 2023
start time: 2023年 07月 18日 星期二 10:51:00 CST
start time: Sun Oct 1 12:40:03 CST 2023
start time: 2024年 01月 11日 星期四 16:19:35 CST
start time: Thu Feb 1 13:33:02 CST 2024
terminate called after throwing an instance of ‘fmt::v7::format_error’
what(): string pointer is null
2.5.5 RELEASE (build 24c1eca)
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
tracker:process consumption: 51172407232
tracker:query_pool consumption: 12830657
tracker:load consumption: 7663376
tracker:metadata consumption: 2549095079
tracker:tablet_metadata consumption: 25356530
tracker:rowset_metadata consumption: 155864381
tracker:segment_metadata consumption: 311667204
tracker:column_metadata consumption: 2056206964
tracker:tablet_schema consumption: 2294762
tracker:segment_zonemap consumption: 258620710
tracker:short_key_index consumption: 2350389
tracker:column_zonemap_index consumption: 499716652
tracker:ordinal_index consumption: 864866904
tracker:bitmap_index consumption: 0
tracker:bloom_filter_index consumption: 55925760
tracker:compaction consumption: 27195920
tracker:schema_change consumption: 0
tracker:column_pool consumption: 2973711369
tracker:page_cache consumption: 27394295776
tracker:update consumption: 9933814916
tracker:chunk_allocator consumption: 2150150768
tracker:clone consumption: 0
tracker:consistency consumption: 0
*** Aborted at 1709053265 (unix time) try “date -d @1709053265” if you are using GNU date ***
PC: @ 0x7f2aa14e3387 __GI_raise
*** SIGABRT (@0x219c1) received by PID 137665 (TID 0x7f2968942700) from PID 137665; stack trace: ***
@ 0x58f9dc2 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f2aa1f98630 (unknown)
@ 0x7f2aa14e3387 __GI_raise
@ 0x7f2aa14e4a78 __GI_abort
@ 0x2ace5e4 _ZN9__gnu_cxx27__verbose_terminate_handlerEv.cold
@ 0x7d8f516 __cxxabiv1::__terminate()
@ 0x7d8f581 std::terminate()
@ 0x7d8f6d4 __cxa_throw
@ 0x6570ef6 fmt::v7::detail::write<>()
@ 0x6574cd0 fmt::v7::detail::parse_replacement_field<>()
@ 0x65751bb fmt::v7::vformat_to<>()
@ 0x656acaa fmt::v7::detail::vformat()
@ 0x51a3d89 starrocks::MysqlTableWriter::append()
@ 0x4f279eb starrocks::pipeline::MysqlTableSinkIOBuffer::_process_chunk()
@ 0x4f23e3b starrocks::pipeline::SinkIOBuffer::execute_io_task()
@ 0x5a408ac bthread::ExecutionQueueBase::_execute()
@ 0x5a41628 bthread::ExecutionQueueBase::_execute_tasks()
@ 0x475fbe0 starrocks::PriorityThreadPool::work_thread()
@ 0x58b97e7 thread_proxy
@ 0x7f2aa1f90ea5 start_thread
@ 0x7f2aa15abb0d __clone
@ 0x0 (unknown)
start time: 2024年 02月 28日 星期三 01:06:44 CST
---- BE.warn
W0228 00:58:53.105187 139115 exec_state_reporter.cpp:129] Retrying ReportExecStatus: No more data to read.
W0228 00:59:22.892098 140197 tablet_updates.cpp:1122] wait_for_version slow(3993ms) version:546505.1 tablet:548153 #version:317 [546201 546505.1@315 546506] pending: rowsets:3[id/seg/row/del/byte/compaction]: [218555/1/2869244/4/32.01 M
B/-8.75 KB],[570916/1/2422043/0/27.39 MB/4.61 MB],[570917/1/94/0/4.29 KB/32.00 MB]
W0228 00:59:23.413348 139115 exec_state_reporter.cpp:129] Retrying ReportExecStatus: No more data to read.
W0228 00:59:27.922783 140197 tablet_updates.cpp:1122] wait_for_version slow(3992ms) version:546506.1 tablet:548157 #version:317 [546201 546506.1@316 546506.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218573/1/2868300/9/32.01
MB/-8.97 KB],[570899/1/2423029/0/27.40 MB/4.60 MB]
W0228 00:59:31.141867 140195 tablet_updates.cpp:1122] wait_for_version slow(3950ms) version:546506.1 tablet:548137 #version:321 [546199 546506.1@319 546507] pending: rowsets:3[id/seg/row/del/byte/compaction]: [218424/1/2867798/6/32.00 M
B/-543.00 B],[570869/1/2423731/0/27.40 MB/4.60 MB],[570870/1/18/0/2.97 KB/32.00 MB]
W0228 00:59:31.502624 140203 tablet_updates.cpp:1122] wait_for_version slow(3842ms) version:546506.1 tablet:548149 #version:321 [546201 546506.1@319 546507] pending: rowsets:3[id/seg/row/del/byte/compaction]: [218885/1/2868960/9/32.01 M
B/-13.28 KB],[571567/1/2421600/0/27.39 MB/4.61 MB],[571568/1/7/0/2.72 KB/32.00 MB]
W0228 00:59:36.681923 140203 tablet_updates.cpp:1122] wait_for_version slow(4180ms) version:546507.1 tablet:548145 #version:324 [546200 546507.1@322 546508] pending: rowsets:3[id/seg/row/del/byte/compaction]: [218864/1/2867877/8/32.01 M
B/-11.28 KB],[571538/1/2424459/0/27.41 MB/4.59 MB],[571539/0/0/0/0/32.00 MB]
W0228 00:59:56.061198 139115 exec_state_reporter.cpp:129] Retrying ReportExecStatus: No more data to read.
W0228 01:00:08.721858 140196 tablet_updates.cpp:1122] wait_for_version slow(4135ms) version:546513.1 tablet:548141 #version:330 [546199 546513.1@329 546513.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218053/1/2868366/10/32.0
1 MB/-8.20 KB],[570398/1/2423381/0/27.40 MB/4.60 MB]
W0228 01:00:13.932560 140196 tablet_updates.cpp:1122] wait_for_version slow(4138ms) version:546514.1 tablet:548133 #version:332 [546199 546514.1@330 546515] pending: rowsets:4[id/seg/row/del/byte/compaction]: [218123/1/2869082/4/32.01 M
B/-12.33 KB],[570416/1/82/0/4.26 KB/32.00 MB],[570417/1/2423434/0/27.41 MB/4.59 MB],[570418/1/144/0/4.79 KB/32.00 MB]
W0228 01:00:17.384943 140202 tablet_updates.cpp:1122] wait_for_version slow(4137ms) version:546515.1 tablet:548129 #version:333 [546198 546515.1@332 546515.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218484/1/2868243/7/32.01
MB/-9.46 KB],[570613/1/2422763/0/27.40 MB/4.60 MB]
W0228 01:00:22.567395 140202 tablet_updates.cpp:1122] wait_for_version slow(4144ms) version:546515.1 tablet:548161 #version:334 [546198 546515.1@332 546516] pending: rowsets:3[id/seg/row/del/byte/compaction]: [218508/1/2867852/5/32.01 M
B/-7.67 KB],[570614/1/2422868/0/27.40 MB/4.60 MB],[570615/1/222/0/6.08 KB/31.99 MB]
W0228 01:00:56.498030 139115 exec_state_reporter.cpp:129] Retrying ReportExecStatus: No more data to read.
W0228 01:01:04.728317 139092 mysql_table_sink_operator.cpp:84] open mysql table writer failed, error: Internal error: mysql_real_connect failed because Access denied for user ‘hive_azkaban’@‘192.168.22.3’ (using password: NO)
W0228 01:01:04.809360 139115 exec_state_reporter.cpp:129] Retrying ReportExecStatus: write() send(): Broken pipe
W0228 01:06:48.613453 182510 data_dir.cpp:367] Found invalid rowset=020000001f040913614e457ff114893073f813b0a4a5d09b tablet id=1195131 tablet uid=fb43b7b90969649c-d4436e6c0a97c19d schema hash=1722537656 txn_id: 43709039 current valid tablet uid=ec4cd7d2c9e534d7-e7763defc8187cb2
W0228 01:06:53.958266 183807 tablet_updates.cpp:1122] wait_for_version slow(3981ms) version:546523.1 tablet:548153 #version:335 [546201 546523.1@334 546523.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218555/1/2869244/4/32.01 MB/-8.75 KB],[570935/1/2422043/0/27.39 MB/4.61 MB]
W0228 01:06:54.116353 183813 tablet_updates.cpp:1122] wait_for_version slow(4136ms) version:546523.1 tablet:548149 #version:338 [546201 546523.1@337 546523.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218885/1/2868960/9/32.01 MB/-13.28 KB],[571585/1/2421600/0/27.39 MB/4.61 MB]
W0228 01:06:54.558048 183805 tablet_updates.cpp:1122] wait_for_version slow(4052ms) version:546523.1 tablet:548137 #version:338 [546199 546523.1@337 546523.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218424/1/2867798/6/32.00 MB/-543.00 B],[570887/1/2423731/0/27.40 MB/4.60 MB]
W0228 01:06:54.684245 183806 tablet_updates.cpp:1122] wait_for_version slow(4650ms) version:546523.1 tablet:548141 #version:341 [546199 546523.1@340 546523.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218053/1/2868366/10/32.01 MB/-8.20 KB],[570409/1/2423381/0/27.40 MB/4.60 MB]
W0228 01:06:55.162475 183812 tablet_updates.cpp:1122] wait_for_version slow(4125ms) version:546523.1 tablet:548129 #version:342 [546198 546523.1@341 546523.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218484/1/2868243/7/32.01 MB/-9.46 KB],[570622/1/2422763/0/27.40 MB/4.60 MB]
W0228 01:06:58.774470 183805 tablet_updates.cpp:1122] wait_for_version slow(3984ms) version:280060.1 tablet:1328522 #version:338 [279736 280060.1@337 280060.1] pending: rowsets:790[id/seg/row/del/byte/compaction]: [11287/1/181875/0/33.22 MB/-1.22 MB],[11286/1/171897/0/32.02 MB/-22.91 KB],[11285/1/184310/0/32.36 MB/-368.35 KB],[11284/1/223859/0/32.51 MB/-522.10 KB],[11283/1/215095/0/35.02 MB/-3.02 MB],[11282/1/197812/0/32.06 MB/-64.57 KB],[11281/1/205001/0/32.02 MB/-21.79 KB],[11280/1/237633/0/34.65 MB/-2.65 MB],[11279/1/216840/0/32.50 MB/-510.34 KB],[11278/1/227126/0/32.92 MB/-943.49 KB],[11277/1/217851/0/32.78 MB/-797.96 KB]…,[163618/1/320618/0/39.47 MB/-7.47 MB],[163799/1/254358/0/32.35 MB/-355.18 KB],[219281/1/318358/3992/39.35 MB/-4.88 MB],[220171/1/321807/8053/38.71 MB/-1.87 MB],[220806/1/507470/11571/62.40 MB/-23.28 MB],[284980/1/290276/4873/35.23 MB/-279.24 KB],[285708/1/272752/983/32.98 MB/-396.85 KB],[289297/1/640855/16708/77.29 MB/-35.22 MB],[289479/1/16736/0/2.08 MB/29.92 MB]
W0228 01:06:58.796406 183813 tablet_updates.cpp:1122] wait_for_version slow(3709ms) version:546523.1 tablet:548145 #version:340 [546200 546523.1@339 546523.1] pending: rowsets:2[id/seg/row/del/byte/compaction]: [218864/1/2867877/8/32.01 MB/-11.28 KB],[571555/1/2424459/0/27.41 MB/4.59 MB]