集群中的有台be的宕机了，启动之后be.INFO一直打印日志，但是alive一直是false

hjs_l000 · 2025年06月12日 03:43

为了更快的定位您的问题，请提供以下信息，谢谢
【详述】集群中有台be宕机了，重启之后日志一直打印“Current memory statistics: process(7039837816), query_pool(0), load(0), metadata(4108935990), compaction(0), schema_change(0), column_pool(0), page_cache(43328), update(681799540), chunk_allocator(8208), clone(0), consistency(0), datacache(0)”，SHOW PROC ‘/backends’;命令之后alive一直是false
【背景】查询写数据
【业务影响】影响写入
【是否存算分离】否
【StarRocks版本】例如：1.18.2
【集群规模】3fe（1 follower+2observer）+4be
【机器信息】
【联系方式】15026796346@163.com
【附件】
链接: https://pan.baidu.com/s/11m8nYloBTVIlkgqUjPyyMw 提取码: 1144

最后就一直这样了

许秀不许秀 · 2025年06月12日 05:40

建议先升级

hjs_l000 · 2025年06月12日 05:41

之前升级过一次。最好是升级到什么版本比较好呢？

TheTopPlayer · 2025年06月12日 05:57

升级到3.3的最新版

lvlouisaslia · 2025年06月12日 05:59

用show backends看, 用show proc '/backends’时确保在LEADER上执行.

hjs_l000 · 2025年06月12日 06:01

在leader上看的，还是一样的问题

lvlouisaslia · 2025年06月12日 07:44

fe日志里找heartbeatmgr对应这个节点的错误日志.

hjs_l000 · 2025年06月12日 07:55

提示get bad heartbeat response: type: BACKEND, status: BAD, msg: java.net.ConnectException: Connection refused (Connection refused) 拒绝链接呢，因为be一直起不来，9040等端口都没开

lvlouisaslia · 2025年06月13日 03:12

BE重启后的完整日志发一下.

lvlouisaslia · 2025年06月13日 03:12

再次重启BE, 也不能恢复?

hjs_l000 · 2025年06月13日 03:52

在这个帖子里的百度云里，重启之后 ps查看进程是在的，但是一直打印那个log日志，然后几个端口都不通

lvlouisaslia · 2025年06月13日 04:09

$ grep starrocks_be.cpp be.INFO.log.20250611-161446
I0611 21:48:41.260057 25696 starrocks_be.cpp:115] BE start step 1: daemon threads start successfully
I0611 21:48:41.260151 25696 starrocks_be.cpp:119] BE start step 2: jdbc driver manager init successfully
I0611 21:48:41.261162 25696 starrocks_be.cpp:125] BE start step 3: backend network options init successfully
I0611 21:48:41.262274 25696 starrocks_be.cpp:130] BE start step 4: global env init successfully

The BE process failed to load the tablet meta from rocksdb

something wrong with the local rocksdb meta store. Either drop the entire data from the /data/starrocks/data, let starrocks to repair the tablet replicas or wait until the tablets are loaded successful.

lvlouisaslia · 2025年06月13日 04:11

用gdb包里带的pstack拿一下BE进程的线程栈看一下.

hjs_l000 · 2025年06月13日 05:46

Thread 56 (Thread 0x7f99ccfff700 (LWP 25697)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000730370c in background_thread_entry ()
#2 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#3 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 55 (Thread 0x7f99cbfff700 (LWP 25698)):
#0 0x00007f99cdb1d9fd in nanosleep () from /lib64/libc.so.6
#1 0x00007f99cdb4e2d4 in usleep () from /lib64/libc.so.6
#2 0x00000000069e917a in bvar::detail::SamplerCollector::run() ()
#3 0x00000000069ea6d9 in bvar::detail::SamplerCollector::sampling_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 54 (Thread 0x7f99cadff700 (LWP 25699)):
#0 0x00007f99ce759de2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000007302e9a in background_thread_entry ()
#2 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#3 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 53 (Thread 0x7f99ca0fe700 (LWP 25700)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 52 (Thread 0x7f99c96fd700 (LWP 25701)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 51 (Thread 0x7f99c8cfc700 (LWP 25702)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 50 (Thread 0x7f99c80fb700 (LWP 25703)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 49 (Thread 0x7f99c73ff700 (LWP 25704)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 48 (Thread 0x7f99c5bff700 (LWP 25705)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 47 (Thread 0x7f99c69fe700 (LWP 25706)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000007302fb6 in background_thread_entry ()
#2 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#3 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 46 (Thread 0x7f99c51fe700 (LWP 25707)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 45 (Thread 0x7f99c47fd700 (LWP 25708)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 44 (Thread 0x7f99c3dfc700 (LWP 25709)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 43 (Thread 0x7f99c33fb700 (LWP 25710)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 42 (Thread 0x7f99c29fa700 (LWP 25711)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 41 (Thread 0x7f99c1ff9700 (LWP 25712)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 40 (Thread 0x7f99c15f8700 (LWP 25713)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 39 (Thread 0x7f99c0bf7700 (LWP 25714)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 38 (Thread 0x7f99bfbff700 (LWP 25715)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 37 (Thread 0x7f99bebff700 (LWP 25716)):
#0 0x00007f99cdb570e3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000008b9c2b6 in aws_event_loop_thread ()
#2 0x0000000008c3fbd2 in thread_fn ()
#3 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 36 (Thread 0x7f99bdffe700 (LWP 25717)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000007302fb6 in background_thread_entry ()
#2 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#3 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 35 (Thread 0x7f99b75ff700 (LWP 25718)):
#0 0x00007f99cdb1d9fd in nanosleep () from /lib64/libc.so.6
#1 0x00007f99cdb4e2d4 in usleep () from /lib64/libc.so.6
#2 0x0000000006a019c8 in bthread_usleep ()
#3 0x0000000002e44cb0 in starrocks::Awaitility::until(std::function<bool ()>) ()
#4 0x0000000002e81ced in starrocks::nap_sleep(int, std::function<bool ()>) ()
#5 0x0000000002c07888 in starrocks::gc_memory(void*) ()
#6 0x0000000008cca900 in execute_native_thread_routine ()
#7 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#8 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 34 (Thread 0x7f99b6bfe700 (LWP 25719)):
#0 0x00007f99cdb1d9fd in nanosleep () from /lib64/libc.so.6
#1 0x00007f99cdb4e2d4 in usleep () from /lib64/libc.so.6
#2 0x0000000006a019c8 in bthread_usleep ()
#3 0x0000000002e44cb0 in starrocks::Awaitility::until(std::function<bool ()>) ()
#4 0x0000000002e81ced in starrocks::nap_sleep(int, std::function<bool ()>) ()
#5 0x0000000002c06096 in starrocks::calculate_metrics(void*) ()
#6 0x0000000008cca900 in execute_native_thread_routine ()
#7 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#8 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 33 (Thread 0x7f99b61fd700 (LWP 25720)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 32 (Thread 0x7f99b47fe700 (LWP 25722)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 31 (Thread 0x7f99b3dfd700 (LWP 25723)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 30 (Thread 0x7f99b33fc700 (LWP 25724)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 29 (Thread 0x7f99b29fb700 (LWP 25725)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 28 (Thread 0x7f99b1ffa700 (LWP 25726)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 27 (Thread 0x7f99b15f9700 (LWP 25727)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 26 (Thread 0x7f99b07f9700 (LWP 25728)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 25 (Thread 0x7f99afdf8700 (LWP 25729)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 24 (Thread 0x7f99af1f7700 (LWP 25730)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 23 (Thread 0x7f99ae5f6700 (LWP 25731)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 22 (Thread 0x7f99ad7ff700 (LWP 25732)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 21 (Thread 0x7f99acdfe700 (LWP 25733)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 20 (Thread 0x7f99ac3fd700 (LWP 25734)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 19 (Thread 0x7f99ab5ff700 (LWP 25735)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 18 (Thread 0x7f99aa7ff700 (LWP 25736)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 17 (Thread 0x7f99a9dfe700 (LWP 25737)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 16 (Thread 0x7f99a91fd700 (LWP 25738)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 15 (Thread 0x7f99a87fc700 (LWP 25739)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 14 (Thread 0x7f99a7dfb700 (LWP 25740)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 13 (Thread 0x7f99a6fff700 (LWP 25741)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x00000000066861ea in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) ()
#3 0x000000000668659e in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 12 (Thread 0x7f999aff4700 (LWP 25793)):
#0 0x00007f99ce759de2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000006606cea in rocksdb::port::CondVar::TimedWait(unsigned long) ()
#2 0x00000000065c8536 in rocksdb::InstrumentedCondVar::TimedWait(unsigned long) ()
#3 0x000000000652192c in rocksdb::Run() ()
#4 0x0000000008cca900 in execute_native_thread_routine ()
#5 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#6 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 11 (Thread 0x7f99b53ff700 (LWP 25794)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 10 (Thread 0x7f999b9f5700 (LWP 25795)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 9 (Thread 0x7f999c3f6700 (LWP 25796)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 8 (Thread 0x7f99a05fe700 (LWP 25797)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 7 (Thread 0x7f999d3ff700 (LWP 25798)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 6 (Thread 0x7f9994c73700 (LWP 25799)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 5 (Thread 0x7f9994272700 (LWP 25800)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 4 (Thread 0x7f9993871700 (LWP 25801)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 3 (Thread 0x7f9992e70700 (LWP 25802)):
#0 0x00007f99ce759a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x0000000008c5f0ac in std::condition_variable::wait(std::unique_lockstd::mutex&) ()
#2 0x0000000002ed331a in starrocks::ThreadPool::dispatch_thread() ()
#3 0x0000000002ecc7ba in starrocks::supervise_thread(void*) ()
#4 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 2 (Thread 0x7f999246f700 (LWP 25803)):
#0 0x00000000051a06c0 in starrocks::Tablet::_contains_rowset(starrocks::RowsetId) ()
#1 0x00000000051a82c8 in starrocks::Tablet::add_rowset(std::shared_ptrstarrocks::Rowset const&, bool) ()
#2 0x00000000051a8971 in starrocks::Tablet::load_rowset(std::shared_ptrstarrocks::Rowset const&) ()
#3 0x000000000518d2eb in starrocks::DataDir::load()::{lambda(starrocks::UniqueId const&, starrocks::RowsetId, std::basic_string_view<char, std::char_traits >)#2}::operator()(starrocks::UniqueId const&, starrocks::RowsetId, std::basic_string_view<char, std::char_traits >) const [clone .constprop.0] ()
#4 0x000000000518d5c1 in std::_Function_handler<bool (starrocks::UniqueId const&, starrocks::RowsetId const&, std::basic_string_view<char, std::char_traits >), starrocks::DataDir::load()::{lambda(starrocks::UniqueId const&, starrocks::RowsetId, std::basic_string_view<char, std::char_traits >)#2}>::_M_invoke(std::_Any_data const&, starrocks::UniqueId const&, starrocks::RowsetId const&, std::basic_string_view<char, std::char_traits >&&) ()
#5 0x0000000005997672 in starrocks::RowsetMetaManager::traverse_rowset_metas(starrocks::KVStore*, std::function<bool (starrocks::UniqueId const&, starrocks::RowsetId const&, std::basic_string_view<char, std::char_traits >)> const&)::{lambda(std::basic_string_view<char, std::char_traits >, std::basic_string_view<char, std::char_traits >)#1}::operator()(std::basic_string_view<char, std::char_traits >, std::basic_string_view<char, std::char_traits >) const ()
#6 0x00000000050ec766 in starrocks::KVStore::iterate(starrocks::ColumnFamilyIndex, std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&, std::function<bool (std::basic_string_view<char, std::char_traits >, std::basic_string_view<char, std::char_traits >)> const&, long) ()
#7 0x0000000005996bd5 in starrocks::RowsetMetaManager::traverse_rowset_metas(starrocks::KVStore*, std::function<bool (starrocks::UniqueId const&, starrocks::RowsetId const&, std::basic_string_view<char, std::char_traits >)> const&) ()
#8 0x00000000051873ed in starrocks::DataDir::load() ()
#9 0x0000000005168d0b in std::_State_impl<std::_Invoker<std::tuple<starrocks::StorageEngine::load_data_dirs(std::vector<starrocks::DataDir*, std::allocatorstarrocks::DataDir* > const&)::{lambda()#1}> > >::_M_run() ()
#10 0x0000000008cca900 in execute_native_thread_routine ()
#11 0x00007f99ce755ea5 in start_thread () from /lib64/libpthread.so.0
#12 0x00007f99cdb56b0d in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x7f99cfc2d1c0 (LWP 25696)):
#0 0x00007f99ce757017 in pthread_join () from /lib64/libpthread.so.0
#1 0x0000000008cca963 in std::join() ()
#2 0x000000000516bba8 in starrocks::StorageEngine::load_data_dirs(std::vector<starrocks::DataDir*, std::allocatorstarrocks::DataDir* > const&) ()
#3 0x00000000051708ea in starrocks::StorageEngine::_open(starrocks::EngineOptions const&) ()
#4 0x000000000517d517 in starrocks::StorageEngine::open(starrocks::EngineOptions const&, starrocks::StorageEngine**) ()
#5 0x0000000002e21184 in starrocks::init_storage_engine(starrocks::GlobalEnv*, std::vector<starrocks::StorePath, std::allocatorstarrocks::StorePath >, bool) ()
#6 0x0000000002e21c5b in starrocks::start_be(std::vector<starrocks::StorePath, std::allocatorstarrocks::StorePath > const&, bool) ()
#7 0x0000000002a50527 in main ()

hjs_l000 · 2025年06月13日 05:47

是的，好像是某些数据有问题