常见 Crash / BUG / 优化查询

blithe_jj · 2025年04月25日 05:54

Be异常重启能帮忙看下这个帖子吗？

trueeyu · 2025年04月30日 03:58

SelectOperator crash

starrocks::BinaryColumnBase<unsigned int>::append(starrocks::Column const&, unsigned long, unsigned long)
*** SIGSEGV (@0x0) received by PID 88 (TID 0x7f261abcf640) from PID 0; stack trace: ***
    @     0x7f26dbf4bee8 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x99ee7)
    @          0xa28f3a9 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7f26dbef4520 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x4251f)
    @          0x5495a7b starrocks::BinaryColumnBase<unsigned int>::append(starrocks::Column const&, unsigned long, unsigned long)
    @          0x54bb516 starrocks::NullableColumn::append(starrocks::Column const&, unsigned long, unsigned long)
    @          0x7caa0b8 starrocks::pipeline::SelectOperator::pull_chunk(starrocks::RuntimeState*)
    @          0x53f9fe0 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
    @          0x7e6e053 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x8bae9e3 starrocks::ThreadPool::dispatch_thread()
    @          0x8ba60a9 starrocks::Thread::supervise_thread(void*)
    @     0x7f26dbf46ac3 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x94ac2)
    @     0x7f26dbfd8850 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x12684f)

Github Issue:
- https://github.com/StarRocks/starrocks/issues/56588
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/57023
Jira
问题版本:
- 3.3.0 ~ 3.3.11
- 3.4.0 ~ 3.4.1
修复版本:
- 3.3.12+
- 3.4.2+
问题原因:
临时解决办法:

trueeyu · 2025年04月30日 15:05

FE 一直给挂掉的 BE 发请求导致导入报错

一台 BE 挂掉，也会导致导入持续报错

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/55371
Jira
问题版本:
- 3.2.0 ~ 3.2.14
- 3.3.0 ~ 3.3.9
- 3.4.0
修复版本:
- 3.2.15+
- 3.3.10+
- 3.4.1+
问题原因:
临时解决办法:

trueeyu · 2025年05月13日 07:43

Array_unique_agg/array_union_agg crash

*** Aborted at 1740794708 (unix time) try "date -d @1740794708" if you are using GNU date ***
PC: @          0x617302d starrocks::Rowset::comparator(std::shared_ptr<starrocks::Rowset> const&, std::shared_ptr<starrocks::Rowset> const&)
*** SIGSEGV (@0xa8) received by PID 161549 (TID 0x7fec84d57700) from PID 168; stack trace: ***
    @     0x7ff6a0da6647 (/usr/lib64/libpthread-2.28.so+0x10646)
    @          0x7cd6b20 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7ff6a19ddaaa os::Linux::chained_handler(int, siginfo*, void*)
    @     0x7ff6a19e30ae JVM_handle_linux_signal
    @     0x7ff6a19d6fb8 signalHandler(int, siginfo*, void*)
    @     0x7ff6a0da94c0 (/usr/lib64/libpthread-2.28.so+0x134bf)
    @          0x617302d starrocks::Rowset::comparator(std::shared_ptr<starrocks::Rowset> const&, std::shared_ptr<starrocks::Rowset> const&)
    @          0x6329fec void std::__introsort_loop<__gnu_cxx::__normal_iterator<std::shared_ptr<starrocks::Rowset>*, std::vector<std::shared_ptr<starrocks::Rowset>, std::allocator<std::shared_ptr<starrocks::Rowset> > > >, long, __gnu_cxx::__ops::_Iter_comp_iter<bool (*)(std::sharH8?
    @          0x637866d starrocks::SizeTieredCompactionPolicy::_pick_rowsets_to_size_tiered_compact(bool, std::vector<std::shared_ptr<starrocks::Rowset>, std::allocator<std::shared_ptr<starrocks::Rowset> > >*, double*)
    @          0x637b980 starrocks::SizeTieredCompactionPolicy::need_compaction(double*, starrocks::CompactionType*)
    @          0x615fc4a starrocks::Tablet::need_compaction()
    @          0x636dcb3 starrocks::CompactionManager::update_tablet(std::shared_ptr<starrocks::Tablet> const&)
    @          0x394f753 starrocks::ThreadPool::dispatch_thread()
    @          0x39479f6 starrocks::Thread::supervise_thread(void*)
    @     0x7ff6a0d9ef1b (/usr/lib64/libpthread-2.28.so+0x8f1a)
    @     0x7ff6a0b2833f clone  、

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/50425
- https://github.com/StarRocks/starrocks/pull/56746
Jira
问题版本:
- 3.3.0~3.3.11
修复版本:
- 3.3.12+
问题原因:
临时解决办法:

trueeyu · 2025年07月8日 06:59

Compaction crash

*** Aborted at 1740794708 (unix time) try "date -d @1740794708" if you are using GNU date ***
PC: @          0x617302d starrocks::Rowset::comparator(std::shared_ptr<starrocks::Rowset> const&, std::shared_ptr<starrocks::Rowset> const&)
*** SIGSEGV (@0xa8) received by PID 161549 (TID 0x7fec84d57700) from PID 168; stack trace: ***
    @     0x7ff6a0da6647 (/usr/lib64/libpthread-2.28.so+0x10646)
    @          0x7cd6b20 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7ff6a19ddaaa os::Linux::chained_handler(int, siginfo*, void*)
    @     0x7ff6a19e30ae JVM_handle_linux_signal
    @     0x7ff6a19d6fb8 signalHandler(int, siginfo*, void*)
    @     0x7ff6a0da94c0 (/usr/lib64/libpthread-2.28.so+0x134bf)
    @          0x617302d starrocks::Rowset::comparator(std::shared_ptr<starrocks::Rowset> const&, std::shared_ptr<starrocks::Rowset> const&)
    @          0x6329fec void std::__introsort_loop<__gnu_cxx::__normal_iterator<std::shared_ptr<starrocks::Rowset>*, std::vector<std::shared_ptr<starrocks::Rowset>, std::allocator<std::shared_ptr<starrocks::Rowset> > > >, long, __gnu_cxx::__ops::_Iter_comp_iter<bool (*)(std::sharH8?
    @          0x637866d starrocks::SizeTieredCompactionPolicy::_pick_rowsets_to_size_tiered_compact(bool, std::vector<std::shared_ptr<starrocks::Rowset>, std::allocator<std::shared_ptr<starrocks::Rowset> > >*, double*)
    @          0x637b980 starrocks::SizeTieredCompactionPolicy::need_compaction(double*, starrocks::CompactionType*)
    @          0x615fc4a starrocks::Tablet::need_compaction()
    @          0x636dcb3 starrocks::CompactionManager::update_tablet(std::shared_ptr<starrocks::Tablet> const&)
    @          0x394f753 starrocks::ThreadPool::dispatch_thread()
    @          0x39479f6 starrocks::Thread::supervise_thread(void*)
    @     0x7ff6a0d9ef1b (/usr/lib64/libpthread-2.28.so+0x8f1a)
    @     0x7ff6a0b2833f clone

或

** Aborted at 1751745341 (unix time) try "date -d @1751745341" if you are using GNU date ***
PC: @          0x3dce69c void google::protobuf::internal::RepeatedPtrFieldBase::Destroy<google::protobuf::RepeatedPtrField<starrocks::BinaryPredicatePB>::TypeHandler>()
*** SIGSEGV (@0x0) received by PID 8076 (TID 0x7f7cd9df2700) from PID 0; stack trace: ***
    @     0x7f8086e2c20b __pthread_once_slow
    @          0x7ce6340 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7f8086e35630 (/usr/lib64/libpthread-2.17.so+0xf62f)
    @          0x3dce69c void google::protobuf::internal::RepeatedPtrFieldBase::Destroy<google::protobuf::RepeatedPtrField<starrocks::BinaryPredicatePB>::TypeHandler>()
    @          0x3dcd691 starrocks::DeletePredicatePB::~DeletePredicatePB()
    @          0x617728e starrocks::TabletMeta::~TabletMeta()
    @          0x36ccb8a std::_Sp_counted_base<(__gnu_cxx::_Lock_policy)2>::_M_release()
    @          0x6352ed0 starrocks::CompactionManager::_check_compaction_disabled(starrocks::CompactionCandidate const&)
    @          0x6353a76 starrocks::CompactionManager::pick_candidate(starrocks::CompactionCandidate*)
    @          0x6353cd7 starrocks::CompactionManager::_schedule()
    @          0xc43e710 execute_native_thread_routine
    @     0x7f8086e2dea5 start_thread
    @     0x7f808622e96d __clone

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/57652
Jira
问题版本:
- 3.3.0 ~ 3.3.12
- 3.4.0 ~ 3.4.2
修复版本:
- 3.3.13+
- 3.4.3+
问题原因:
临时解决办法:

trueeyu · 2025年05月13日 07:55

last_value crash

*** Aborted at 1746187907 (unix time) try "date -d @1746187907" if you are using GNU date ***
PC: @          0x36e0f84 std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >::_M_assign(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)
*** SIGSEGV (@0x0) received by PID 192900 (TID 0x14d14d5a1640) from PID 0; stack trace: ***
    @     0x14d5e588ee18 __pthread_once_slow
    @          0x7da16a0 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x14d5e682b9b9 os::Linux::chained_handler(int, siginfo_t*, void*)
    @     0x14d5e6831c7a JVM_handle_linux_signal
    @     0x14d5e6823a4c signalHandler(int, siginfo_t*, void*)
    @     0x14d5e583e6f0 (/usr/lib64/libc.so.6+0x3e6ef)
    @          0x36e0f84 std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >::_M_assign(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)
    @          0x53bcaf8 starrocks::LastValueWindowFunction<(starrocks::LogicalType)54, false, starrocks::JsonValue*>::get_values(starrocks::FunctionContext*, unsigned char const*, starrocks::Column*, unsigned long, unsigned long) const
    @          0x41204ee starrocks::Analytor::_get_window_function_result(unsigned long, unsigned long)
    @          0x41205db starrocks::Analytor::_materializing_process_for_unbounded_frame(starrocks::RuntimeState*)
    @          0x41223b9 starrocks::Analytor::_materializing_process(starrocks::RuntimeState*)
    @          0x411f712 starrocks::Analytor::finish_process(starrocks::RuntimeState*)
    @          0x451292c starrocks::pipeline::AnalyticSinkOperator::set_finishing(starrocks::RuntimeState*)
    @          0x44d53b4 starrocks::pipeline::PipelineDriver::_mark_operator_finishing(std::shared_ptr<starrocks::pipeline::Operator>&, starrocks::RuntimeState*)
    @          0x44d8c8a starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
    @          0x479b7d3 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x397e973 starrocks::ThreadPool::dispatch_thread()
    @          0x3976c16 starrocks::Thread::supervise_thread(void*)
    @     0x14d5e5889c02 start_thread
    @     0x14d5e590ec40 __clone3

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/58697
- https://github.com/StarRocks/starrocks/pull/58776
Jira
问题版本:
- 3.3.0 ~ 3.3.13
- 3.4.0 ~ 3.4.3
修复版本:
- 3.3.14+
- 3.4.4+
问题原因:
临时解决办法:

trueeyu · 2025年05月30日 03:56

Spill 报磁盘空间不足

no writable spill storage directories

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/55703
- https://github.com/StarRocks/starrocks/pull/57736
Jira
问题版本:
- 3.3.0 ~ 3.3.12
- 3.4.0 ~ 3.4.2
修复版本:
- 3.3.13+
- 3.4.3+
问题原因:
临时解决办法:

trueeyu · 2025年05月30日 03:53

305. capture_consistent_versions error

ERROR 1064 (HY000): capture_consistent_versions error: version not found. tablet_id: 882465, version: 2215 tablet_max_version:2184 backend [id=10002] [host=1.1.1.1]

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/58513
Jira
问题版本:
- 3.2.0 ~ 3.2.16
- 3.3.0 ~ 3.3.13
- 3.4.0 ~ 3.4.3
修复版本:
- 3.2.17+
- 3.3.14+
- 3.4.4+
问题原因:
临时解决办法:

trueeyu · 2025年07月4日 07:38

JDBC catalog 导致 FE 线程泄漏

FE 线程数不断增加, 和数据源的连接不释放

2025-01-18 09:35:11.157+08:00 INFO (leaderCheckpointer|348) [JDBCMetadata.createHikariDataSource():136] create hikari data source
java.lang.Throwable: null
        at com.starrocks.connector.jdbc.JDBCMetadata.createHikariDataSource(JDBCMetadata.java:136) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.jdbc.JDBCMetadata.<init>(JDBCMetadata.java:94) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.jdbc.JDBCMetadata.<init>(JDBCMetadata.java:63) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.jdbc.JDBCConnector.getMetadata(JDBCConnector.java:98) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.LazyConnector.getMetadata(LazyConnector.java:33) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.CatalogConnector.getMetadata(CatalogConnector.java:43) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getOptionalMetadata(MetadataMgr.java:190) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getOptionalMetadata(MetadataMgr.java:164) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getTable(MetadataMgr.java:496) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getTable(MetadataMgr.java:526) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getTableWithIdentifier(MetadataMgr.java:531) ~[starrocks-fe.jar:?]
        at com.starrocks.sql.optimizer.rule.transformation.materialization.MvUtils.getTableWithIdentifier(MvUtils.java:1410) ~[starrocks-fe.jar:?]
        at com.starrocks.catalog.MaterializedView.onReloadImpl(MaterializedView.java:985) ~[starrocks-fe.jar:?]
        at com.starrocks.catalog.MaterializedView.onReload(MaterializedView.java:916) ~[starrocks-fe.jar:?]
        at com.starrocks.server.GlobalStateMgr.processMvRelatedMeta(GlobalStateMgr.java:1557) ~[starrocks-fe.jar:?]
        at com.starrocks.server.GlobalStateMgr.postLoadImage(GlobalStateMgr.java:1547) ~[starrocks-fe.jar:?]
        at com.starrocks.server.GlobalStateMgr.loadImage(GlobalStateMgr.java:1536) ~[starrocks-fe.jar:?]
        at com.starrocks.leader.Checkpoint.replayAndGenerateGlobalStateMgrImage(Checkpoint.java:208) ~[starrocks-fe.jar:?]
        at com.starrocks.leader.Checkpoint.createImage(Checkpoint.java:193) ~[starrocks-fe.jar:?]
        at com.starrocks.leader.Checkpoint.runAfterCatalogReady(Checkpoint.java:110) ~[starrocks-fe.jar:?]
        at com.starrocks.common.util.FrontendDaemon.runOneCycle(FrontendDaemon.java:72) ~[starrocks-fe.jar:?]
        at com.starrocks.common.util.Daemon.run(Daemon.java:107) ~[starrocks-fe.jar:?]

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/55270
Jira
问题版本:
- 3.1.0 ~ 3.1.17
- 3.2.0 ~ 3.2.14
- 3.3.0 ~ 3.3.9
- 3.4.0
修复版本:
- 3.1.18+
- 3.2.15+
- 3.3.10+
- 3.4.1+
问题原因:
临时解决办法:

xiongmao · 2025年06月30日 07:55

*** Aborted at 1751265362 (unix time) try "date -d @1751265362" if you are using GNU date ***
PC: @          0x6e66f78 ra_portable_size_in_bytes
*** SIGSEGV (@0x0) received by PID 256450 (TID 0x7fa20e86c700) from PID 0; stack trace: ***
    @          0x67755a2 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7fa2458d7630 (unknown)
    @          0x6e66f78 ra_portable_size_in_bytes
    @          0x5900770 starrocks::BitmapValue::get_size_in_bytes()
    @          0x345d6d0 starrocks::ObjectColumn<>::byte_size()
    @          0x2bafdd3 starrocks::Column::memory_usage()
    @          0x3447f2b starrocks::NullableColumn::memory_usage()
    @          0x343c040 starrocks::Chunk::memory_usage()
    @          0x525bc68 starrocks::MemTable::insert()
    @          0x5251aa0 starrocks::DeltaWriter::write()
    @          0x51ccabc starrocks::AsyncDeltaWriter::_execute()
    @          0x68d82dc bthread::ExecutionQueueBase::_execute()
    @          0x68d9058 bthread::ExecutionQueueBase::_execute_tasks()
    @          0x2e79bdc starrocks::ThreadPool::dispatch_thread()
    @          0x2e7385a starrocks::Thread::supervise_thread()
    @     0x7fa2458cfea5 start_thread
    @     0x7fa244cd0b0d __clone
    @                0x0 (unknown)

Github Issue:
Github Fix PR: https://github.com/StarRocks/starrocks/pull/44167
Jira
问题版本
1. 2.5.0 ～ 2.5.20
2. 3.0 ～ 3.0.9
3. 3.1.0 ~ 3.1.10
4. 3.2.0 ~ 3.2.7
5. 3.3.0
修复版本
1. 2.5.21+
2. 3.0.10+
3. 3.1.10+
4. 3.3.1+

hanson · 2025年07月17日 05:28

我的版本3.1.15 出现如下错误：
E0717 00:30:18.454006 4729 scan_operator.cpp:413] scan fragment 292df4c3-6262-11f0-93c0-a0369fd8ceda driver 0 Scan tasks error: Unknown code(48): : global dict greater than DICT_DECODE_MAX_SIZE
/build/starrocks/be/src/storage/meta_reader.cpp:179 _collect(_params->fields[i], _params->cids[i], (*dsts)[i], _params->field_type[i])
/build/starrocks/be/src/storage/meta_reader.cpp:79 _collect_context.seg_collecters[_collect_context.cursor_idx]->collect(&columns)
/build/starrocks/be/src/storage/olap_meta_reader.cpp:158 _read((*result).get(), chunk_capacity - chunk_start)

看本贴第一个说是3.1.15后修复了，感觉是没修复

MJie · 2025年07月29日 11:44

请问下，295.LogMessageFatal这个问题有修复计划吗？按照临时解决办法设置ignore_load_tablet_failure = true，对数据会有什么影响吗，会出现数据丢失或者不一致吗@ LIANGCHAOHUA

jiankang · 2025年08月6日 05:45

老师好。
目前我们的版本 3.1.17-67ae3b7 的版本，
在调用udfs额时候还是会出现这个问题。
未知错误 (1064, 'exception happened when get class: java.lang.OutOfMemoryError: Compressed class space[] backend

书忆江南 · 2025年08月8日 02:36

补充：bug 305的临时解决方法，把对应be上的tablet id进行set bad：
https://docs.starrocks.io/zh/docs/sql-reference/sql-statements/cluster-management/tablet_replica/ADMIN_SET_REPLICA_STATUS/

trueeyu · 2025年08月13日 07:07

使用 StarRocks 外表同步数据报错

get TableMeta failed from TNetworkAddress

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/30124
Jira
问题版本:
- 2.5.0 ~ 2.5.12
- 3.1.0 ~ 3.1.2
修复版本:
- 2.5.13+
- 3.1.3+
问题原因:
临时解决办法:

trueeyu · 2025年08月13日 07:30

SkewRule 导致性能慢或SlowLock

  "app//com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHiveScan(StatisticsCalculator.java:664)",
  "app//com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHiveScan(StatisticsCalculator.java:179)",
  "app//com.starrocks.sql.optimizer.operator.logical.LogicalHiveScanOperator.accept(LogicalHiveScanOperator.java:78)",
  "app//com.starrocks.sql.optimizer.statistics.StatisticsCalculator.estimatorStats(StatisticsCalculator.java:202)",
  "app//com.starrocks.sql.optimizer.Utils.calculateStatistics(Utils.java:815)",
  "app//com.starrocks.sql.optimizer.Utils.calculateStatistics(Utils.java:804)",
  "app//com.starrocks.sql.optimizer.Utils.calculateStatistics(Utils.java:804)",
  "app//com.starrocks.sql.optimizer.Optimizer.skewJoinOptimize(Optimizer.java:794)",
  "app//com.starrocks.sql.optimizer.Optimizer.logicalRuleRewrite(Optimizer.java:570)",
  "app//com.starrocks.sql.optimizer.Optimizer.rewriteAndValidatePlan(Optimizer.java:748)",
  "app//com.starrocks.sql.optimizer.Optimizer.optimizeByCost(Optimizer.java:248)",
  "app//com.starrocks.sql.optimizer.Optimizer.optimize(Optimizer.java:196)",
  "app//com.starrocks.sql.optimizer.Optimizer.optimize(Optimizer.java:172)",
  "app//com.starrocks.sql.InsertPlanner.buildExecPlan(InsertPlanner.java:517)",
  "app//com.starrocks.sql.InsertPlanner.plan(InsertPlanner.java:315)",
  "app//com.starrocks.sql.StatementPlanner.planInsertStmt(StatementPlanner.java:203)",
  "app//com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:141)",
  "app//com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:92)",
  "app//com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:578)",

Github Issue:
Github Fix PR:
Jira
问题版本:
- 所有版本
修复版本:
- 未修复
问题原因:
临时解决办法:
- Set global enable_stats_to_optimize_skew_join=false;

colagy · 2025年09月2日 07:47

大佬请问3.2.17版本什么时候发布

trueeyu · 2025年09月11日 03:33

StarRocks写的Parquet文件，Hive读不了

Failed with exception java.io.IOException:org.apache.parquet.io.ParquetDecodingException: Can not read value at 0 in block -1 in file

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/43875
Jira
问题版本:
- 3.2.0~latest
- 3.3.0~3.3.4
修复版本:
- 3.2未修复
- 3.3.5+
问题原因:
- StarRocks写的是新版本的Parquet格式，Hive <=3.0 的版本识别不了
临时解决办法:

trueeyu · 2025年10月28日 07:01

Morsel queue crash

*** SIGSEGV (@0xa0) received by PID 1328927 (TID 0x14f3e4c3a640) from PID 160; stack trace: ***
    @     0x14f509070ee8 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x99ee7)
    @          0xa37c049 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x14f509e7835d os::Linux::chained_handler(int, siginfo*, void*)
    @     0x14f509e7df5f JVM_handle_linux_signal
    @     0x14f509e6f968 signalHandler(int, siginfo*, void*)
    @     0x14f509019520 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x4251f)
    @          0x6d622bc starrocks::TabletReader::_to_seek_tuple(std::shared_ptr<starrocks::TabletSchema const> const&, starrocks::OlapTuple const&, starrocks::SeekTuple*, starrocks::MemPool*)
    @          0x6d62ebe starrocks::TabletReader::parse_seek_range(std::shared_ptr<starrocks::TabletSchema const> const&, starrocks::TabletReaderParams::RangeStartOperation, starrocks::TabletReaderParams::RangeEndOperation, std::vector<starrocks::OlapTuple, std::allocator<starrockP^Y
    @          0x758ae83 starrocks::pipeline::PhysicalSplitMorselQueue::_init_segment()
    @          0x758b46f starrocks::pipeline::PhysicalSplitMorselQueue::_try_get_split_from_single_tablet()
    @          0x758bd67 starrocks::pipeline::PhysicalSplitMorselQueue::try_get()
    @          0x7587e53 starrocks::pipeline::BucketSequenceMorselQueue::try_get()
    @          0x5456ace starrocks::pipeline::ScanOperator::_pickup_morsel(starrocks::RuntimeState*, int)
    @          0x54555bc starrocks::pipeline::ScanOperator::_try_to_trigger_next_scan(starrocks::RuntimeState*)
    @          0x545584a starrocks::pipeline::ScanOperator::pull_chunk(starrocks::RuntimeState*)
    @          0x544c8b8 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
    @          0x7ebce58 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x8c00b73 starrocks::ThreadPool::dispatch_thread()
    @          0x8bf81c9 starrocks::Thread::supervise_thread(void*)
    @     0x14f50906bac3 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x94ac2)
    @     0x14f5090fd850 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x12684f)

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/50690
Jira
问题版本:
- 3.3.0~3.3.17
- 3.4.0~3.4.16
- 3.5.0~3.5.4
修复版本:
- 3.3.18+
- 3.4.17+
- 3.5.5+
问题原因:
临时解决办法:
- set global enable_per_bucket_optimize = false

trueeyu · 2025年10月29日 02:18

Arm parquet reader crash

*** SIGSEGV (@0x0) received by PID 28 (TID 0xfffea329fe00) LWP(602) from PID 0; stack trace: ***
    @     0xffffb81e25c4 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x825c3)
    @          0xf73dd28 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0xffffb989c850 ([vdso]+0x84f)
    @     0xffffb81f7bbc (/usr/lib/aarch64-linux-gnu/libc.so.6+0x97bbb)
    @          0xb350584 starrocks::parquet::Int32ToDateConverter::convert(starrocks::Cow<starrocks::Column>::ImmutPtr<starrocks::Column> const&, starrocks::Column*)
    @          0xb37c948 starrocks::parquet::StatisticsHelper::decode_value_into_column(starrocks::Cow<starrocks::Column>::MutPtr<starrocks::Column> const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::ba
    @          0xb29af2c starrocks::parquet::RawColumnReader::_row_group_zone_map_filter(std::vector<starrocks::ColumnPredicate const*, std::allocator<starrocks::ColumnPredicate const*> > const&, starrocks::CompoundNodeType, starrocks::TypeDescriptor const&, unsigned long, unsigne
    @          0xb29f114 starrocks::parquet::ScalarColumnReader::row_group_zone_map_filter(std::vector<starrocks::ColumnPredicate const*, std::allocator<starrocks::ColumnPredicate const*> > const&, starrocks::CompoundNodeType, unsigned long, unsigned long) const
    @          0xb254340 starrocks::StatusOr<std::optional<starrocks::SparseRange<unsigned long> > > starrocks::parquet::PredicateFilterEvaluator::visit_for_rowgroup_zonemap<(starrocks::CompoundNodeType)0>(starrocks::PredicateCompoundNode<(starrocks::CompoundNodeType)0> const&)
    @          0xb2573cc starrocks::StatusOr<std::optional<starrocks::SparseRange<unsigned long> > > starrocks::parquet::PredicateFilterEvaluator::operator()<(starrocks::CompoundNodeType)0>(starrocks::PredicateCompoundNode<(starrocks::CompoundNodeType)0> const&, starrocks::parquet
    @          0xb22ac94 starrocks::parquet::FileReader::_filter_group(std::shared_ptr<starrocks::parquet::GroupReader> const&)
    @          0xb22b3a8 starrocks::parquet::FileReader::_init_group_readers()
    @          0xb22c3ac starrocks::parquet::FileReader::init(starrocks::HdfsScannerContext*)
    @          0xab53f4c starrocks::HdfsParquetScanner::do_open(starrocks::RuntimeState*)
    @          0xaa038a8 starrocks::HdfsScanner::open(starrocks::RuntimeState*)
    @          0xa9de95c starrocks::connector::HiveDataSource::_init_scanner(starrocks::RuntimeState*)
    @          0xa9df6d8 starrocks::connector::HiveDataSource::open(starrocks::RuntimeState*)
    @          0xa9bcf88 starrocks::pipeline::ConnectorChunkSource::_open_data_source(starrocks::RuntimeState*, bool*)
    @          0xa9bd9fc starrocks::pipeline::ConnectorChunkSource::_read_chunk(starrocks::RuntimeState*, std::shared_ptr<starrocks::Chunk>*)
    @          0xa9c399c starrocks::pipeline::ChunkSource::buffer_next_batch_chunks_blocking(starrocks::RuntimeState*, unsigned long, starrocks::workgroup::WorkGroup const*)
    @          0xa299bf0 auto starrocks::pipeline::ScanOperator::_trigger_next_scan(starrocks::RuntimeState*, int)::{lambda(auto:1&)#1}::operator()<starrocks::workgroup::YieldContext>(starrocks::workgroup::YieldContext&) const [clone .constprop.0]
    @          0xa92c89c starrocks::workgroup::ScanExecutor::worker_thread()
    @          0xc411dc4 starrocks::ThreadPool::dispatch_thread()
    @          0xc408a68 starrocks::Thread::supervise_thread(void*)

Github Issue:
Github Fix PR:
- https://github.com/StarRocks/starrocks/pull/63294
Jira
问题版本:
- 3.3.0~3.3.19
- 3.4.0~3.4.8
- 3.5.0~3.5.5
- 4.0.0
修复版本:
- 3.3.20+
- 3.4.9+
- 3.5.6+
- 4.0.1+
问题原因:
临时解决办法:

常见 Crash / BUG / 优化 查询

SelectOperator crash

FE 一直给挂掉的 BE 发请求导致导入报错

Array_unique_agg/array_union_agg crash

Compaction crash

last_value crash

Spill 报磁盘空间不足

305. capture_consistent_versions error

JDBC catalog 导致 FE 线程泄漏

使用 StarRocks 外表同步数据报错

SkewRule 导致性能慢或SlowLock

StarRocks写的Parquet文件，Hive读不了

Morsel queue crash

Arm parquet reader crash

常见 Crash / BUG / 优化查询