常见 Crash / BUG / 优化 查询

301. Array_unique_agg/array_union_agg crash

*** Aborted at 1740794708 (unix time) try "date -d @1740794708" if you are using GNU date ***
PC: @          0x617302d starrocks::Rowset::comparator(std::shared_ptr<starrocks::Rowset> const&, std::shared_ptr<starrocks::Rowset> const&)
*** SIGSEGV (@0xa8) received by PID 161549 (TID 0x7fec84d57700) from PID 168; stack trace: ***
    @     0x7ff6a0da6647 (/usr/lib64/libpthread-2.28.so+0x10646)
    @          0x7cd6b20 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7ff6a19ddaaa os::Linux::chained_handler(int, siginfo*, void*)
    @     0x7ff6a19e30ae JVM_handle_linux_signal
    @     0x7ff6a19d6fb8 signalHandler(int, siginfo*, void*)
    @     0x7ff6a0da94c0 (/usr/lib64/libpthread-2.28.so+0x134bf)
    @          0x617302d starrocks::Rowset::comparator(std::shared_ptr<starrocks::Rowset> const&, std::shared_ptr<starrocks::Rowset> const&)
    @          0x6329fec void std::__introsort_loop<__gnu_cxx::__normal_iterator<std::shared_ptr<starrocks::Rowset>*, std::vector<std::shared_ptr<starrocks::Rowset>, std::allocator<std::shared_ptr<starrocks::Rowset> > > >, long, __gnu_cxx::__ops::_Iter_comp_iter<bool (*)(std::sharH8?
    @          0x637866d starrocks::SizeTieredCompactionPolicy::_pick_rowsets_to_size_tiered_compact(bool, std::vector<std::shared_ptr<starrocks::Rowset>, std::allocator<std::shared_ptr<starrocks::Rowset> > >*, double*)
    @          0x637b980 starrocks::SizeTieredCompactionPolicy::need_compaction(double*, starrocks::CompactionType*)
    @          0x615fc4a starrocks::Tablet::need_compaction()
    @          0x636dcb3 starrocks::CompactionManager::update_tablet(std::shared_ptr<starrocks::Tablet> const&)
    @          0x394f753 starrocks::ThreadPool::dispatch_thread()
    @          0x39479f6 starrocks::Thread::supervise_thread(void*)
    @     0x7ff6a0d9ef1b (/usr/lib64/libpthread-2.28.so+0x8f1a)
    @     0x7ff6a0b2833f clone  、

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/50425

  • https://github.com/StarRocks/starrocks/pull/56746

• Jira

• 问题版本:

  • 3.3.0~3.3.11

• 修复版本:

  • 3.3.12+

• 问题原因:

• 临时解决办法:

302. Compaction crash

*** Aborted at 1740794708 (unix time) try "date -d @1740794708" if you are using GNU date ***
PC: @          0x617302d starrocks::Rowset::comparator(std::shared_ptr<starrocks::Rowset> const&, std::shared_ptr<starrocks::Rowset> const&)
*** SIGSEGV (@0xa8) received by PID 161549 (TID 0x7fec84d57700) from PID 168; stack trace: ***
    @     0x7ff6a0da6647 (/usr/lib64/libpthread-2.28.so+0x10646)
    @          0x7cd6b20 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7ff6a19ddaaa os::Linux::chained_handler(int, siginfo*, void*)
    @     0x7ff6a19e30ae JVM_handle_linux_signal
    @     0x7ff6a19d6fb8 signalHandler(int, siginfo*, void*)
    @     0x7ff6a0da94c0 (/usr/lib64/libpthread-2.28.so+0x134bf)
    @          0x617302d starrocks::Rowset::comparator(std::shared_ptr<starrocks::Rowset> const&, std::shared_ptr<starrocks::Rowset> const&)
    @          0x6329fec void std::__introsort_loop<__gnu_cxx::__normal_iterator<std::shared_ptr<starrocks::Rowset>*, std::vector<std::shared_ptr<starrocks::Rowset>, std::allocator<std::shared_ptr<starrocks::Rowset> > > >, long, __gnu_cxx::__ops::_Iter_comp_iter<bool (*)(std::sharH8?
    @          0x637866d starrocks::SizeTieredCompactionPolicy::_pick_rowsets_to_size_tiered_compact(bool, std::vector<std::shared_ptr<starrocks::Rowset>, std::allocator<std::shared_ptr<starrocks::Rowset> > >*, double*)
    @          0x637b980 starrocks::SizeTieredCompactionPolicy::need_compaction(double*, starrocks::CompactionType*)
    @          0x615fc4a starrocks::Tablet::need_compaction()
    @          0x636dcb3 starrocks::CompactionManager::update_tablet(std::shared_ptr<starrocks::Tablet> const&)
    @          0x394f753 starrocks::ThreadPool::dispatch_thread()
    @          0x39479f6 starrocks::Thread::supervise_thread(void*)
    @     0x7ff6a0d9ef1b (/usr/lib64/libpthread-2.28.so+0x8f1a)
    @     0x7ff6a0b2833f clone  

或

** Aborted at 1751745341 (unix time) try "date -d @1751745341" if you are using GNU date ***
PC: @          0x3dce69c void google::protobuf::internal::RepeatedPtrFieldBase::Destroy<google::protobuf::RepeatedPtrField<starrocks::BinaryPredicatePB>::TypeHandler>()
*** SIGSEGV (@0x0) received by PID 8076 (TID 0x7f7cd9df2700) from PID 0; stack trace: ***
    @     0x7f8086e2c20b __pthread_once_slow
    @          0x7ce6340 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7f8086e35630 (/usr/lib64/libpthread-2.17.so+0xf62f)
    @          0x3dce69c void google::protobuf::internal::RepeatedPtrFieldBase::Destroy<google::protobuf::RepeatedPtrField<starrocks::BinaryPredicatePB>::TypeHandler>()
    @          0x3dcd691 starrocks::DeletePredicatePB::~DeletePredicatePB()
    @          0x617728e starrocks::TabletMeta::~TabletMeta()
    @          0x36ccb8a std::_Sp_counted_base<(__gnu_cxx::_Lock_policy)2>::_M_release()
    @          0x6352ed0 starrocks::CompactionManager::_check_compaction_disabled(starrocks::CompactionCandidate const&)
    @          0x6353a76 starrocks::CompactionManager::pick_candidate(starrocks::CompactionCandidate*)
    @          0x6353cd7 starrocks::CompactionManager::_schedule()
    @          0xc43e710 execute_native_thread_routine
    @     0x7f8086e2dea5 start_thread
    @     0x7f808622e96d __clone

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/57652

• Jira

• 问题版本:

  • 3.3.0 ~ 3.3.12

  • 3.4.0 ~ 3.4.2

• 修复版本:

  • 3.3.13+

  • 3.4.3+

• 问题原因:

• 临时解决办法:

303. last_value crash

*** Aborted at 1746187907 (unix time) try "date -d @1746187907" if you are using GNU date ***
PC: @          0x36e0f84 std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >::_M_assign(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)
*** SIGSEGV (@0x0) received by PID 192900 (TID 0x14d14d5a1640) from PID 0; stack trace: ***
    @     0x14d5e588ee18 __pthread_once_slow
    @          0x7da16a0 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x14d5e682b9b9 os::Linux::chained_handler(int, siginfo_t*, void*)
    @     0x14d5e6831c7a JVM_handle_linux_signal
    @     0x14d5e6823a4c signalHandler(int, siginfo_t*, void*)
    @     0x14d5e583e6f0 (/usr/lib64/libc.so.6+0x3e6ef)
    @          0x36e0f84 std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >::_M_assign(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)
    @          0x53bcaf8 starrocks::LastValueWindowFunction<(starrocks::LogicalType)54, false, starrocks::JsonValue*>::get_values(starrocks::FunctionContext*, unsigned char const*, starrocks::Column*, unsigned long, unsigned long) const
    @          0x41204ee starrocks::Analytor::_get_window_function_result(unsigned long, unsigned long)
    @          0x41205db starrocks::Analytor::_materializing_process_for_unbounded_frame(starrocks::RuntimeState*)
    @          0x41223b9 starrocks::Analytor::_materializing_process(starrocks::RuntimeState*)
    @          0x411f712 starrocks::Analytor::finish_process(starrocks::RuntimeState*)
    @          0x451292c starrocks::pipeline::AnalyticSinkOperator::set_finishing(starrocks::RuntimeState*)
    @          0x44d53b4 starrocks::pipeline::PipelineDriver::_mark_operator_finishing(std::shared_ptr<starrocks::pipeline::Operator>&, starrocks::RuntimeState*)
    @          0x44d8c8a starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
    @          0x479b7d3 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x397e973 starrocks::ThreadPool::dispatch_thread()
    @          0x3976c16 starrocks::Thread::supervise_thread(void*)
    @     0x14d5e5889c02 start_thread
    @     0x14d5e590ec40 __clone3

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/58697

  • https://github.com/StarRocks/starrocks/pull/58776

• Jira

• 问题版本:

  • 3.3.0 ~ 3.3.13

  • 3.4.0 ~ 3.4.3

• 修复版本:

  • 3.3.14+

  • 3.4.4+

• 问题原因:

• 临时解决办法:

304. Spill 报磁盘空间不足

no writable spill storage directories

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/55703
  • https://github.com/StarRocks/starrocks/pull/57736

• Jira

• 问题版本:

  • 3.3.0 ~ 3.3.12

  • 3.4.0 ~ 3.4.2

• 修复版本:

  • 3.3.13+

  • 3.4.3+

• 问题原因:

• 临时解决办法:

305. capture_consistent_versions error

ERROR 1064 (HY000): capture_consistent_versions error: version not found. tablet_id: 882465, version: 2215 tablet_max_version:2184 backend [id=10002] [host=1.1.1.1]

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/58513

• Jira

• 问题版本:

  • 3.2.0 ~ 3.2.16

  • 3.3.0 ~ 3.3.13

  • 3.4.0 ~ 3.4.3

• 修复版本:

  • 3.2.17+

  • 3.3.14+

  • 3.4.4+

• 问题原因:

• 临时解决办法:

305. JDBC catalog 导致 FE 线程泄漏

FE 线程数不断增加, 和数据源的连接不释放

2025-01-18 09:35:11.157+08:00 INFO (leaderCheckpointer|348) [JDBCMetadata.createHikariDataSource():136] create hikari data source
java.lang.Throwable: null
        at com.starrocks.connector.jdbc.JDBCMetadata.createHikariDataSource(JDBCMetadata.java:136) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.jdbc.JDBCMetadata.<init>(JDBCMetadata.java:94) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.jdbc.JDBCMetadata.<init>(JDBCMetadata.java:63) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.jdbc.JDBCConnector.getMetadata(JDBCConnector.java:98) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.LazyConnector.getMetadata(LazyConnector.java:33) ~[starrocks-fe.jar:?]
        at com.starrocks.connector.CatalogConnector.getMetadata(CatalogConnector.java:43) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getOptionalMetadata(MetadataMgr.java:190) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getOptionalMetadata(MetadataMgr.java:164) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getTable(MetadataMgr.java:496) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getTable(MetadataMgr.java:526) ~[starrocks-fe.jar:?]
        at com.starrocks.server.MetadataMgr.getTableWithIdentifier(MetadataMgr.java:531) ~[starrocks-fe.jar:?]
        at com.starrocks.sql.optimizer.rule.transformation.materialization.MvUtils.getTableWithIdentifier(MvUtils.java:1410) ~[starrocks-fe.jar:?]
        at com.starrocks.catalog.MaterializedView.onReloadImpl(MaterializedView.java:985) ~[starrocks-fe.jar:?]
        at com.starrocks.catalog.MaterializedView.onReload(MaterializedView.java:916) ~[starrocks-fe.jar:?]
        at com.starrocks.server.GlobalStateMgr.processMvRelatedMeta(GlobalStateMgr.java:1557) ~[starrocks-fe.jar:?]
        at com.starrocks.server.GlobalStateMgr.postLoadImage(GlobalStateMgr.java:1547) ~[starrocks-fe.jar:?]
        at com.starrocks.server.GlobalStateMgr.loadImage(GlobalStateMgr.java:1536) ~[starrocks-fe.jar:?]
        at com.starrocks.leader.Checkpoint.replayAndGenerateGlobalStateMgrImage(Checkpoint.java:208) ~[starrocks-fe.jar:?]
        at com.starrocks.leader.Checkpoint.createImage(Checkpoint.java:193) ~[starrocks-fe.jar:?]
        at com.starrocks.leader.Checkpoint.runAfterCatalogReady(Checkpoint.java:110) ~[starrocks-fe.jar:?]
        at com.starrocks.common.util.FrontendDaemon.runOneCycle(FrontendDaemon.java:72) ~[starrocks-fe.jar:?]
        at com.starrocks.common.util.Daemon.run(Daemon.java:107) ~[starrocks-fe.jar:?]

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/55270

• Jira

• 问题版本:

  • 3.1.0 ~ 3.1.17

  • 3.2.0 ~ 3.2.14

  • 3.3.0 ~ 3.3.9

  • 3.4.0

• 修复版本:

  • 3.1.18+

  • 3.2.15+

  • 3.3.10+

  • 3.4.1+

• 问题原因:

• 临时解决办法:

*** Aborted at 1751265362 (unix time) try "date -d @1751265362" if you are using GNU date ***
PC: @          0x6e66f78 ra_portable_size_in_bytes
*** SIGSEGV (@0x0) received by PID 256450 (TID 0x7fa20e86c700) from PID 0; stack trace: ***
    @          0x67755a2 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7fa2458d7630 (unknown)
    @          0x6e66f78 ra_portable_size_in_bytes
    @          0x5900770 starrocks::BitmapValue::get_size_in_bytes()
    @          0x345d6d0 starrocks::ObjectColumn<>::byte_size()
    @          0x2bafdd3 starrocks::Column::memory_usage()
    @          0x3447f2b starrocks::NullableColumn::memory_usage()
    @          0x343c040 starrocks::Chunk::memory_usage()
    @          0x525bc68 starrocks::MemTable::insert()
    @          0x5251aa0 starrocks::DeltaWriter::write()
    @          0x51ccabc starrocks::AsyncDeltaWriter::_execute()
    @          0x68d82dc bthread::ExecutionQueueBase::_execute()
    @          0x68d9058 bthread::ExecutionQueueBase::_execute_tasks()
    @          0x2e79bdc starrocks::ThreadPool::dispatch_thread()
    @          0x2e7385a starrocks::Thread::supervise_thread()
    @     0x7fa2458cfea5 start_thread
    @     0x7fa244cd0b0d __clone
    @                0x0 (unknown)

• Github Issue:

• Github Fix PR: https://github.com/StarRocks/starrocks/pull/44167

• Jira

• 问题版本

  1. 2.5.0 ～ 2.5.20
  2. 3.0 ～ 3.0.9
  3. 3.1.0 ~ 3.1.10
  4. 3.2.0 ~ 3.2.7
  5. 3.3.0

• 修复版本

  1. 2.5.21+
  2. 3.0.10+
  3. 3.1.10+
  4. 3.3.1+

我的版本3.1.15 出现如下错误：
E0717 00:30:18.454006 4729 scan_operator.cpp:413] scan fragment 292df4c3-6262-11f0-93c0-a0369fd8ceda driver 0 Scan tasks error: Unknown code(48): : global dict greater than DICT_DECODE_MAX_SIZE
/build/starrocks/be/src/storage/meta_reader.cpp:179 _collect(_params->fields[i], _params->cids[i], (*dsts)[i], _params->field_type[i])
/build/starrocks/be/src/storage/meta_reader.cpp:79 _collect_context.seg_collecters[_collect_context.cursor_idx]->collect(&columns)
/build/starrocks/be/src/storage/olap_meta_reader.cpp:158 _read((*result).get(), chunk_capacity - chunk_start)

看本贴第一个说是3.1.15后修复了，感觉是没修复

请问下，295.LogMessageFatal这个问题有修复计划吗？按照临时解决办法设置ignore_load_tablet_failure = true，对数据会有什么影响吗，会出现数据丢失或者不一致吗@ LIANGCHAOHUA

老师好。
目前我们的版本 3.1.17-67ae3b7 的版本，
在调用udfs额时候 还是会出现这个问题。
未知错误 (1064, 'exception happened when get class: java.lang.OutOfMemoryError: Compressed class space[] backend

补充：bug 305的临时解决方法，把对应be上的tablet id进行set bad：
https://docs.starrocks.io/zh/docs/sql-reference/sql-statements/cluster-management/tablet_replica/ADMIN_SET_REPLICA_STATUS/

307. 使用 StarRocks 外表同步数据报错

get TableMeta failed from TNetworkAddress

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/30124

• Jira

• 问题版本:

  • 2.5.0 ~ 2.5.12

  • 3.1.0 ~ 3.1.2

• 修复版本:

  • 2.5.13+

  • 3.1.3+

• 问题原因:

• 临时解决办法:

308. SkewRule 导致性能慢或SlowLock

  "app//com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHiveScan(StatisticsCalculator.java:664)",
  "app//com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHiveScan(StatisticsCalculator.java:179)",
  "app//com.starrocks.sql.optimizer.operator.logical.LogicalHiveScanOperator.accept(LogicalHiveScanOperator.java:78)",
  "app//com.starrocks.sql.optimizer.statistics.StatisticsCalculator.estimatorStats(StatisticsCalculator.java:202)",
  "app//com.starrocks.sql.optimizer.Utils.calculateStatistics(Utils.java:815)",
  "app//com.starrocks.sql.optimizer.Utils.calculateStatistics(Utils.java:804)",
  "app//com.starrocks.sql.optimizer.Utils.calculateStatistics(Utils.java:804)",
  "app//com.starrocks.sql.optimizer.Optimizer.skewJoinOptimize(Optimizer.java:794)",
  "app//com.starrocks.sql.optimizer.Optimizer.logicalRuleRewrite(Optimizer.java:570)",
  "app//com.starrocks.sql.optimizer.Optimizer.rewriteAndValidatePlan(Optimizer.java:748)",
  "app//com.starrocks.sql.optimizer.Optimizer.optimizeByCost(Optimizer.java:248)",
  "app//com.starrocks.sql.optimizer.Optimizer.optimize(Optimizer.java:196)",
  "app//com.starrocks.sql.optimizer.Optimizer.optimize(Optimizer.java:172)",
  "app//com.starrocks.sql.InsertPlanner.buildExecPlan(InsertPlanner.java:517)",
  "app//com.starrocks.sql.InsertPlanner.plan(InsertPlanner.java:315)",
  "app//com.starrocks.sql.StatementPlanner.planInsertStmt(StatementPlanner.java:203)",
  "app//com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:141)",
  "app//com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:92)",
  "app//com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:578)",

• Github Issue:

• Github Fix PR:

• Jira

• 问题版本:

  • 所有版本

• 修复版本:

  • 未修复

• 问题原因:

• 临时解决办法:

  • Set global enable_stats_to_optimize_skew_join=false;

大佬 请问3.2.17版本什么时候发布

309. StarRocks写的Parquet文件，Hive读不了

Failed with exception java.io.IOException:org.apache.parquet.io.ParquetDecodingException: Can not read value at 0 in block -1 in file

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/43875

• Jira

• 问题版本:

  • 3.2.0~latest

  • 3.3.0~3.3.4

• 修复版本:

  • 3.2未修复

  • 3.3.5+

• 问题原因:

  • StarRocks写的是新版本的Parquet格式，Hive <=3.0 的版本识别不了

• 临时解决办法:

310. Morsel queue crash

*** SIGSEGV (@0xa0) received by PID 1328927 (TID 0x14f3e4c3a640) from PID 160; stack trace: ***
    @     0x14f509070ee8 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x99ee7)
    @          0xa37c049 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x14f509e7835d os::Linux::chained_handler(int, siginfo*, void*)
    @     0x14f509e7df5f JVM_handle_linux_signal
    @     0x14f509e6f968 signalHandler(int, siginfo*, void*)
    @     0x14f509019520 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x4251f)
    @          0x6d622bc starrocks::TabletReader::_to_seek_tuple(std::shared_ptr<starrocks::TabletSchema const> const&, starrocks::OlapTuple const&, starrocks::SeekTuple*, starrocks::MemPool*)
    @          0x6d62ebe starrocks::TabletReader::parse_seek_range(std::shared_ptr<starrocks::TabletSchema const> const&, starrocks::TabletReaderParams::RangeStartOperation, starrocks::TabletReaderParams::RangeEndOperation, std::vector<starrocks::OlapTuple, std::allocator<starrockP^Y
    @          0x758ae83 starrocks::pipeline::PhysicalSplitMorselQueue::_init_segment()
    @          0x758b46f starrocks::pipeline::PhysicalSplitMorselQueue::_try_get_split_from_single_tablet()
    @          0x758bd67 starrocks::pipeline::PhysicalSplitMorselQueue::try_get()
    @          0x7587e53 starrocks::pipeline::BucketSequenceMorselQueue::try_get()
    @          0x5456ace starrocks::pipeline::ScanOperator::_pickup_morsel(starrocks::RuntimeState*, int)
    @          0x54555bc starrocks::pipeline::ScanOperator::_try_to_trigger_next_scan(starrocks::RuntimeState*)
    @          0x545584a starrocks::pipeline::ScanOperator::pull_chunk(starrocks::RuntimeState*)
    @          0x544c8b8 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
    @          0x7ebce58 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x8c00b73 starrocks::ThreadPool::dispatch_thread()
    @          0x8bf81c9 starrocks::Thread::supervise_thread(void*)
    @     0x14f50906bac3 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x94ac2)
    @     0x14f5090fd850 (/usr/lib/x86_64-linux-gnu/libc.so.6+0x12684f)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/62034

• Jira

• 问题版本:

  • 3.3.0~3.3.17

  • 3.4.0~3.4.16

  • 3.5.0~3.5.4

• 修复版本:

  • 3.3.18+

  • 3.4.17+

  • 3.5.5+

• 问题原因:

• 临时解决办法:

  • set global enable_per_bucket_optimize = false

311. Arm parquet reader crash

*** SIGSEGV (@0x0) received by PID 28 (TID 0xfffea329fe00) LWP(602) from PID 0; stack trace: ***
    @     0xffffb81e25c4 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x825c3)
    @          0xf73dd28 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0xffffb989c850 ([vdso]+0x84f)
    @     0xffffb81f7bbc (/usr/lib/aarch64-linux-gnu/libc.so.6+0x97bbb)
    @          0xb350584 starrocks::parquet::Int32ToDateConverter::convert(starrocks::Cow<starrocks::Column>::ImmutPtr<starrocks::Column> const&, starrocks::Column*)
    @          0xb37c948 starrocks::parquet::StatisticsHelper::decode_value_into_column(starrocks::Cow<starrocks::Column>::MutPtr<starrocks::Column> const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::ba
    @          0xb29af2c starrocks::parquet::RawColumnReader::_row_group_zone_map_filter(std::vector<starrocks::ColumnPredicate const*, std::allocator<starrocks::ColumnPredicate const*> > const&, starrocks::CompoundNodeType, starrocks::TypeDescriptor const&, unsigned long, unsigne
    @          0xb29f114 starrocks::parquet::ScalarColumnReader::row_group_zone_map_filter(std::vector<starrocks::ColumnPredicate const*, std::allocator<starrocks::ColumnPredicate const*> > const&, starrocks::CompoundNodeType, unsigned long, unsigned long) const
    @          0xb254340 starrocks::StatusOr<std::optional<starrocks::SparseRange<unsigned long> > > starrocks::parquet::PredicateFilterEvaluator::visit_for_rowgroup_zonemap<(starrocks::CompoundNodeType)0>(starrocks::PredicateCompoundNode<(starrocks::CompoundNodeType)0> const&)
    @          0xb2573cc starrocks::StatusOr<std::optional<starrocks::SparseRange<unsigned long> > > starrocks::parquet::PredicateFilterEvaluator::operator()<(starrocks::CompoundNodeType)0>(starrocks::PredicateCompoundNode<(starrocks::CompoundNodeType)0> const&, starrocks::parquet
    @          0xb22ac94 starrocks::parquet::FileReader::_filter_group(std::shared_ptr<starrocks::parquet::GroupReader> const&)
    @          0xb22b3a8 starrocks::parquet::FileReader::_init_group_readers()
    @          0xb22c3ac starrocks::parquet::FileReader::init(starrocks::HdfsScannerContext*)
    @          0xab53f4c starrocks::HdfsParquetScanner::do_open(starrocks::RuntimeState*)
    @          0xaa038a8 starrocks::HdfsScanner::open(starrocks::RuntimeState*)
    @          0xa9de95c starrocks::connector::HiveDataSource::_init_scanner(starrocks::RuntimeState*)
    @          0xa9df6d8 starrocks::connector::HiveDataSource::open(starrocks::RuntimeState*)
    @          0xa9bcf88 starrocks::pipeline::ConnectorChunkSource::_open_data_source(starrocks::RuntimeState*, bool*)
    @          0xa9bd9fc starrocks::pipeline::ConnectorChunkSource::_read_chunk(starrocks::RuntimeState*, std::shared_ptr<starrocks::Chunk>*)
    @          0xa9c399c starrocks::pipeline::ChunkSource::buffer_next_batch_chunks_blocking(starrocks::RuntimeState*, unsigned long, starrocks::workgroup::WorkGroup const*)
    @          0xa299bf0 auto starrocks::pipeline::ScanOperator::_trigger_next_scan(starrocks::RuntimeState*, int)::{lambda(auto:1&)#1}::operator()<starrocks::workgroup::YieldContext>(starrocks::workgroup::YieldContext&) const [clone .constprop.0]
    @          0xa92c89c starrocks::workgroup::ScanExecutor::worker_thread()
    @          0xc411dc4 starrocks::ThreadPool::dispatch_thread()
    @          0xc408a68 starrocks::Thread::supervise_thread(void*)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/63294

• Jira

• 问题版本:

  • 3.3.0~3.3.19

  • 3.4.0~3.4.8

  • 3.5.0~3.5.5

  • 4.0.0

• 修复版本:

  • 3.3.20+

  • 3.4.9+

  • 3.5.6+

  • 4.0.1+

• 问题原因:

• 临时解决办法:

312. min_by/max_by 函数 crash

*** Aborted at 1754458860 (unix time) try "date -d @1754458860" if you are using GNU date ***
PC: @     0x7f0ee04d5711 __memcpy_ssse3_back
*** SIGSEGV (@0x7f0e74196ff1) received by PID 16389 (TID 0x7f0e5895e700) from PID 1947824113; stack trace: ***
    @     0x7f0ee107b20b __pthread_once_slow
    @          0x7dc3dc0 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x7f0ee1f0935d os::Linux::chained_handler(int, siginfo*, void*)
    @     0x7f0ee1f0ef5f JVM_handle_linux_signal
    @     0x7f0ee1f00968 signalHandler(int, siginfo*, void*)
    @     0x7f0ee1084630 (/usr/lib64/libpthread-2.17.so+0xf62f)
    @     0x7f0ee04d5711 __memcpy_ssse3_back
    @          0x4ce607d starrocks::AggregateFunctionBatchHelper<starrocks::MinByAggregateData<(starrocks::LogicalType)17, true, int>, starrocks::MaxMinByAggregateFunction<(starrocks::LogicalType)17, starrocks::MinByAggregateData<(starrocks::LogicalType)17, true, int>, starrocks::����
    @          0x46200dc starrocks::Aggregator::compute_batch_agg_states(starrocks::Chunk*, unsigned long)
    @          0x451ffcd starrocks::pipeline::AggregateBlockingSinkOperator::push_chunk(starrocks::RuntimeState*, std::shared_ptr<starrocks::Chunk> const&)
    @          0x452f3e1 starrocks::pipeline::BucketProcessSinkOperator::push_chunk(starrocks::RuntimeState*, std::shared_ptr<starrocks::Chunk> const&)
    @          0x44f49d4 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
    @          0x47b85e3 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x398e8e3 starrocks::ThreadPool::dispatch_thread()
    @          0x3985f66 starrocks::Thread::supervise_thread(void*)
    @     0x7f0ee107cea5 start_thread
    @     0x7f0ee047db0d __clone

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/61651

• Jira

• 问题版本:

  • 3.3.0~3.3.17

  • 3.4.0~3.4.6

  • 3.5.0~3.5.3

• 修复版本:

  • 3.3.18+

  • 3.4.7+

  • 3.5.4+

• 问题原因:

• 临时解决办法:

313. RecoverableStub crash

*** SIGABRT (@0x272000296e6) received by PID 169702 (TID 0x15162f6fb640) from PID 169702; stack trace: ***
    @     0x151dd468ee18 __pthread_once_slow
    @          0x7da2500 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x151dd463e6f0 (/usr/lib64/libc.so.6+0x3e6ef)
    @     0x151dd468b94c __pthread_kill_implementation
    @     0x151dd463e646 __GI_raise
    @     0x151dd46287f3 __GI_abort
    @          0x3328555 __gnu_cxx::__verbose_terminate_handler() [clone .cold]
    @          0xc480c56 __cxxabiv1::__terminate(void (*)())
    @          0xc480cc1 std::terminate()
    @          0xc48144f __cxa_pure_virtual
    @          0x3821545 starrocks::LocalTabletsChannel::_abort_replica_tablets(starrocks::PTabletWriterAddChunkRequest const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::unordered_map<long, std::vector<long, std::allocator<long> >X^S
    @          0x38237f0 starrocks::LocalTabletsChannel::add_chunk(starrocks::Chunk*, starrocks::PTabletWriterAddChunkRequest const&, starrocks::PTabletWriterAddBatchResult*)
    @          0x3815939 starrocks::LoadChannel::_add_chunk(starrocks::Chunk*, starrocks::PTabletWriterAddChunkRequest const&, starrocks::PTabletWriterAddBatchResult*)
    @          0x3816b2c starrocks::LoadChannel::add_chunks(starrocks::PTabletWriterAddChunksRequest const&, starrocks::PTabletWriterAddBatchResult*)
    @          0x38101c3 starrocks::LoadChannelMgr::add_chunks(starrocks::PTabletWriterAddChunksRequest const&, starrocks::PTabletWriterAddBatchResult*)
    @          0x38d163b starrocks::BackendInternalServiceImpl<starrocks::PInternalService>::tablet_writer_add_chunks(google::protobuf::RpcController*, starrocks::PTabletWriterAddChunksRequest const*, starrocks::PTabletWriterAddBatchResult*, google::protobuf::Closure*)
    @          0x802f2d4 brpc::policy::ProcessRpcRequest(brpc::InputMessageBase*)
    @          0x7f5b677 brpc::ProcessInputMessage(void*)
    @          0x7f5c9f5 brpc::InputMessenger::OnNewMessages(brpc::Socket*)
    @          0x7f4acee brpc::Socket::ProcessEvent(void*)
    @          0x7f1bd72 bthread::TaskGroup::task_runner(long)
    @          0x8071201 bthread_make_fcontext

• Github Issue:

  • https://github.com/StarRocks/starrocks/issues/59929

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/59933

• Jira

• 问题版本:

  • 3.2.0~3.2.16

  • 3.3.0~3.3.15

  • 3.4.0~3.4.4

  • 3.5.0

• 修复版本:

  • 3.2.17+

  • 3.3.16+

  • 3.4.5+

  • 3.5.1+

• 问题原因:

• 临时解决办法:

314. AggHashMapWithSerializedKey crash

*** SIGSEGV (@0x10) received by PID 61982 (TID 0x151907171640) LWP(66306) from PID 16; stack trace: ***
    @     0x1522e1c8ef38 __pthread_once_slow
    @          0xbed4e94 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0x1522e318c519 PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0]
    @     0x1522e318cf6e JVM_handle_linux_signal
    @     0x1522e1c3e730 (/usr/lib64/libc.so.6+0x3e72f)
    @          0x565de1e void starrocks::AggHashMapWithSerializedKey<phmap::flat_hash_map<starrocks::Slice, unsigned char*, starrocks::SliceHashWithSeed<(starrocks::PhmapSeed)0>, starrocks::SliceEqual, std::allocator<std::pair<starrocks::Slice const, unsigned char*> > > >::compute@
    @          0x5687d74 starrocks::Aggregator::build_hash_map_with_selection(unsigned long)
    @          0x54667fc starrocks::pipeline::AggregateStreamingSinkOperator::_push_chunk_by_selective_preaggregation(std::shared_ptr<starrocks::Chunk> const&, unsigned long, bool)
    @          0x54671f2 starrocks::pipeline::AggregateStreamingSinkOperator::_push_chunk_by_auto(std::shared_ptr<starrocks::Chunk> const&, unsigned long)
    @          0x54682d2 starrocks::pipeline::AggregateStreamingSinkOperator::push_chunk(starrocks::RuntimeState*, std::shared_ptr<starrocks::Chunk> const&)
    @          0x5426a49 starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
    @          0x58bfc71 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x45fee3f starrocks::ThreadPool::dispatch_thread()
    @          0x45f5c30 starrocks::Thread::supervise_thread(void*)
    @     0x1522e1c89d22 start_thread
    @     0x1522e1d0ed40 __clone3

• Github Issue:

  • https://github.com/StarRocks/starrocks/issues/64926

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/64973

• Jira

• 问题版本:

  • 3.5.0~3.5.8

• 修复版本:

  • 3.5.9+

• 问题原因:

• 临时解决办法:

  • 无