常见 Crash / BUG / 优化 查询

236. Grouping Sets 导致BE报错或 crash

deserialize chunk data failed. column slot id: 86, column row count: 18446744073709551615, expected row count: 200. There is probably a bug here.

java.lang.RuntimeException: Runtime error: encode size does not equal when decoding, encode size = 4294967296, but decode get size = 1662, raw size = 2444.

*** Aborted at 1718758341 (unix time) try “date -d @1718758341” if you are using GNU date ***
PC: @ 0x8557ace svb_decode_avx_simple
*** SIGSEGV (@0x7fc28176c000) received by PID 27 (TID 0x7fc2f326a640) from PID 18446744071586627584; stack trace: ***
@ 0x7cfae6a google::(anonymous namespace)::FailureSignalHandler()
@ 0x7fc358cfe520 (unknown)
@ 0x8557ace svb_decode_avx_simple
@ 0x8557d21 streamvbyte_decode
@ 0x55619ff starrocks::serde::(anonymous namespace)::decode_integers<>()
@ 0x5563a5b starrocks::ColumnVisitorMutableAdapter<>::visit()
@ 0x3d1001d starrocks::ColumnFactory<>::accept_mutable()
@ 0x55669ea starrocks::serde::ColumnArraySerde::deserialize()
@ 0x5566ccf starrocks::ColumnVisitorMutableAdapter<>::visit()
@ 0x3d638dd starrocks::ColumnFactory<>::accept_mutable()
@ 0x55669ea starrocks::serde::ColumnArraySerde::deserialize()
@ 0x5566c83 starrocks::ColumnVisitorMutableAdapter<>::visit()
@ 0x3d6561d starrocks::ColumnFactory<>::accept_mutable()
@ 0x55669ea starrocks::serde::ColumnArraySerde::deserialize()
@ 0x65620ba starrocks::serde::ProtobufChunkDeserializer::deserialize()
@ 0x662074b starrocks::DataStreamRecvr::SenderQueue::_deserialize_chunk()
@ 0x66249c7 starrocks::DataStreamRecvr::PipelineSenderQueue::get_chunk()
@ 0x66179d6 starrocks::DataStreamRecvr::get_chunk_for_pipeline()
@ 0x60a9493 starrocks::pipeline::ExchangeSourceOperator::pull_chunk()
@ 0x5c7e4d0 starrocks::pipeline::PipelineDriver::process()
@ 0x6508830 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
@ 0x68ac92c starrocks::ThreadPool::dispatch_thread()
@ 0x68a5d6a starrocks::thread::supervise_thread()
@ 0x7fc358d50ac3 (unknown)
@ 0x7fc358de2850 (unknown)
@ 0x0 (unknown)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/48765

• Jira

• 问题版本:

  • 3.1.0 ～ 3.1.14

  • 3.2.0 ～ 3.2.9

  • 3.3.0 ～ 3.3.1

• 修复版本:

  • 3.1.15+

  • 3.2.10+

  • 3.3.2+

• 问题原因:

• 临时解决办法:

237. SchemaChange 期间，查询会导致 BE crash

*** Aborted at 1721960790 (unix time) try "date -d @1721960790" if you are using GNU date ***
PC: @          0x36f80c0 starrocks::FixedLengthColumnBase<>::put_mysql_row_buffer()
*** SIGSEGV (@0x0) received by PID 2097 (TID 0x7f51f17a9700) from PID 0; stack trace: ***
    @          0xa15ccd2 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7f5288b0a630 (unknown)
    @          0x36f80c0 starrocks::FixedLengthColumnBase<>::put_mysql_row_buffer()
    @          0x402e593 starrocks::StructColumn::put_mysql_row_buffer()
    @          0x6bcf7fc starrocks::MysqlResultWriter::process_chunk()
    @          0x440111d starrocks::pipeline::ResultSinkOperator::push_chunk()
    @          0x449e552 starrocks::pipeline::PipelineDriver::process()
    @          0x448e1bd starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x39c247c starrocks::ThreadPool::dispatch_thread()
    @          0x39bc14a starrocks::Thread::supervise_thread()
    @     0x7f5288b02ea5 start_thread
    @     0x7f5287cedb0d __clone
    @                0x0 (unknown)

*** Aborted at 1721942589 (unix time) try "date -d @1721942589" if you are using GNU date ***
PC: @     0x7f167d532d10 __memmove_ssse3_back
*** SIGSEGV (@0x0) received by PID 2765 (TID 0x7f160564e700) from PID 0; stack trace: ***
    @          0xa15ccd2 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7f167f16154f os::Linux::chained_handler()
    @     0x7f167f1673b8 JVM_handle_linux_signal
    @     0x7f167f158db8 signalHandler()
    @     0x7f167e2f1630 (unknown)
    @     0x7f167d532d10 __memmove_ssse3_back
    @          0x36fcff8 starrocks::FixedLengthColumnBase<>::append()
    @          0x400e456 starrocks::NullableColumn::append()
    @          0x402d9e6 starrocks::StructColumn::append()
    @          0x400e46e starrocks::NullableColumn::append()
    @          0x3fecd42 starrocks::Chunk::append()
    @          0x62b6311 starrocks::ChunkPipelineAccumulator::push()
    @          0x45185fc starrocks::pipeline::ChunkAccumulateOperator::push_chunk()
    @          0x449e552 starrocks::pipeline::PipelineDriver::process()
    @          0x448e1bd starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x39c247c starrocks::ThreadPool::dispatch_thread()
    @          0x39bc14a starrocks::Thread::supervise_thread()
    @     0x7f167e2e9ea5 start_thread
    @     0x7f167d4d4b0d __clone
    @                0x0 (unknown)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49355

• Jira

• 问题版本:

  • 3.2.0 ～ 3.2.9

  • 3.3.0 ～ 3.3.1

• 修复版本:

  • 3.2.10+

  • 3.3.2+

• 问题原因:

• 临时解决办法:

238. Change user null pointer

2024-06-11 11:19:24.834+08:00 WARN (starrocks-mysql-nio-pool-1739|29976) [ReadListener.lambda$handleEvent$0():81] Exception happened in one session(com.starrocks.mysql.nio.NConnectContext@159c7d69).
java.nio.BufferUnderflowException: null
        at java.nio.Buffer.nextGetIndex(Buffer.java:643) ~[?:?]
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:165) ~[?:?]
        at com.starrocks.mysql.MysqlProto.readByte(MysqlProto.java:312) ~[starrocks-fe.jar:?]
        at com.starrocks.mysql.MysqlProto.readInt1(MysqlProto.java:316) ~[starrocks-fe.jar:?]
        at com.starrocks.mysql.MysqlProto.readVInt(MysqlProto.java:342) ~[starrocks-fe.jar:?]
        at com.starrocks.mysql.MysqlProto.readLenEncodedString(MysqlProto.java:375) ~[starrocks-fe.jar:?]
        at com.starrocks.mysql.MysqlChangeUserPacket.readFrom(MysqlChangeUserPacket.java:88) ~[starrocks-fe.jar:?]
        at com.starrocks.mysql.MysqlProto.changeUser(MysqlProto.java:263) ~[starrocks-fe.jar:?]
        at com.starrocks.qe.ConnectProcessor.handleChangeUser(ConnectProcessor.java:139) ~[starrocks-fe.jar:?]
        at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:507) ~[starrocks-fe.jar:?]
        at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:799) ~[starrocks-fe.jar:?]
        at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
        at java.lang.Thread.run(Thread.java:829) ~[?:?]

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/47796

• Jira

• 问题版本:

  • 3.1.0 ~ 3.1.13

  • 3.2.0 ~ 3.2.8

  • 3.3.0

• 修复版本:

  • 3.1.14+

  • 3.2.9+

  • 3.3.1+

• 问题原因:

• 临时解决办法:

239. Parquet json 类型导入报错

Vectorized engine does not support the operator, cast from VARBINARY to ARRAY failed, maybe use switch function backend

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49385

• Jira

• 问题版本:

  • 3.2.0 ～ 3.2.9

  • 3.3.0 ～ 3.3.2

• 修复版本:

  • 3.2.10+

  • 3.3.3+

• 问题原因:

• 临时解决办法:

240. 获取统计信息，生成大量 Union ALL，导致BE内存占用过高

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/44671

• Jira

• 问题版本:

  • 3.1.0 ~ 3.1.11

  • 3.2.0 ~ 3.2.4

• 修复版本:

  • 3.1.12+

  • 3.2.5+

• 问题原因:

• 临时解决办法:

241. 物化视图 crash

F0814 15:02:13.101240 32573 column_aggregate_func.cpp:379] Check failed: false unreachable path, unknown key column type: 22

*** Aborted at 1722929720 (unix time) try "date -d @1722929720" if you are using GNU date ***
PC: @     0x2aeb1af3d207 __GI_raise
*** SIGABRT (@0xa132) received by PID 41266 (TID 0x2afe8f136700) from PID 41266; stack trace: ***
    @          0x6538582 google::(anonymous namespace)::FailureSignalHandler()
    @     0x2aeb1a3d35d0 (unknown)
    @     0x2aeb1af3d207 __GI_raise
    @     0x2aeb1af3e8f8 __GI_abort
    @          0x2a6413e starrocks::failure_function()
    @          0x652bf5d google::LogMessage::Fail()
    @          0x652e3cf google::LogMessage::SendToLog()
    @          0x652baae google::LogMessage::Flush()
    @          0x652e9d9 google::LogMessageFatal::~LogMessageFatal()
    @          0x55edab2 starrocks::ColumnAggregatorFactory::create_key_column_aggregator()
    @          0x501a5a9 starrocks::ChunkAggregator::ChunkAggregator()
    @          0x5482b6f starrocks::AggregateIterator::init_encoded_schema()
    @          0x5005c71 starrocks::TabletReader::_init_collector()
    @          0x5006fc9 starrocks::TabletReader::open()
    @          0x4fea4a7 starrocks::SchemaChangeHandler::_do_process_alter_tablet_normal()
    @          0x4fec53b starrocks::SchemaChangeHandler::_do_process_alter_tablet()
    @          0x4fed22a starrocks::SchemaChangeHandler::process_alter_tablet()
    @          0x4f7eafa starrocks::EngineAlterTabletTask::execute()
    @          0x4e2d0ae starrocks::StorageEngine::execute_task()
    @          0x3280b30 starrocks::run_alter_tablet_task()
    @          0x2d0b99c starrocks::ThreadPool::dispatch_thread()
    @          0x2d0564a starrocks::Thread::supervise_thread()
    @     0x2aeb1a3cbdd5 start_thread

*** Aborted at 1723618933 (unix time) try “date -d @1723618933” if you are using GNU date ***
PC: @ 0x7fedbeafa387 __GI_raise
*** SIGABRT (@0x7e5a) received by PID 32346 (TID 0x7fed94ff0700) from PID 32346; stack trace: ***
@ 0x63bc462 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7fedbf7c9630 (unknown)
@ 0x7fedbeafa387 __GI_raise
@ 0x7fedbeafba78 __GI_abort
@ 0x2a274de starrocks::failure_function()
@ 0x63afe3d google::LogMessage::Fail()
@ 0x63b22af google::LogMessage::SendToLog()
@ 0x63af98e google::LogMessage::Flush()
@ 0x63b28b9 google::LogMessageFatal::~LogMessageFatal()
@ 0x4cdf972 starrocks::create_value_aggregator()
@ 0x4ce01c1 starrocks::ColumnAggregatorFactory::create_value_column_aggregator()
@ 0x4763261 starrocks::ChunkAggregator::ChunkAggregator()
@ 0x4764765 starrocks::MemTable::_init_aggregator_if_needed()
@ 0x47649e5 starrocks::MemTable::MemTable()
@ 0x4cf0b3b starrocks::DeltaWriter::_reset_mem_table()
@ 0x4cf23e9 starrocks::DeltaWriter::write()
@ 0x59681e7 starrocks::AsyncDeltaWriter::_execute()
@ 0x6517eec bthread::ExecutionQueueBase::_execute()
@ 0x6518c68 bthread::ExecutionQueueBase::_execute_tasks()
@ 0x4fa7de2 starrocks::ThreadPool::dispatch_thread()
@ 0x4fa287a starrocks:
:supervise_thread()
@ 0x7fedbf7c1ea5 start_thread
@ 0x7fedbebc2b0d __clone
@ 0x0 (unknown)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49528

• Jira

• 问题版本:

  • 3.1.0 ~ 3.1.14

  • 3.2.0 ~ 3.2.9

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.1.15+

  • 3.2.10+

  • 3.3.3+

• 问题原因:

• 临时解决办法:

242. Temp 分区 replace 报错，并且导致 FE 无法启动

 com.starrocks.journal.JournalInconsistentException: failed to load journal type 210
        at com.starrocks.persist.EditLog.loadJournal(EditLog.java:1195)
        at com.starrocks.server.GlobalStateMgr.replayJournalInner(GlobalStateMgr.java:1879)
        at com.starrocks.server.GlobalStateMgr.replayJournal(GlobalStateMgr.java:1828)
        at com.starrocks.server.GlobalStateMgr.transferToLeader(GlobalStateMgr.java:1190)
        at com.starrocks.server.GlobalStateMgr$1.transferToLeader(GlobalStateMgr.java:732)
        at com.starrocks.ha.StateChangeExecutor.runOneCycle(StateChangeExecutor.java:103)
        at com.starrocks.common.util.Daemon.run(Daemon.java:107)
Caused by: java.lang.NullPointerException
        at com.starrocks.catalog.CatalogUtils.checkTempPartitionConflict(CatalogUtils.java:217)
        at com.starrocks.catalog.OlapTable.replaceTempPartitions(OlapTable.java:2644)
        at com.starrocks.server.LocalMetastore.replayReplaceTempPartition(LocalMetastore.java:4724)
        at com.starrocks.persist.EditLog.loadJournal(EditLog.java:834)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49764

• Jira

• 问题版本:

  • 3.1.0 ~ 3.1.14

  • 3.2.0 ~ 3.2.10

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.1.15+

  • 3.2.11+

  • 3.3.3+

• 问题原因:

• 临时解决办法:

243. 使用 StarRocks 外表，会将其它集群的 BE 加入当前集群

会导致导入报错

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49323

• Jira

• 问题版本:

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.3.3+

• 问题原因:

• 临时解决办法:

  • 重启 FE

244. Load 内存持续增长不释放

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49761

• Jira

• 问题版本:

  • 3.1.0 ~ 3.1.14

  • 3.2.0 ~ 3.2.10

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.1.15+

  • 3.2.11+

  • 3.3.3+

• 问题原因:

• 临时解决办法:

245. 主键模型 load_delete crash

*** SIGABRT (@0x8a5c) received by PID 35420 (TID 0x7f93fa5f7700) from PID 35420; stack trace: ***
    @          0x77e7a52 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7f96429345f0 (unknown)
    @     0x7f964258d337 __GI_raise
    @     0x7f964258ea28 __GI_abort
    @          0x34ed0ee starrocks::failure_function()
    @          0x77db42d google::LogMessage::Fail()
    @          0x77dd89f google::LogMessage::SendToLog()
    @          0x77daf7e google::LogMessage::Flush()
    @          0x77ddea9 google::LogMessageFatal::~LogMessageFatal()
    @          0x79ba804 brpc::BaiduStreamingLogHandler()
    @          0x7b4068a google::protobuf::internal::LogMessage::Finish()
    @          0x7b7eaf0 google::protobuf::RepeatedPtrField<>::Get()
    @          0x61349f6 starrocks::lake::RowsetUpdateState::load_delete()
    @          0x6124377 starrocks::lake::UpdateManager::publish_primary_key_tablet()
    @          0x6163c61 starrocks::lake::PrimaryKeyTxnLogApplier::apply_write_log()

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49550

• Jira

• 问题版本:

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.3.3+

• 问题原因:

• 临时解决办法:

246. Nest-Loop-Join crash

*** Aborted at 1724088138 (unix time) try "date -d @1724088138" if you are using GNU date ***
PC: @     0x7f059e043895 __memmove_avx_unaligned_erms
*** SIGSEGV (@0x0) received by PID 1351 (TID 0x7f0472519700) from PID 0; stack trace: ***
    @          0x67ec202 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7f059ec5fc20 (unknown)
    @     0x7f059e043895 __memmove_avx_unaligned_erms
    @          0x2c3f594 std::vector<>::_M_range_insert<>()
    @          0x2c43014 starrocks::BinaryColumnBase<>::append()
    @          0x347fe0e starrocks::NullableColumn::append()
    @          0x3464ba2 starrocks::Chunk::append()
    @          0x51e4000 starrocks::ChunkAccumulator::push()
    @          0x38331f1 starrocks::pipeline::NLJoinBuildChunkStreamBuilder::init()
    @          0x38334a7 starrocks::pipeline::NLJoinContext::finish_one_right_sinker()
    @          0x383bc1a starrocks::pipeline::NLJoinBuildOperator::set_finishing()
    @          0x3889f8b starrocks::pipeline::PipelineDriver::_mark_operator_finishing()
    @          0x388a099 starrocks::pipeline::PipelineDriver::_mark_operator_finished()
    @          0x388a69b starrocks::pipeline::PipelineDriver::_mark_operator_cancelled()
    @          0x388acba starrocks::pipeline::PipelineDriver::cancel_operators()
    @          0x387dc3b starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x2e896ac starrocks::ThreadPool::dispatch_thread()
    @          0x2e8332a starrocks::Thread::supervise_thread()
    @     0x7f059ec5517a start_thread
    @     0x7f059dfdfdc3 __GI___clone
    @                0x0 (unknown)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/50045

• Jira

• 问题版本:

  • 3.1.0 ~ 3.1.14

  • 3.2.0 ~ 3.2.10

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.1.15+

  • 3.2.11+

  • 3.3.3+

• 问题原因:

• 临时解决办法:

247. 窗口函数 crash

*** Aborted at 1724033491 (unix time) try "date -d @1724033491" if you are using GNU date ***
PC: @          0x2e22a51 starrocks::Analytor::current_chunk_size()
*** SIGSEGV (@0x0) received by PID 37179 (TID 0x2b2444db8700) from PID 0; stack trace: ***
    @          0x5c30f02 google::(anonymous namespace)::FailureSignalHandler()
    @     0x2b23aa3aa630 (unknown)
    @          0x2e22a51 starrocks::Analytor::current_chunk_size()
    @          0x30e3b0f starrocks::pipeline::AnalyticSinkOperator::_process_by_partition_if_necessary_for_unbounded_preceding_range_frame_streaming()
    @          0x30e3209 starrocks::pipeline::AnalyticSinkOperator::set_finishing()
    @          0x2db6969 starrocks::pipeline::PipelineDriver::_mark_operator_finishing()
    @          0x2db6a19 starrocks::pipeline::PipelineDriver::_mark_operator_finished()
    @          0x2db700b starrocks::pipeline::PipelineDriver::_mark_operator_cancelled()
    @          0x2db75fa starrocks::pipeline::PipelineDriver::cancel_operators()
    @          0x5206ef6 starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x4be8fe2 starrocks::ThreadPool::dispatch_thread()
    @          0x4be3a7a starrocks::Thread::supervise_thread()
    @     0x2b23aa3a2ea5 start_thread
    @     0x2b23aadc3b0d __clone
    @                0x0 (unknown)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/28125

• Jira

• 问题版本:

  • 2.5.0 ~ 2.5.22

  • 3.0.0 ~ latest

  • 3.1.0

• 修复版本:

  • 2.5.23+

  • 3.1.1+

• 问题原因:

• 临时解决办法:

248. Invalid TType

W0805 16:55:14.940848  1227 thrift_rpc_helper.cpp:86] call frontend service failed, address=TNetworkAddress(=****/), port=9020), reason=invalid TType

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49619

  • https://github.com/StarRocks/starrocks/pull/50276

• Jira

• 问题版本:

  • 3.0.0 ～ 3.0.9

  • 3.1.0 ～ 3.1.14

  • 3.2.0 ～ 3.2.10

  • 3.3.0 ～ 3.3.3

• 修复版本:

  • 3.0.10+

  • 3.1.15+

  • 3.2.11+

  • 3.3.4+

• 问题原因:

• 临时解决办法:

248. log_error 死锁，导致频繁打 cancel 日志，CPU高

query_pool 内存不释放

5 tids: 814,817,819,825,833
         0x7e6ea98  starrocks::RuntimeState::log_error(starrocks::Status const&)
         0x7eaf680  starrocks::pipeline::ExchangeSinkOperator::set_finishing(starrocks::RuntimeState*)
         0x550130c  starrocks::pipeline::PipelineDriver::_mark_operator_finishing(std::shared_ptr<starrocks::pipeline::Operator>&, starrocks::RuntimeState*)
         0x5502ce8  starrocks::pipeline::PipelineDriver::process(starrocks::RuntimeState*, int)
         0x7e4e6e8  starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
         0x81649ec  starrocks::ThreadPool::dispatch_thread()
         0x815dc5c  starrocks::Thread::supervise_thread(void*)
    0xffff838fd5c8  (/usr/lib/aarch64-linux-gnu/libc.so.6+0x7d5c8)
    0xffff83965edc  (/usr/lib/aarch64-linux-gnu/libc.so.6+0xe5edc)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/50379

• Jira

• 问题版本:

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.3.3+

• 问题原因:

• 临时解决办法:

249. Having 未处理导致查询结果不对

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/47241

• Jira

• 问题版本:

  • 3.0.0 ~ 3.0.9

  • 3.1.0 ~ 3.1.13

  • 3.2.0 ~ 3.2.8

  • 3.3.0

• 修复版本:

  • 3.0.10+

  • 3.1.14+

  • 3.2.9+

  • 3.3.1+

• 问题原因:

• 临时解决办法:

250. 升级后 broker load 性能下降

3762×1394 469 KB

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/50058

• Jira

• 问题版本:

  • 3.1.14

  • 3.2.9~3.2.10

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.1.15+

  • 3.2.11+

  • 3.3.3+

• 问题原因:

• 临时解决办法:

251. Spill crash

@ 0xffffa79b25d4 (/usr/lib/aarch64-linux-gnu/libc.so.6+0x825d3)
@ 0x94841f8 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
@ 0xffffa8e24850 ([vdso]+0x84f)
@ 0x55802ec starrocks::spill::LogBlockContainer::append_data(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long)
@ 0x5585554 starrocks::spill::LogBlock::append(std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&)
@ 0x56f5938 starrocks::spill::BlockSpillOutputDataStream::append(starrocks::RuntimeState*, std::vector<starrocks::Slice, std::allocatorstarrocks::Slice > const&, unsigned long, unsigned long)
@ 0x56ebc0c starrocks::spill::ColumnarSerde::serialize(starrocks::RuntimeState*, starrocks::spill::SerdeContext&, std::shared_ptrstarrocks::Chunk const&, std::shared_ptrstarrocks::spill::SpillOutputDataStream const&, bool)
@ 0x56c6dc8 starrocks::spill::UnorderedMemTable::finalize(starrocks::workgroup::YieldContext&, std::shared_ptrstarrocks::spill::SpillOutputDataStream const&)
@ 0x56bd814 starrocks::spill::PartitionedSpillerWriter::spill_partition(starrocks::workgroup::YieldContext&, starrocks::spill::SerdeContext&, starrocks::spill::SpilledPartition*)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/50207

• Jira

• 问题版本:

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.3.3+

• 问题原因:

• 临时解决办法:

252. 频繁触发低基数收集报错

偶尔出现这种日志是正常的，频繁出现是不正常的

WARN (ForkJoinPool.commonPool-worker-5|209) [DefaultCoordinator.getNext():786] query failed:     global dict greater than DICT_DECODE_MAX_SIZE

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/48938

• Jira

• 问题版本:

  • 3.1.0 ～ 3.1.14

  • 3.2.0 ～ 3.2.10

  • 3.3.0 ～ 3.3.1

• 修复版本:

  • 3.1.15+

  • 3.2.11+

  • 3.3.2+

• 问题原因:

• 临时解决办法:

253. CN 使用华为 obs crash

F0715 03:28:20.325001 1906116 vacuum.cpp:555] Duplicate files were returned from the remote storage. The most likely cause is an S3 or HDFS API compatibility issue with your remote storage implementation. duplicate file: staros://1969195/meta/00000000001E0C2B_000000000000118D.meta
*** Check failure stack trace: ***

*** Aborted at 1720985300 (unix time) try "date -d @1720985300" if you are using GNU date ***
PC: @     0x7f82783e124f (unknown)
*** SIGABRT (@0x7d000220f0e) received by PID 2232078 (TID 0x7f7e66dfe640) from PID 2232078; stack trace: ***
    @          0x653d562 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7f82783951f0 (unknown)
    @     0x7f82783e124f (unknown)
    @     0x7f8278395146 raise
    @     0x7f82783804f7 abort
    @          0x2a6487e starrocks::failure_function()
    @          0x6530f3d google::LogMessage::Fail()
    @          0x65333af google::LogMessage::SendToLog()
    @          0x6530a8e google::LogMessage::Flush()
    @          0x65339b9 google::LogMessageFatal::~LogMessageFatal()
    @          0x50a3439 _ZNSt17_Function_handlerIFbSt17basic_string_viewIcSt11char_traitsIcEEEZN9starrocks4lake19delete_tablets_implEPNS6_13TabletManagerERKNSt7__cxx1112basic_stringIcS2_SaIcEEERKSt6vectorIlSaIlEEEUlS3_E0_E9_M_invokeERKSt9_Any_dataOS3_
    @          0x4cf5276 _ZNSt17_Function_handlerIFbN6staros7starlet5fslib9EntryStatEEZN9starrocks17StarletFileSystem11iterate_dirERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKSt8functionIFbSt17basic_string_viewIcSA_EEEEUlS3_E_E9_M_invokeERKSt9_Any_dataOS3_
    @          0x5cec1c5 _ZN6staros7starlet5fslib12S3FileSystem8list_dirESt17basic_string_viewIcSt11char_traitsIcEES6_S6_bSt10shared_ptrIN3Aws2S38S3ClientEESt8functionIFbNS1_9EntryStatEEE.localalias
    @          0x5cec713 staros::starlet::fslib::S3FileSystem::list_dir()
    @          0x5cfdfcf staros::starlet::fslib::CacheFileSystemImpl::list_dir()
    @          0x5cfc765 staros::starlet::fslib::CacheFileSystem::list_dir()
    @          0x4cf9ea2 starrocks::StarletFileSystem::iterate_dir()
    @          0x509fbbf starrocks::lake::delete_tablets_impl()
    @          0x50a1227 starrocks::lake::delete_tablets()
    @          0x2c653ce _ZNSt17_Function_handlerIFvvEZN9starrocks15LakeServiceImpl13delete_tabletEPN6google8protobuf13RpcControllerEPKNS1_4lake19DeleteTabletRequestEPNS7_20DeleteTabletResponseEPNS4_7ClosureEEUlvE_E9_M_invokeERKSt9_Any_data
    @          0x2d0d64c starrocks::ThreadPool::dispatch_thread()
    @          0x2d072fa starrocks::Thread::supervise_thread()
    @     0x7f82783df67a (unknown)
    @     0x7f82784625e0 (unknown)
    @                0x0 (unknown)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/49103

• Jira

• 问题版本:

  • 3.1.0 ~ 3.1.14

• 修复版本:

  • 3.1.15+

• 问题原因:

• 解决办法:

  • 升级到支应的 fix 版本并配置 be.conf s3_use_list_objects_v1 = true

254. Pipeline driver crash

*** Aborted at 1718853165 (unix time) try "date -d @1718853165" if you are using GNU date ***
PC: @          0x4fcb438 starrocks::serde::(anonymous namespace)::read_raw()
*** SIGSEGV (@0x0) received by PID 49583 (TID 0x7f7b8404d700) from PID 0; stack trace: ***
    @          0x67c6d22 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7f7d53d1005b os::Linux::chained_handler()
    @     0x7f7d53d1512b JVM_handle_linux_signal
    @     0x7f7d53d088c8 signalHandler()
    @     0x7f7d52ea35d0 (unknown)
    @          0x4fcb438 starrocks::serde::(anonymous namespace)::read_raw()
    @          0x4fd1187 starrocks::ColumnVisitorMutableAdapter<>::visit()
    @          0x2ba8b1c starrocks::ColumnFactory<>::accept_mutable()
    @          0x4fd08f8 starrocks::serde::ColumnArraySerde::deserialize()
    @          0x4fd0b6d starrocks::ColumnVisitorMutableAdapter<>::visit()
    @          0x345e00c starrocks::ColumnFactory<>::accept_mutable()
    @          0x4fd08f8 starrocks::serde::ColumnArraySerde::deserialize()
    @          0x4fd380a starrocks::serde::ProtobufChunkDeserializer::deserialize()
    @          0x2da5660 starrocks::DataStreamRecvr::SenderQueue::_deserialize_chunk()
    @          0x2daa08d starrocks::DataStreamRecvr::PipelineSenderQueue::get_chunk()
    @          0x2d7c593 starrocks::DataStreamRecvr::get_chunk_for_pipeline()
    @          0x37a44aa starrocks::pipeline::ExchangeSourceOperator::pull_chunk()
    @          0x3868146 starrocks::pipeline::PipelineDriver::process()
    @          0x385a70e starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x2e7d84c starrocks::ThreadPool::dispatch_thread()
    @          0x2e774ca starrocks::Thread::supervise_thread()
    @     0x7f7d52e9bdd5 start_thread
    @     0x7f7d5229dead __clone
    @                0x0 (unknown)

*** Aborted at 1721870966 (unix time) try "date -d @1721870966" if you are using GNU date ***
PC: @          0x2c3cfd8 starrocks::BinaryColumnBase<>::append_selective()
*** SIGSEGV (@0x100000006) received by PID 167194 (TID 0x7f8171b25700) from PID 6; stack trace: ***
    @          0x67c6d22 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7f832aa0ce9b os::Linux::chained_handler()
    @     0x7f832aa11a5d JVM_handle_linux_signal
    @     0x7f832aa04858 signalHandler()
    @     0x7f8329eec5d0 (unknown)
    @          0x2c3cfd8 starrocks::BinaryColumnBase<>::append_selective()
    @          0x345d9dd starrocks::NullableColumn::append_selective()
    @          0x344219a starrocks::Chunk::append_selective()
    @          0x3aee96b starrocks::pipeline::ExchangeSinkOperator::Channel::add_rows_selective()
    @          0x3aefe75 starrocks::pipeline::ExchangeSinkOperator::push_chunk()
    @          0x3868b53 starrocks::pipeline::PipelineDriver::process()
    @          0x385a70e starrocks::pipeline::GlobalDriverExecutor::_worker_thread()
    @          0x2e7d84c starrocks::ThreadPool::dispatch_thread()
    @          0x2e774ca starrocks::Thread::supervise_thread()
    @     0x7f8329ee4dd5 start_thread
    @     0x7f83292e6ead __clone
    @                0x0 (unknown)

• Github Issue:

• Github Fix PR:

  • https://github.com/StarRocks/starrocks/pull/50099

• Jira

• 问题版本:

  • 3.2.0 ~ 3.2.10

  • 3.3.0 ~ 3.3.2

• 修复版本:

  • 3.2.11+

  • 3.3.3+

• 问题原因:

• 解决办法: