BE 的日志里面有大量的Bad segment file报错

为了更快的定位您的问题,请提供以下信息,谢谢
【详述】BE 的日志里面有大量的Bad segment file报错
【背景】做过哪些操作?
【业务影响】
【是否存算分离】否
【StarRocks版本】例如:3.1.54
【集群规模】例如:4fe(3 follower+ 1 observer)+ 18be(fe、be单独不熟)
【机器信息】CPU虚拟核/内存/网卡,例如:48C/64G/万兆
【联系方式】为了在解决问题过程中能及时联系到您获取一些日志信息,请补充下您的联系方式,例如:社区群4-明天或者邮箱 392348681@qq.com,谢谢
【附件】

  • be.WARNING
W0205 14:38:07.581591 149283 rowset.cpp:167] Fail to open /data/storage/data/180/10185/430336460/0200000018244d3ce2468cb9eec429bb4f15bc2d197cd583_0.dat: Corruption: Bad segment file /data/storage/data/180/10185/430336460/0200000018244d3ce2468cb9eec429bb         4f15bc2d197cd583_0.dat: file size 0 < 12
/build/starrocks/be/src/storage/rowset/segment.cpp:227 Segment::parse_segment_footer(read_file.get(), &footer, footer_length_hint, partial_rowset_footer)
/build/starrocks/be/src/storage/rowset/segment.cpp:80 segment->_open(footer_length_hint, partial_rowset_footer, true)
W0205 14:38:07.581655 149283 primary_index.cpp:949] load PrimaryIndex error: Corruption: Bad segment file /data/storage/data/180/10185/430336460/0200000018244d3ce2468cb9eec429bb4f15bc2d197cd583_0.dat: file size 0 < 12
/build/starrocks/be/src/storage/rowset/segment.cpp:227 Segment::parse_segment_footer(read_file.get(), &footer, footer_length_hint, partial_rowset_footer)
/build/starrocks/be/src/storage/rowset/segment.cpp:80 segment->_open(footer_length_hint, partial_rowset_footer, true)
/build/starrocks/be/src/storage/rowset/rowset.cpp:92 do_load()
/build/starrocks/be/src/storage/rowset/rowset.cpp:651 load() tablet:0 stack:
    @          0x44ef896  starrocks::PrimaryIndex::load()
    @          0x462669e  starrocks::UpdateManager::on_rowset_finished()
    @          0x4cd0ac7  starrocks::DeltaWriter::commit()
    @          0x59415ed  starrocks::AsyncDeltaWriter::_execute()
    @          0x64ecc4c  bthread::ExecutionQueueBase::_execute()
    @          0x64ed9c8  bthread::ExecutionQueueBase::_execute_tasks()
    @          0x4f836b2  starrocks::ThreadPool::dispatch_thread()
    @          0x4f7e14a  starrocks::Thread::supervise_thread()
    @     0x7f5e9f890402  (unknown)
    @     0x7f5e9f91f590  (unknown)
    @              (nil)  (unknown)
W0205 14:38:07.627609 149283 update_manager.cpp:532] load primary index error: Corruption: Bad segment file /data/storage/data/180/10185/430336460/0200000018244d3ce2468cb9eec429bb4f15bc2d197cd583_0.dat: file size 0 < 12
/build/starrocks/be/src/storage/rowset/segment.cpp:227 Segment::parse_segment_footer(read_file.get(), &footer, footer_length_hint, partial_rowset_footer)
/build/starrocks/be/src/storage/rowset/segment.cpp:80 segment->_open(footer_length_hint, partial_rowset_footer, true)
/build/starrocks/be/src/storage/rowset/rowset.cpp:92 do_load()
/build/starrocks/be/src/storage/rowset/rowset.cpp:651 load() tablet: 10185
W0205 14:38:07.627673 149283 async_delta_writer.cpp:54] Fail to write or commit. txn_id: 10812126 tablet_id: 10185: Corruption: Bad segment file /data/storage/data/180/10185/430336460/0200000018244d3ce2468cb9eec429bb4f15bc2d197cd583_0.dat: file size 0 <          12
/build/starrocks/be/src/storage/rowset/segment.cpp:227 Segment::parse_segment_footer(read_file.get(), &footer, footer_length_hint, partial_rowset_footer)
/build/starrocks/be/src/storage/rowset/segment.cpp:80 segment->_open(footer_length_hint, partial_rowset_footer, true)
/build/starrocks/be/src/storage/rowset/rowset.cpp:92 do_load()
/build/starrocks/be/src/storage/rowset/rowset.cpp:651 load()

W0205 14:40:02.656708 211318 engine_clone_task.cpp:985] remove tablet file:/data/storage/data/482/10193/430336460/020000000086d3140e456998dd68cc1a2ff5355a340404a0_0.dat failed, status:OK
W0205 14:40:02.656729 211318 engine_clone_task.cpp:985] remove tablet file:/data/storage/data/482/10193/430336460/020000000086d3150e456998dd68cc1a2ff5355a340404a0_0.dat failed, status:OK
W0205 14:40:02.656737 211318 engine_clone_task.cpp:985] remove tablet file:/data/storage/data/482/10193/430336460/0200000016c912b5e745e938d95710c1bffcab388d464b84_0.dat failed, status:OK
W0205 14:40:02.656745 211318 engine_clone_task.cpp:985] remove tablet file:/data/storage/data/482/10193/430336460/0200000016c92b76e745e938d95710c1bffcab388d464b84_0.dat failed, status:OK
W0205 14:40:02.656749 211318 tablet_updates.cpp:2117] remove_expired_versions failed, tablet updates is in error state: tablet:10193 _apply_rowset_commit error: load primary index failed: Corruption: Bad segment file /data/storage/data/482/10193/4303364         60/0200000018244d40e2468cb9eec429bb4f15bc2d197cd583_0.dat: file size 0 < 12
/build/starrocks/be/src/storage/rowset/segment.cpp:227 Segment::parse_segment_footer(read_file.get(), &footer, footer_length_hint, partial_rowset_footer)
/build/starrocks/be/src/storage/rowset/segment.cpp:80 segment->_open(footer_length_hint, partial_rowset_footer, true)
/build/starrocks/be/src/storage/rowset/rowset.cpp:92 do_load()
/build/starrocks/be/src/storage/rowset/rowset.cpp:651 load() tablet:10193 #version:11 [163974.1 163982@8 163984] pending: rowsets:11
  689 [seg:1 row:8779 del:29 bytes:15922349 compaction:252776087 partial_update_by_column:false]
  690 [seg:0 row:0 del:0 bytes:0 compaction:268435456 partial_update_by_column:false]
  691 [seg:1 row:7 del:0 bytes:4541 compaction:268430915 partial_update_by_column:false]
  692 [seg:1 row:5 del:0 bytes:3939 compaction:268431517 partial_update_by_column:false]
  693 [seg:1 row:17 del:0 bytes:40582 compaction:268394874 partial_update_by_column:false]
  694 [seg:0 row:0 del:0 bytes:0 compaction:268435456 partial_update_by_column:false]
  695 [seg:0 row:0 del:0 bytes:0 compaction:268435456 partial_update_by_column:false]
  696 [seg:0 row:0 del:0 bytes:0 compaction:268435456 partial_update_by_column:false]
  697 [seg:0 row:0 del:0 bytes:0 compaction:268435456 partial_update_by_column:false]
  698 [seg:1 row:2 del:0 bytes:13925 compaction:268421531 partial_update_by_column:false]
  699 [seg:0 row:0 del:0 bytes:0 compaction:268435456 partial_update_by_column:false]
W0205 14:40:02.659510 211318 engine_clone_task.cpp:348] Fail to clone tablet. tablet_id:10193, schema_hash:430336460, signature:10193, version:163984, expected_version: 164177
W0205 14:40:02.659531 211318 agent_task.cpp:359] clone failed. signature: 10193

磁盘故障了?

没有,磁盘正常的