be 节点意外停止 Fail to open fragment 585eb406-2a13-11ed-9ef7-32811fe6eb6b: Internal error: [10.18.2.3] fail to prepare tablet reader 42388.41071906.a0496db67495204b-0b58f595e9616c8b: Unknown code(45):

sr 3个节点物理服务器,每个节点都部署be和fe,其中一个节点be在9月2日00:34意外停止早上9:50分钟左右手动拉起,be当时日志如下,当时有大数据插入工作。是否是导入压力太大导致?

0902 00:33:54.684520 119151 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=49336 highest_score=11
I0902 00:33:54.684690 119151 compaction.cpp:158] start cumulative compaction. tablet=49336, output version is=3696-3706, max rows per segment=1, segment iterator num=0, algorithm=horizontal, column group size=0, columns per group=5
I0902 00:33:54.685420 119151 compaction.cpp:210] succeed to do cumulative compaction. tablet=49336, output_version=3696-3706, input infos [segments=0, rows=0, disk size=0], output infos [segments=0, rows=0, disk size=0]. elapsed time=0.000829s.
I0902 00:33:54.757800 119151 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=16189 highest_score=4
I0902 00:33:54.856137 119152 tablet_updates.cpp:1102] commit compaction tablet:46084 version:65857.1 rowset:101388 #seg:29 #row:104097 size:19.70 MB #pending:0 state_memory:3.97 MB
I0902 00:33:54.856295 227380 tablet_updates.cpp:1128] apply_compaction_commit start tablet:46084 version:65857.1 rowset:101388
I0902 00:33:54.904855 227380 tablet_updates.cpp:1224] apply_compaction_commit finish tablet:46084 version:65857.1 total del/row:270332/2247897 12% rowset:101388 #row:104097 #del:0 #delvec:29 duration:49ms(1/48/0)
I0902 00:33:55.401445 119150 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=42432 highest_score=3
I0902 00:33:55.842986 119151 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=44195 highest_score=10
I0902 00:33:55.843197 119151 compaction.cpp:158] start cumulative compaction. tablet=44195, output version is=3267-3275, max rows per segment=1, segment iterator num=0, algorithm=horizontal, column group size=0, columns per group=5
I0902 00:33:55.844002 119151 compaction.cpp:210] succeed to do cumulative compaction. tablet=44195, output_version=3267-3275, input infos [segments=0, rows=0, disk size=0], output infos [segments=0, rows=0, disk size=0]. elapsed time=0.000936s.
I0902 00:33:55.916668 119151 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=16221 highest_score=4
I0902 00:33:56.483693 119150 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=42496 highest_score=3
W0902 00:33:56.637324 119057 version_graph.cpp:388] fail to find path in version_graph. spec_version: 0-2515
W0902 00:33:56.637385 119057 tablet.cpp:472] tablet:42388.41071906.a0496db67495204b-0b58f595e9616c8b, version already has been merged. spec_version: [0-2515]
W0902 00:33:56.637408 119057 tablet_scanner.cpp:64] [10.221.22.187] fail to prepare tablet reader 42388.41071906.a0496db67495204b-0b58f595e9616c8b: Unknown code(45): :
/root/starrocks/be/src/storage/tablet.cpp:516 capture_consistent_versions(spec_version, &version_path)
E0902 00:33:56.637421 119057 olap_scan_node.cpp:97] Failed to start scan node: Internal error: [] fail to prepare tablet reader 42388.41071906.a0496db67495204b-0b58f595e9616c8b: Unknown code(45): :
/root/starrocks/be/src/storage/tablet.cpp:516 capture_consistent_versions(spec_version, &version_path)
/root/starrocks/be/src/exec/vectorized/olap_scan_node.cpp:519 scanner->init(state, scanner_params)
/root/starrocks/be/src/exec/vectorized/olap_scan_node.cpp:369 _start_scan_thread(state)
W0902 00:33:56.637442 119057 plan_fragment_executor.cpp:188] fail to open fragment, instance_id=585eb406-2a13-11ed-9ef7-32811fe6eb6b, status=Internal error: [10.221.22.187] fail to prepare tablet reader 42388.41071906.a0496db67495204b-0b58f595e9616c8b: Unknown code(45): :
/root/starrocks/be/src/storage/tablet.cpp:516 capture_consistent_versions(spec_version, &version_path)
/root/starrocks/be/src/exec/vectorized/olap_scan_node.cpp:519 scanner->init(state, scanner_params)
/root/starrocks/be/src/exec/vectorized/olap_scan_node.cpp:369 _start_scan_thread(state)
/root/starrocks/be/src/exec/vectorized/hash_join_node.cpp:562 child(0)->get_next(state, &_cur_left_input_chunk, &_probe_eos)
/root/starrocks/be/src/exec/vectorized/hash_join_node.cpp:288 _probe(state, probe_timer, chunk, tmp_eos)
/root/starrocks/be/src/exec/vectorized/project_node.cpp:122 _children[0]->get_next(state, chunk, eos)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:329 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:217 _get_next_internal_vectorized(&chunk)
I0902 00:33:56.648581 119238 internal_service.cpp:232] cancel fragment, fragment_instance_id=585eb406-2a13-11ed-9ef7-32811fe6eb6e, reason: InternalError
W0902 00:33:56.651572 119057 fragment_mgr.cpp:195] Fail to open fragment 585eb406-2a13-11ed-9ef7-32811fe6eb6b: Internal error: [10.221.22.187] fail to prepare tablet reader 42388.41071906.a0496db67495204b-0b58f595e9616c8b: Unknown code(45): :
/root/starrocks/be/src/storage/tablet.cpp:516 capture_consistent_versions(spec_version, &version_path)
/root/starrocks/be/src/exec/vectorized/olap_scan_node.cpp:519 scanner->init(state, scanner_params)
/root/starrocks/be/src/exec/vectorized/olap_scan_node.cpp:369 _start_scan_thread(state)
/root/starrocks/be/src/exec/vectorized/hash_join_node.cpp:562 child(0)->get_next(state, &_cur_left_input_chunk, &_probe_eos)
/root/starrocks/be/src/exec/vectorized/hash_join_node.cpp:288 _probe(state, probe_timer, chunk, tmp_eos)
/root/starrocks/be/src/exec/vectorized/project_node.cpp:122 _children[0]->get_next(state, chunk, eos)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:329 _plan->get_next(_runtime_state, &_chunk, &_done)
/root/starrocks/be/src/runtime/plan_fragment_executor.cpp:217 _get_next_internal_vectorized(&chunk)
I0902 00:33:56.653810 119057 plan_fragment_executor.cpp:450] Fragment 585eb406-2a13-11ed-9ef7-32811fe6eb6b:(Active: 3m47s, non-child: 0.00%)

  • AverageThreadTokens: 1.00
  • MemoryLimit: 40.00 GB
  • PeakMemoryUsage: 1.38 GB
  • RowsProduced: 0
    DataStreamSender (dst_id=5, dst_fragments=[585eb4062a1311ed-9ef732811fe6eb70]):(Active: 444.915us, non-child: 0.00%)
    • PartType: UNPARTITIONED
    • BytesSent: 0
    • CompressTime: 0.000ns
    • IgnoreRows: 0
    • OverallThroughput: 0.00 /sec
    • SendRequestTime: 85.718us
    • SerializeBatchTime: 0.000ns
    • ShuffleDispatchTime: 0.000ns
    • ShuffleHashTime: 0.000ns
    • UncompressedBytes: 0
    • WaitResponseTime: 295.434us
      PROJECT_NODE (id=4):(Active: 3m47s, non-child: 0.00%)
    • CommonSubExprComputeTime: 0.000ns
    • ExprComputeTime: 0.000ns
    • PeakMemoryUsage: 0
    • RowsReturned: 0
    • RowsReturnedRate: 0
      HASH_JOIN_NODE (id=3):(Active: 3m47s, non-child: 0.91%)
      • JoinPredicates: 6: personnel_id = 18: resident_id
      • JoinType: LeftOuterJoin
      • AvgInputProbeChunkSize: 0
      • AvgOutputChunkSize: 0
      • BuildBuckets: 8.39M
      • BuildRows: 6.97M
      • BuildTime: 2s065ms
        • 1-CopyRightTableChunkTime: 1s520ms
        • 2-BuildHashTableTime: 515.379ms
        • 3-BuildPushDownExprTime: 1.431us
        • 4-BuildConjunctEvaluateTime: 14.520us
      • PeakMemoryUsage: 1.19 GB
      • ProbeRows: 0
      • ProbeTime: 30.197us
        • 1-MergeInputChunkTimer: 0.000ns
        • 2-SearchHashTableTimer: 0.000ns
        • 3-OutputBuildColumnTimer: 0.000ns
        • 4-OutputProbeColumnTimer: 0.000ns
        • 5-OutputTupleColumnTimer: 0.000ns
        • 6-ProbeConjunctEvaluateTime: 0.000ns
        • 7-OtherJoinConjunctEvaluateTime: 0.000ns
        • 8-WhereConjunctEvaluateTime: 0.000ns
      • PushDownExprNum: 0
      • RowsReturned: 0
      • RowsReturnedRate: 0
        EXCHANGE_NODE (id=2):(Active: 3m45s, non-child: 99.09%)
        • BytesPassThrough: 0
        • BytesReceived: 482.75 MB
        • DecompressRowBatchTimer: 716.697ms
        • DeserializeRowBatchTimer: 347.013ms
        • PeakMemoryUsage: 0
        • RequestReceived: 1.68 KB
        • RowsReturned: 6.97M
        • RowsReturnedRate: 30.93 K/sec
        • SenderTotalTime: 1s089ms
        • SenderWaitLockTime: 897.211us
          OLAP_SCAN_NODE (id=0):(Active: 12.294ms, non-child: 0.01%)
        • Table: ods_neptune_fact_access
        • Rollup: ods_neptune_fact_access
        • Predicates: CAST(1: record_date AS VARCHAR(1048576)) = ‘20220901’, 14: picture_url != ‘’
        • BytesRead: 0
        • ExprFilterTime: 0.000ns
        • IOTaskCount : 119
        • NumDiskAccess: 0
        • PeakMemoryUsage: 0
        • RowsRead: 0
        • RowsReturned: 0
        • RowsReturnedRate: 0
        • ScanConcurrency : 0
        • ScanTime: 0.000ns
        • ScannerThreadsInvoluntaryContextSwitches: 0
        • ScannerThreadsTotalWallClockTime: 0.000ns
          • MaterializeTupleTime(*): 0.000ns
          • ScannerThreadsSysTime: 0.000ns
          • ScannerThreadsUserTime: 0.000ns
        • ScannerThreadsVoluntaryContextSwitches: 0
        • TabletCount : 138
        • TotalRawReadTime(*): 0.000ns
        • TotalReadThroughput: 0.00 /sec
          SCAN:
          • CachedPagesNum: 0
          • CompressedBytesRead: 0
          • CreateSegmentIter: 0.000ns
          • IOTime: 0.000ns
          • PushdownPredicates: 1
          • RawRowsRead: 0
          • ReadPagesNum: 0
          • SegmentInit: 0.000ns
            • BitmapIndexFilter: 0.000ns
            • BitmapIndexFilterRows: 0
            • BloomFilterFilterRows: 0
            • SegmentZoneMapFilterRows: 0
            • ShortKeyFilterRows: 0
            • ZoneMapIndexFilterRows: 0
          • SegmentRead: 0.000ns
            • BlockFetch: 0.000ns
            • BlockFetchCount: 0
            • BlockSeek: 0.000ns
            • BlockSeekCount: 0
            • ChunkCopy: 0.000ns
            • DecompressT: 0.000ns
            • DelVecFilterRows: 0
            • IndexLoad: 0.000ns
            • PredFilter: 0.000ns
            • PredFilterRows: 0
            • RowsetsReadCount: 373
            • SegmentsReadCount: 0
            • TotalColumnsDataPageCount: 0
          • UncompressedBytesRead: 0
            I0902 00:33:57.016579 119151 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=44163 highest_score=10
            I0902 00:33:57.016793 119151 compaction.cpp:158] start cumulative compaction. tablet=44163, output version is=3267-3275, max rows per segment=1, segment iterator num=0, algorithm=horizontal, column group size=0, columns per group=5
            I0902 00:33:57.017592 119151 compaction.cpp:210] succeed to do cumulative compaction. tablet=44163, output_version=3267-3275, input infos [segments=0, rows=0, disk size=0], output infos [segments=0, rows=0, disk size=0]. elapsed time=0.000933s.
            I0902 00:33:57.092180 119151 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=20574 highest_score=4
            I0902 00:33:57.299005 118752 daemon.cpp:85] Released 14681088 bytes from column pool
            I0902 00:33:57.586817 119150 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=16032 highest_score=3
            I0902 00:33:58.192242 119151 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=44227 highest_score=10
            I0902 00:33:58.192438 119151 compaction.cpp:158] start cumulative compaction. tablet=44227, output version is=3267-3275, max rows per segment=1, segment iterator num=0, algorithm=horizontal, column group size=0, columns per group=5
            I0902 00:33:58.193177 119151 compaction.cpp:210] succeed to do cumulative compaction. tablet=44227, output_version=3267-3275, input infos [segments=0, rows=0, disk size=0], output infos [segments=0, rows=0, disk size=0]. elapsed time=0.000869s.
            I0902 00:33:58.267710 119151 tablet_manager.cpp:598] Found the best tablet to compact. compaction_type=cumulative tablet_id=47457 highest_score=3
            I0902 00:33:58.404950 118898 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44243 rowsetid: 020000002cbed644e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.404994 118898 delta_writer.cpp:305] Closed delta writer. tablet_id=44243 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.405140 118897 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44247 rowsetid: 020000002cbed645e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.405179 118897 delta_writer.cpp:305] Closed delta writer. tablet_id=44247 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.405297 118900 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44251 rowsetid: 020000002cbed646e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.405331 118900 delta_writer.cpp:305] Closed delta writer. tablet_id=44251 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.405450 118903 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44239 rowsetid: 020000002cbed643e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.405498 118903 delta_writer.cpp:305] Closed delta writer. tablet_id=44239 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.405616 33364 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44227 rowsetid: 020000002cbed640e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.405647 33364 delta_writer.cpp:305] Closed delta writer. tablet_id=44227 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.405738 33359 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44235 rowsetid: 020000002cbed642e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.405776 33359 delta_writer.cpp:305] Closed delta writer. tablet_id=44235 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.405890 33361 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44219 rowsetid: 020000002cbed63ee94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.405943 33361 delta_writer.cpp:305] Closed delta writer. tablet_id=44219 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406039 118899 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44207 rowsetid: 020000002cbed63be94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.406076 118899 delta_writer.cpp:305] Closed delta writer. tablet_id=44207 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406199 33363 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44215 rowsetid: 020000002cbed63de94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.406232 33363 delta_writer.cpp:305] Closed delta writer. tablet_id=44215 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406314 118902 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44223 rowsetid: 020000002cbed63fe94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.406363 118902 delta_writer.cpp:305] Closed delta writer. tablet_id=44223 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406450 33362 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44199 rowsetid: 020000002cbed639e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.406487 33362 delta_writer.cpp:305] Closed delta writer. tablet_id=44199 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406554 33366 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44203 rowsetid: 020000002cbed63ae94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.406586 33366 delta_writer.cpp:305] Closed delta writer. tablet_id=44203 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406661 33367 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44195 rowsetid: 020000002cbed638e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.406700 33367 delta_writer.cpp:305] Closed delta writer. tablet_id=44195 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406785 118901 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44231 rowsetid: 020000002cbed641e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.406821 118901 delta_writer.cpp:305] Closed delta writer. tablet_id=44231 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406889 118898 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44191 rowsetid: 020000002cbed637e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.406913 118898 delta_writer.cpp:305] Closed delta writer. tablet_id=44191 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.406993 33360 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44211 rowsetid: 020000002cbed63ce94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407032 33360 delta_writer.cpp:305] Closed delta writer. tablet_id=44211 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407106 118897 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44187 rowsetid: 020000002cbed636e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407130 118897 delta_writer.cpp:305] Closed delta writer. tablet_id=44187 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407186 118900 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44183 rowsetid: 020000002cbed635e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407207 118900 delta_writer.cpp:305] Closed delta writer. tablet_id=44183 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407263 118903 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44179 rowsetid: 020000002cbed634e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407306 118903 delta_writer.cpp:305] Closed delta writer. tablet_id=44179 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407378 33364 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44171 rowsetid: 020000002cbed632e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407404 33364 delta_writer.cpp:305] Closed delta writer. tablet_id=44171 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407456 33359 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44167 rowsetid: 020000002cbed631e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407480 33359 delta_writer.cpp:305] Closed delta writer. tablet_id=44167 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407543 33361 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44163 rowsetid: 020000002cbed630e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407567 33361 delta_writer.cpp:305] Closed delta writer. tablet_id=44163 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407624 118899 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44159 rowsetid: 020000002cbed62fe94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407646 118899 delta_writer.cpp:305] Closed delta writer. tablet_id=44159 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407696 33363 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44155 rowsetid: 020000002cbed62ee94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407721 33363 delta_writer.cpp:305] Closed delta writer. tablet_id=44155 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407759 118902 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44151 rowsetid: 020000002cbed62de94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407780 118902 delta_writer.cpp:305] Closed delta writer. tablet_id=44151 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407821 33362 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44147 rowsetid: 020000002cbed62ce94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407845 33362 delta_writer.cpp:305] Closed delta writer. tablet_id=44147 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407888 33366 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44143 rowsetid: 020000002cbed62be94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407913 33366 delta_writer.cpp:305] Closed delta writer. tablet_id=44143 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.407963 33367 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44139 rowsetid: 020000002cbed62ae94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.407984 33367 delta_writer.cpp:305] Closed delta writer. tablet_id=44139 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.408020 118901 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44135 rowsetid: 020000002cbed629e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.408039 118901 delta_writer.cpp:305] Closed delta writer. tablet_id=44135 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.408079 118898 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44131 rowsetid: 020000002cbed628e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.408100 118898 delta_writer.cpp:305] Closed delta writer. tablet_id=44131 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 00:33:58.408175 33360 txn_manager.cpp:208] committed transaction partition_id: 42587 transaction_id: 2469035 tablet: 44127 rowsetid: 020000002cbed627e94a3d664f442a13b2af2b58f66c6eb7 version: 0
            I0902 00:33:58.408195 33360 delta_writer.cpp:305] Closed delta writer. tablet_id=44127 stats=(flush time(ms)=0, flush count=1), flush flush_size_bytes = 0
            I0902 09:52:18.902487 172576 daemon.cpp:253] version 2.1.6 RELEASE (build d44c230)
            Built on 2022-05-09 19:24:54 by None@0271e465eca8
            I0902 09:52:19.502169 172576 mem_info.cpp:78] Physical Memory: 251.38 GB
            I0902 09:52:19.502238 172576 daemon.cpp:259] Cpu Info:
            Model: Intel® Xeon® Silver 4210 CPU @ 2.20GHz
            Cores: 40
            Max Possible Cores: 40
            L1 Cache: 32.00 KB (Line: 64.00 B)
            L2 Cache: 1.00 MB (Line: 64.00 B)
            L3 Cache: 13.75 MB (Line: 64.00 B)
            Hardware Supports:
            ssse3
            sse4_1
            sse4_2
            popcnt
            avx
            avx2
            Numa Nodes: 2
            Numa Nodes of Cores: 0->0 | 1->0 | 2->0 | 3->0 | 4->0 | 5->0 | 6->0 | 7->0 | 8->0 | 9->0 | 10->1 | 11->1 | 12->1 | 13->1 | 14->1 | 15->1 | 16->1 | 17->1 | 18->1 | 19->1 | 20->0 | 21->0 | 22->0 | 23->0 | 24->0 | 25->0 | 26->0 | 27->0 | 28->0 | 29->0 | 30->1 | 31->1 | 32->1 | 33->1 | 34->1 | 35->1 | 36->1 | 37->1 | 38->1 | 39->1 |
            I0902 09:52:19.502333 172576 daemon.cpp:260] Disk Info:
            Num disks 11: sda, sdb, sdc, sdd, sde, sdf, sdg, sdh, sdi, sdj, dm-
            I0902 09:52:19.502372 172576 daemon.cpp:261] Mem Info: 251.38 GB
            I0902 09:52:19.526053 172576 daemon.cpp:240] Minidump is disabled
            I0902 09:52:19.526093 172576 backend_options.cpp:92] priority cidrs in conf: 10.221.22.187/24
            I0902 09:52:19.528589 172576 backend_options.cpp:80] local host ip=10.221.22.187
            I0902 09:52:19.532021 172576 storage_engine.cpp:82] Opening storage engine using uid=5d420051e1a7a7a4-1d8d26b96d86cb94

看看什么版本,还有be out的内容

StarRocks version 2.1.6

[root@wsccsd3 be]# more be.out
start time: Thu Jul 14 18:50:32 CST 2022
start time: Thu Jul 14 19:22:18 CST 2022
start time: Thu Jul 14 19:24:14 CST 2022
start time: Thu Jul 14 19:37:30 CST 2022
start time: Thu Jul 14 19:44:27 CST 2022
*** Aborted at 1662050036 (unix time) try “date -d @1662050036” if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGSEGV (@0x0) received by PID 118747 (TID 0x7f334db49700) from PID 0; stack trace: ***
@ 0x3544aa2 google::(anonymous namespace)::FailureSignalHandler()
@ 0x7f33aac825d0 (unknown)
@ 0x0 (unknown)
start time: Fri Sep 2 09:52:18 CST 2022

核心日志报错是
I0902 00:33:56.648581 119238 internal_service.cpp:232] cancel fragment, fragment_instance_id=585eb406-2a13-11ed-9ef7-32811fe6eb6e, reason: InternalError
W0902 00:33:56.651572 119057 fragment_mgr.cpp:195] Fail to open fragment 585eb406-2a13-11ed-9ef7-32811fe6eb6b: Internal error: [192.168.22.3] fail to prepare tablet reader 42388.41071906.a0496db67495204b-0b58f595e9616c8b: Unknown code(45):