【概述】Kafka routine load 消费特别慢

为了更快的定位您的问题,请提供以下信息,谢谢
【详述】Kafka routine load 消费特别慢
【背景】routine load/kafka/ json
【业务影响】
【是否存算分离】否
【StarRocks版本】3.4.1
【集群规模】例如:3fe(3 follower)+37be(fe与be混部)
【机器信息】NA
【联系方式】gardonkoo@163.com
【附件】
plan_fragment_executor.cpp:492] Fragment 2e94eed9-8323-41a3-a97e-655575c48d3d:(Active: 21s767ms, non-child: 0.00%)

  • InstanceAllocatedMemoryUsage: 444.48 KB
  • InstanceDeallocatedMemoryUsage: 255.42 KB
  • InstancePeakMemoryUsage: 275.88 KB
  • MemoryLimit: 2.00 GB
  • RowsProduced: 1
    OlapTableSink:(Active: 54.056ms, non-child: 0.25%)
    • TxnID: 3323139
    • IndexNum: 1
    • ReplicatedStorage: true
    • AutomaticPartition: true
    • AutomaticBucketSize: 4294967296
    • DynamicOverwrite: false
    • AllocAutoIncrementTime: 210.000ns
    • CloseWaitTime: 22.114ms
    • OpenTime: 31.689ms
    • PrepareDataTime: 25.840us
      • ConvertChunkTime: 1.140us
      • ValidateDataTime: 2.390us
    • RowsFiltered: 0
    • RowsRead: 1
    • RowsReturned: 1
    • RpcClientSideTime: 243.417ms
    • RpcServerSideTime: 139.380ms
    • RpcServerWaitFlushTime: 0.000ns
    • SendDataTime: 331.433us
      • PackChunkTime: 18.481us
      • SendRpcTime: 1.233ms
        • CompressTime: 0.000ns
        • SerializeChunkTime: 12.320us
      • WaitResponseTime: 0.000ns
        FILE_SCAN_NODE (id=0):(Active: 21s744ms, non-child: 99.90%)
    • BytesRead: 0
    • IOTaskExecTime: 0.000ns
    • IOTaskWaitTime: 0.000ns
    • NumDiskAccess: 0
    • PeakMemoryUsage: 0
    • RowsRead: 0
    • RowsReturned: 1
    • RowsReturnedRate: 0
    • ScanTime: 21s744ms
    • ScannerQueueCounter: 1
    • ScannerQueueTime: 3.490us
    • ScannerThreadsInvoluntaryContextSwitches: 0
    • ScannerThreadsTotalWallClockTime: 0.000ns
      • MaterializeTupleTime(*): 0.000ns
      • ScannerThreadsSysTime: 0.000ns
      • ScannerThreadsUserTime: 0.000ns
    • ScannerThreadsVoluntaryContextSwitches: 0
    • TotalRawReadTime(*): 0.000ns
    • TotalReadThroughput: 0.00 /sec
      DataSource:
      • DataSourceType: FileDataSource
      • FileScanner: 0
        • CastChunkTime: 13.330us
        • CreateChunkTime: 34.610us
        • FileReadCount: 2
        • FileReadTime: 21s744ms
        • FillTime: 0.000ns
        • MaterializeTime: 61.850us
        • ReadTime: 0.000ns
      • ScannerTotalTime: 21s744ms