为了更快的定位您的问题,请提供以下信息,谢谢
【详述】Kafka routine load 消费特别慢
【背景】routine load/kafka/ json
【业务影响】
【是否存算分离】否
【StarRocks版本】3.4.1
【集群规模】例如:3fe(3 follower)+37be(fe与be混部)
【机器信息】NA
【联系方式】gardonkoo@163.com
【附件】
plan_fragment_executor.cpp:492] Fragment 2e94eed9-8323-41a3-a97e-655575c48d3d:(Active: 21s767ms, non-child: 0.00%)
- InstanceAllocatedMemoryUsage: 444.48 KB
- InstanceDeallocatedMemoryUsage: 255.42 KB
- InstancePeakMemoryUsage: 275.88 KB
- MemoryLimit: 2.00 GB
- RowsProduced: 1
OlapTableSink:(Active: 54.056ms, non-child: 0.25%)- TxnID: 3323139
- IndexNum: 1
- ReplicatedStorage: true
- AutomaticPartition: true
- AutomaticBucketSize: 4294967296
- DynamicOverwrite: false
- AllocAutoIncrementTime: 210.000ns
- CloseWaitTime: 22.114ms
- OpenTime: 31.689ms
- PrepareDataTime: 25.840us
- ConvertChunkTime: 1.140us
- ValidateDataTime: 2.390us
- RowsFiltered: 0
- RowsRead: 1
- RowsReturned: 1
- RpcClientSideTime: 243.417ms
- RpcServerSideTime: 139.380ms
- RpcServerWaitFlushTime: 0.000ns
- SendDataTime: 331.433us
- PackChunkTime: 18.481us
- SendRpcTime: 1.233ms
- CompressTime: 0.000ns
- SerializeChunkTime: 12.320us
- WaitResponseTime: 0.000ns
FILE_SCAN_NODE (id=0):(Active: 21s744ms, non-child: 99.90%)
- BytesRead: 0
- IOTaskExecTime: 0.000ns
- IOTaskWaitTime: 0.000ns
- NumDiskAccess: 0
- PeakMemoryUsage: 0
- RowsRead: 0
- RowsReturned: 1
- RowsReturnedRate: 0
- ScanTime: 21s744ms
- ScannerQueueCounter: 1
- ScannerQueueTime: 3.490us
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0.000ns
- MaterializeTupleTime(*): 0.000ns
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 0.000ns
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawReadTime(*): 0.000ns
- TotalReadThroughput: 0.00 /sec
DataSource:- DataSourceType: FileDataSource
- FileScanner: 0
- CastChunkTime: 13.330us
- CreateChunkTime: 34.610us
- FileReadCount: 2
- FileReadTime: 21s744ms
- FillTime: 0.000ns
- MaterializeTime: 61.850us
- ReadTime: 0.000ns
- ScannerTotalTime: 21s744ms