数据库数据查询速度异常

jietao6818 · 2025年02月12日 01:34

[详述】数据查询速度异常
export.tar (49.3 MB)

jietao6818 · 2025年02月12日 03:35

Query:
Summary:
- Query ID: bdc7f294-e8ef-11ef-9933-02424fb97f64
- Start Time: 2025-02-12 11:16:25
- End Time: 2025-02-12 11:31:38
- Total: 15m13s
- Query Type: Query
- Query State: Finished
- StarRocks Version: 3.2.6-2585333
- User: root
- Default Db: YODA_YMS
- Sql Statement: /* ApplicationName=DBeaver 22.1.4 - SQLEditor <Script-34.sql> */ SELECT * FROM YODA_USER WHERE account = ‘admin’
LIMIT 0, 20000
- Variables: parallel_fragment_exec_instance_num=1,max_parallel_scan_instance_num=-1,pipeline_dop=0,enable_adaptive_sink_dop=true,enable_runtime_adaptive_dop=false,runtime_profile_report_interval=5
- NonDefaultSessionVariables: {“sql_mode_v2”:{“defaultValue”:32,“actualValue”:2097184},“character_set_results”:{“defaultValue”:“utf8”,“actualValue”:“NULL”},“query_timeout”:{“defaultValue”:300,“actualValue”:30000},“disable_join_reorder”:{“defaultValue”:false,“actualValue”:true},“enable_adaptive_sink_dop”:{“defaultValue”:false,“actualValue”:true},“runtime_profile_report_interval”:{“defaultValue”:10,“actualValue”:5},“enable_profile”:{“defaultValue”:false,“actualValue”:true}}
- Collect Profile Time: 5ms
- IsProfileAsync: true
Planner:
- – Total[1] 15m13s
- – Analyzer[1] 0
- – Transformer[1] 0
- – Optimizer[1] 0
- – preprocessMvs[1] 0
- – chooseCandidates[1] 0
- – generateMvPlan[1] 0
- – validateMv[1] 0
- – mvWithView[1] 0
- – RuleBaseOptimize[1] 0
- – CostBaseOptimize[1] 0
- – PhysicalRewrite[1] 0
- – PlanValidate[1] 0
- – InputDependenciesChecker[1] 0
- – TypeChecker[1] 0
- – CTEUniqueChecker[1] 0
- – ColumnReuseChecker[1] 0
- – ExecPlanBuild[1] 0
- – Pending[1] 0
- – Prepare[1] 0
- – Deploy[1] 5ms
- – DeployLockInternalTime[1] 5ms
- – DeploySerializeConcurrencyTime[2] 0
- – DeployStageByStageTime[6] 0
- – DeployWaitTime[6] 4ms
- – DeployAsyncSendTime[2] 0
- DeployDataSize: 5572
Execution:
- Topology: {“rootId”:1,“nodes”:[{“id”:1,“name”:“EXCHANGE”,“properties”:{“sinkIds”:[],“displayMem”:true},“children”:[0]},{“id”:0,“name”:“OLAP_SCAN”,“properties”:{“sinkIds”:[1],“displayMem”:false},“children”:[]}]}
- FrontendProfileMergeTime: 1.149ms
- QueryAllocatedMemoryUsage: 1.334 MB
- QueryCumulativeCpuTime: 649.871us
- QueryCumulativeNetworkTime: 302.642us
- QueryCumulativeOperatorTime: 1.878ms
- QueryCumulativeScanTime: 430.814us
- QueryDeallocatedMemoryUsage: 936.266 KB
- QueryExecutionWallTime: 7.916ms
- QueryPeakMemoryUsage: 903.516 KB
- QueryPeakScheduleTime: 241.789us
- QuerySpillBytes: 0.000 B
- ResultDeliverTime: 0ns
Fragment 0:
- BackendAddresses: 10.216.7.214:9060
- InstanceIds: bdc7f294-e8ef-11ef-9933-02424fb97f65
- BackendNum: 1
- BackendProfileMergeTime: 1.617ms
- FragmentInstancePrepareTime: 557.088us
- prepare-fragment-ctx: 10.955us
- prepare-pipeline-driver: 78.140us
- prepare-query-ctx: 8.784us
- prepare-runtime-state: 78.140us
- InitialProcessDriverCount: 0
- InitialProcessMem: 13.402 GB
- InstanceAllocatedMemoryUsage: 475.914 KB
- InstanceDeallocatedMemoryUsage: 122.789 KB
- InstanceNum: 1
- InstancePeakMemoryUsage: 353.125 KB
- QueryMemoryLimit: -1.000 B
Pipeline (id=0):
- ActiveTime: 14.235us
- __MAX_OF_ActiveTime: 97.973us
- __MIN_OF_ActiveTime: 5.207us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 16
- DriverPrepareTime: 111.678us
- __MAX_OF_DriverPrepareTime: 450.267us
- __MIN_OF_DriverPrepareTime: 75.311us
- DriverTotalTime: 3.535ms
- __MAX_OF_DriverTotalTime: 3.621ms
- __MIN_OF_DriverTotalTime: 3.476ms
- OverheadTime: 423ns
- __MAX_OF_OverheadTime: 6.778us
- __MIN_OF_OverheadTime: 0ns
- PeakDriverQueueSize: 120
- __MAX_OF_PeakDriverQueueSize: 15
- __MIN_OF_PeakDriverQueueSize: 0
- PendingTime: 3.346ms
- __MAX_OF_PendingTime: 3.360ms
- __MIN_OF_PendingTime: 3.344ms
- InputEmptyTime: 3.346ms
- __MAX_OF_InputEmptyTime: 3.361ms
- __MIN_OF_InputEmptyTime: 3.343ms
- FirstInputEmptyTime: 3.346ms
- __MAX_OF_FirstInputEmptyTime: 3.361ms
- __MIN_OF_FirstInputEmptyTime: 3.343ms
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 16
- __MAX_OF_ScheduleCount: 1
- __MIN_OF_ScheduleCount: 1
- ScheduleTime: 175.275us
- __MAX_OF_ScheduleTime: 241.789us
- __MIN_OF_ScheduleTime: 115.243us
- TotalDegreeOfParallelism: 16
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
RESULT_SINK (plan_node_id=-1):
CommonMetrics:
- IsFinalSink
- CloseTime: 6.390us
- __MAX_OF_CloseTime: 9.896us
- __MIN_OF_CloseTime: 4.334us
- OperatorAllocatedMemoryUsage: 15.695 KB
- OperatorDeallocatedMemoryUsage: 7.336 KB
- OperatorPeakMemoryUsage: 8.359 KB
- OperatorTotalTime: 9.836us
- __MAX_OF_OperatorTotalTime: 57.079us
- __MIN_OF_OperatorTotalTime: 4.554us
- PrepareTime: 16.481us
- __MAX_OF_PrepareTime: 23.486us
- __MIN_OF_PrepareTime: 12.454us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1
- __MAX_OF_PushChunkNum: 1
- __MIN_OF_PushChunkNum: 0
- PushRowNum: 1
- __MAX_OF_PushRowNum: 1
- __MIN_OF_PushRowNum: 0
- PushTotalTime: 3.245us
- __MAX_OF_PushTotalTime: 51.922us
- __MIN_OF_PushTotalTime: 0ns
- SetFinishedTime: 31ns
- __MAX_OF_SetFinishedTime: 43ns
- __MIN_OF_SetFinishedTime: 23ns
- SetFinishingTime: 170ns
- __MAX_OF_SetFinishingTime: 567ns
- __MIN_OF_SetFinishingTime: 35ns
UniqueMetrics:
result sink:
- AppendChunkTime: 600ns
- __MAX_OF_AppendChunkTime: 9.601us
- __MIN_OF_AppendChunkTime: 0ns
- ResultRendTime: 2.540us
- __MAX_OF_ResultRendTime: 40.653us
- __MIN_OF_ResultRendTime: 0ns
- TupleConvertTime: 207ns
- __MAX_OF_TupleConvertTime: 3.312us
- __MIN_OF_TupleConvertTime: 0ns
- NumSentRows: 1
- __MAX_OF_NumSentRows: 1
- __MIN_OF_NumSentRows: 0
CHUNK_ACCUMULATE (plan_node_id=-1):
CommonMetrics:
- IsSubordinate
- CloseTime: 325ns
- __MAX_OF_CloseTime: 804ns
- __MIN_OF_CloseTime: 176ns
- OperatorTotalTime: 767ns
- __MAX_OF_OperatorTotalTime: 2.285us
- __MIN_OF_OperatorTotalTime: 296ns
- PrepareTime: 10.275us
- __MAX_OF_PrepareTime: 16.062us
- __MIN_OF_PrepareTime: 7.603us
- PullChunkNum: 1
- __MAX_OF_PullChunkNum: 1
- __MIN_OF_PullChunkNum: 0
- PullRowNum: 1
- __MAX_OF_PullRowNum: 1
- __MIN_OF_PullRowNum: 0
- PullTotalTime: 4ns
- __MAX_OF_PullTotalTime: 79ns
- __MIN_OF_PullTotalTime: 0ns
- PushChunkNum: 1
- __MAX_OF_PushChunkNum: 1
- __MIN_OF_PushChunkNum: 0
- PushRowNum: 1
- __MAX_OF_PushRowNum: 1
- __MIN_OF_PushRowNum: 0
- PushTotalTime: 102ns
- __MAX_OF_PushTotalTime: 1.643us
- __MIN_OF_PushTotalTime: 0ns
- SetFinishedTime: 99ns
- __MAX_OF_SetFinishedTime: 167ns
- __MIN_OF_SetFinishedTime: 58ns
- SetFinishingTime: 235ns
- __MAX_OF_SetFinishingTime: 418ns
- __MIN_OF_SetFinishingTime: 41ns
UniqueMetrics:
LIMIT (plan_node_id=1):
CommonMetrics:
- CloseTime: 5.541us
- __MAX_OF_CloseTime: 6.977us
- __MIN_OF_CloseTime: 3.955us
- OperatorAllocatedMemoryUsage: 46.734 KB
- OperatorDeallocatedMemoryUsage: 14.500 KB
- OperatorPeakMemoryUsage: 30.828 KB
- OperatorTotalTime: 5.722us
- __MAX_OF_OperatorTotalTime: 7.153us
- __MIN_OF_OperatorTotalTime: 4.656us
- PrepareTime: 10.391us
- __MAX_OF_PrepareTime: 15.125us
- __MIN_OF_PrepareTime: 6.816us
- PullChunkNum: 1
- __MAX_OF_PullChunkNum: 1
- __MIN_OF_PullChunkNum: 0
- PullRowNum: 1
- __MAX_OF_PullRowNum: 1
- __MIN_OF_PullRowNum: 0
- PullTotalTime: 7ns
- __MAX_OF_PullTotalTime: 112ns
- __MIN_OF_PullTotalTime: 0ns
- PushChunkNum: 1
- __MAX_OF_PushChunkNum: 1
- __MIN_OF_PushChunkNum: 0
- PushRowNum: 1
- __MAX_OF_PushRowNum: 1
- __MIN_OF_PushRowNum: 0
- PushTotalTime: 31ns
- __MAX_OF_PushTotalTime: 506ns
- __MIN_OF_PushTotalTime: 0ns
- SetFinishedTime: 25ns
- __MAX_OF_SetFinishedTime: 35ns
- __MIN_OF_SetFinishedTime: 22ns
- SetFinishingTime: 116ns
- __MAX_OF_SetFinishingTime: 167ns
- __MIN_OF_SetFinishingTime: 41ns
UniqueMetrics:
EXCHANGE_SOURCE (plan_node_id=1):
CommonMetrics:
- CloseTime: 11.840us
- __MAX_OF_CloseTime: 20.704us
- __MIN_OF_CloseTime: 5.367us
- JoinRuntimeFilterEvaluate: 0
- JoinRuntimeFilterHashTime: 0ns
- JoinRuntimeFilterInputRows: 0
- JoinRuntimeFilterOutputRows: 0
- JoinRuntimeFilterTime: 0ns
- OperatorAllocatedMemoryUsage: 41.734 KB
- OperatorDeallocatedMemoryUsage: 14.156 KB
- OperatorPeakMemoryUsage: 27.734 KB
- OperatorTotalTime: 14.312us
- __MAX_OF_OperatorTotalTime: 27.155us
- __MIN_OF_OperatorTotalTime: 9.552us
- PrepareTime: 45.799us
- __MAX_OF_PrepareTime: 370.329us
- __MIN_OF_PrepareTime: 18.284us
- PullChunkNum: 1
- __MAX_OF_PullChunkNum: 1
- __MIN_OF_PullChunkNum: 0
- PullRowNum: 1
- __MAX_OF_PullRowNum: 1
- __MIN_OF_PullRowNum: 0
- PullTotalTime: 1.557us
- __MAX_OF_PullTotalTime: 21.441us
- __MIN_OF_PullTotalTime: 0ns
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 130ns
- __MAX_OF_SetFinishedTime: 351ns
- __MIN_OF_SetFinishedTime: 41ns
- SetFinishingTime: 784ns
- __MAX_OF_SetFinishingTime: 6.978us
- __MIN_OF_SetFinishingTime: 183ns
UniqueMetrics:
- BufferUnplugCount: 0
- BytesPassThrough: 215.000 B
- __MAX_OF_BytesPassThrough: 215.000 B
- __MIN_OF_BytesPassThrough: 0.000 B
- BytesReceived: 0.000 B
- ClosureBlockCount: 0
- ClosureBlockTime: 0ns
- DecompressChunkTime: 0ns
- DeserializeChunkTime: 0ns
- PeakBufferMemoryBytes: 215.000 B
- __MAX_OF_PeakBufferMemoryBytes: 215.000 B
- __MIN_OF_PeakBufferMemoryBytes: 0.000 B
- ReceiverProcessTotalTime: 1.073us
- __MAX_OF_ReceiverProcessTotalTime: 15.482us
- __MIN_OF_ReceiverProcessTotalTime: 0ns
- RequestReceived: 2
- __MAX_OF_RequestReceived: 1
- __MIN_OF_RequestReceived: 0
- WaitLockTime: 0ns
Fragment 1:
- BackendAddresses: 10.216.7.214:9060
- InstanceIds: bdc7f294-e8ef-11ef-9933-02424fb97f66
- BackendNum: 1
- BackendProfileMergeTime: 1.243ms
- FragmentInstancePrepareTime: 148.818us
- prepare-fragment-ctx: 5.793us
- prepare-pipeline-driver: 45.998us
- prepare-query-ctx: 2.483us
- prepare-runtime-state: 45.998us
- InitialProcessDriverCount: 68
- InitialProcessMem: 13.406 GB
- InstanceAllocatedMemoryUsage: 890.367 KB
- InstanceDeallocatedMemoryUsage: 813.477 KB
- InstanceNum: 1
- InstancePeakMemoryUsage: 594.758 KB
- QueryMemoryLimit: -1.000 B
Pipeline (id=1):
- ActiveTime: 444.346us
- BlockByInputEmpty: 1
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverPrepareTime: 123.140us
- DriverTotalTime: 1.405ms
- OverheadTime: 0ns
- PeakDriverQueueSize: 5
- PendingTime: 741.028us
- InputEmptyTime: 420.147us
- FirstInputEmptyTime: 78.867us
- FollowupInputEmptyTime: 341.280us
- OutputFullTime: 0ns
- PendingFinishTime: 326.780us
- PreconditionBlockTime: 0ns
- ScheduleCount: 2
- ScheduleTime: 220.622us
- TotalDegreeOfParallelism: 1
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
EXCHANGE_SINK (plan_node_id=1):
CommonMetrics:
- CloseTime: 18.031us
- OperatorAllocatedMemoryUsage: 51.422 KB
- OperatorDeallocatedMemoryUsage: 14.969 KB
- OperatorPeakMemoryUsage: 36.453 KB
- OperatorTotalTime: 95.767us
- PrepareTime: 56.466us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1
- PushRowNum: 1
- PushTotalTime: 26.267us
- SetFinishedTime: 22ns
- SetFinishingTime: 51.447us
UniqueMetrics:
- ChannelNum: 1
- DestFragments: bdc7f294e8ef11ef-993302424fb97f65
- DestID: 1
- PartType: UNPARTITIONED
- BytesPassThrough: 215.000 B
- BytesSent: 0.000 B
- BytesUnsent: 0.000 B
- CompressTime: 0ns
- CompressedBytes: 0.000 B
- NetworkBandwidth: 0.000 B/sec
- NetworkTime: 302.642us
- OverallThroughput: 0.000 B/sec
- OverallTime: 334.742us
- PassThroughBufferPeakMemoryUsage: 5.930 KB
- RequestSent: 0
- RequestUnsent: 0
- RpcAvgTime: 151.321us
- RpcCount: 2
- SenderInputBytes: 0.000 B
- SerializeChunkTime: 0ns
- SerializedBytes: 0.000 B
- ShuffleChunkAppendCounter: 0
- ShuffleChunkAppendTime: 0ns
- ShuffleHashTime: 0ns
- WaitTime: 1.142ms
CHUNK_ACCUMULATE (plan_node_id=0):
CommonMetrics:
- IsSubordinate
- CloseTime: 365ns
- OperatorTotalTime: 2.017us
- PrepareTime: 6.132us
- PullChunkNum: 1
- PullRowNum: 1
- PullTotalTime: 164ns
- PushChunkNum: 1
- PushRowNum: 1
- PushTotalTime: 1.261us
- SetFinishedTime: 125ns
- SetFinishingTime: 102ns
UniqueMetrics:
LIMIT (plan_node_id=0):
CommonMetrics:
- CloseTime: 4.659us
- OperatorAllocatedMemoryUsage: 964.984 KB
- OperatorDeallocatedMemoryUsage: 655.953 KB
- OperatorPeakMemoryUsage: 309.031 KB
- OperatorTotalTime: 5.751us
- PrepareTime: 8.643us
- PullChunkNum: 1
- PullRowNum: 1
- PullTotalTime: 193ns
- PushChunkNum: 1
- PushRowNum: 1
- PushTotalTime: 788ns
- SetFinishedTime: 29ns
- SetFinishingTime: 82ns
UniqueMetrics:
OLAP_SCAN (plan_node_id=0):
CommonMetrics:
- CloseTime: 622.149us
- JoinRuntimeFilterEvaluate: 0
- JoinRuntimeFilterHashTime: 0ns
- JoinRuntimeFilterInputRows: 0
- JoinRuntimeFilterOutputRows: 0
- JoinRuntimeFilterTime: 0ns
- OperatorAllocatedMemoryUsage: 815.820 KB
- OperatorDeallocatedMemoryUsage: 556.398 KB
- OperatorPeakMemoryUsage: 259.492 KB
- OperatorTotalTime: 892.239us
- PrepareTime: 21.434us
- PullChunkNum: 1
- PullRowNum: 1
- PullTotalTime: 269.313us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 123ns
- SetFinishingTime: 654ns
UniqueMetrics:
- MorselQueueType: fixed_morsel_queue
- Predicates: 1: account = ‘admin’
- Rollup: YODA_USER
- SharedScan: False
- Table: YODA_USER
- BytesRead: 96.000 B
- CachedPagesNum: 26
- ChunkBufferCapacity: 64
- CompressedBytesRead: 0.000 B
- DefaultChunkBufferCapacity: 64
- IOTaskExecTime: 396.562us
- CreateSegmentIter: 41.507us
- DictDecode: 1.076us
- GetDelVec: 2.383us
- GetDeltaColumnGroup: 5.806us
- GetRowsets: 730ns
- IOTime: 0ns
- LateMaterialize: 34.776us
- ReadPKIndex: 0ns
- SegmentInit: 103.886us
- BitmapIndexFilter: 0ns
- BitmapIndexFilterRows: 0
- BitmapIndexIteratorInit: 2.659us
- BloomFilterFilter: 285ns
- BloomFilterFilterRows: 0
- ColumnIteratorInit: 53.300us
- SegmentRuntimeZoneMapFilterRows: 0
- SegmentZoneMapFilterRows: 0
- ShortKeyFilter: 862ns
- ShortKeyFilterRows: 0
- ShortKeyRangeNumber: 0
- ZoneMapIndexFilterRows: 0
- ZoneMapIndexFiter: 5.290us
- SegmentRead: 9.291us
- BlockFetch: 1.481us
- BlockFetchCount: 1
- BlockSeek: 5.178us
- BlockSeekCount: 1
- ChunkCopy: 43ns
- DecompressT: 0ns
- DelVecFilterRows: 0
- PredFilter: 541ns
- PredFilterRows: 0
- RowsetsReadCount: 2
- SegmentsReadCount: 1
- TotalColumnsDataPageCount: 10
- IOTaskWaitTime: 34.252us
- MorselsCount: 1
- PeakChunkBufferMemoryUsage: 208.196 KB
- PeakChunkBufferSize: 2
- PeakIOTasks: 1
- PeakScanTaskQueueSize: 0
- PushdownPredicates: 1
- RawRowsRead: 1
- ReadPagesNum: 26
- RowsRead: 1
- ScanTime: 430.814us
- SubmitTaskCount: 1
- TabletCount: 1
- UncompressedBytesRead: 0.000 B
Pipeline (id=0):
- ActiveTime: 57.259us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverPrepareTime: 50.647us
- DriverTotalTime: 131.823us
- OverheadTime: 1.745us
- PeakDriverQueueSize: 0
- PendingTime: 0ns
- InputEmptyTime: 0ns
- FirstInputEmptyTime: 0ns
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 1
- ScheduleTime: 74.564us
- TotalDegreeOfParallelism: 1
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
NOOP_SINK (plan_node_id=0):
CommonMetrics:
- IsSubordinate
- CloseTime: 221ns
- OperatorTotalTime: 327ns
- PrepareTime: 12.422us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 23ns
- SetFinishingTime: 83ns
UniqueMetrics:
OLAP_SCAN_PREPARE (plan_node_id=0):
CommonMetrics:
- IsSubordinate
- CloseTime: 6.791us
- OperatorTotalTime: 55.187us
- PrepareTime: 13.924us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 48.224us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 50ns
- SetFinishingTime: 122ns
UniqueMetrics:

jietao6818 · 2025年02月12日 08:34

fe.log_new (5.2 MB) fe_jstack.log (146.0 KB)

jietao6818 · 2025年02月14日 03:29

Query:
Summary:
- Query ID: 88dd1442-ea83-11ef-8f85-02424fb97f64
- Start Time: 2025-02-14 11:26:52
- End Time: 2025-02-14 11:26:56
- Total: 3s547ms
- Query Type: Query
- Query State: Finished
- StarRocks Version: 3.2.6-2585333
- User: root
- Default Db: YODA_YMS
- Sql Statement: select DATE_FORMAT(min(scan_date_time), ‘%Y-%m-%d %H:%i:%s’),DATE_FORMAT(max(scan_date_time), ‘%Y-%m-%d %H:%i:%s’) from YODA_DMS.DEFECT_WAFER
- Variables: parallel_fragment_exec_instance_num=1,max_parallel_scan_instance_num=-1,pipeline_dop=0,enable_adaptive_sink_dop=true,enable_runtime_adaptive_dop=false,runtime_profile_report_interval=5
- NonDefaultSessionVariables: {“query_timeout”:{“defaultValue”:300,“actualValue”:30000},“disable_join_reorder”:{“defaultValue”:false,“actualValue”:true},“enable_adaptive_sink_dop”:{“defaultValue”:false,“actualValue”:true},“runtime_profile_report_interval”:{“defaultValue”:10,“actualValue”:5},“enable_profile”:{“defaultValue”:false,“actualValue”:true}}
- Collect Profile Time: 8ms
- IsProfileAsync: true
Planner:
- – Total[1] 2ms
- – Analyzer[1] 1ms
- – Transformer[1] 0
- – Optimizer[1] 0
- – preprocessMvs[1] 0
- – chooseCandidates[1] 0
- – generateMvPlan[1] 0
- – validateMv[1] 0
- – mvWithView[1] 0
- – RuleBaseOptimize[1] 0
- – CostBaseOptimize[1] 0
- – PhysicalRewrite[1] 0
- – PlanValidate[1] 0
- – InputDependenciesChecker[1] 0
- – TypeChecker[1] 0
- – CTEUniqueChecker[1] 0
- – ColumnReuseChecker[1] 0
- – ExecPlanBuild[1] 0
- – Pending[1] 0
- – Prepare[1] 0
- – Deploy[1] 2ms
- – DeployLockInternalTime[1] 2ms
- – DeploySerializeConcurrencyTime[1] 0
- – DeployStageByStageTime[3] 0
- – DeployWaitTime[3] 1ms
- – DeployAsyncSendTime[1] 0
- DeployDataSize: 4212
Execution:
- Topology: {“rootId”:2,“nodes”:[{“id”:2,“name”:“PROJECT”,“properties”:{“sinkIds”:[],“displayMem”:false},“children”:[1]},{“id”:1,“name”:“AGGREGATION”,“properties”:{“displayMem”:true},“children”:[0]},{“id”:0,“name”:“JDBC_SCAN”,“properties”:{“displayMem”:false},“children”:[]}]}
- FrontendProfileMergeTime: 1.181ms
- QueryAllocatedMemoryUsage: 44.650 MB
- QueryCumulativeCpuTime: 53.045ms
- QueryCumulativeNetworkTime: 0ns
- QueryCumulativeOperatorTime: 3s565ms
- QueryCumulativeScanTime: 3s528ms
- QueryDeallocatedMemoryUsage: 44.206 MB
- QueryExecutionWallTime: 3s536ms
- QueryPeakMemoryUsage: 676.148 KB
- QueryPeakScheduleTime: 85.345ms
- QuerySpillBytes: 0.000 B
- ResultDeliverTime: 0ns
Fragment 0:
- BackendAddresses: 10.216.7.214:9060
- InstanceIds: 88dd1442-ea83-11ef-8f85-02424fb97f65
- BackendNum: 1
- BackendProfileMergeTime: 2.587ms
- FragmentInstancePrepareTime: 488.174us
- prepare-fragment-ctx: 5.412us
- prepare-pipeline-driver: 122.648us
- prepare-query-ctx: 5.699us
- prepare-runtime-state: 122.648us
- InitialProcessDriverCount: 217
- InitialProcessMem: 14.423 GB
- InstanceAllocatedMemoryUsage: 44.650 MB
- InstanceDeallocatedMemoryUsage: 44.206 MB
- InstanceNum: 1
- InstancePeakMemoryUsage: 671.305 KB
- QueryMemoryLimit: -1.000 B
Pipeline (id=3):
- ActiveTime: 155.828us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverPrepareTime: 44.968us
- DriverTotalTime: 3s532ms
- OverheadTime: 0ns
- PeakDriverQueueSize: 0
- PendingTime: 3s532ms
- InputEmptyTime: 3s532ms
- FirstInputEmptyTime: 3s532ms
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 1
- ScheduleTime: 67.354us
- TotalDegreeOfParallelism: 1
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
RESULT_SINK (plan_node_id=-1):
CommonMetrics:
- IsFinalSink
- CloseTime: 11.758us
- OperatorAllocatedMemoryUsage: 5.195 KB
- OperatorDeallocatedMemoryUsage: 6.148 KB
- OperatorPeakMemoryUsage: 0.000 B
- OperatorTotalTime: 93.168us
- PrepareTime: 10.616us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1
- PushRowNum: 1
- PushTotalTime: 81.267us
- SetFinishedTime: 33ns
- SetFinishingTime: 110ns
UniqueMetrics:
result sink:
- AppendChunkTime: 5.045us
- ResultRendTime: 74.042us
- TupleConvertTime: 2.753us
- NumSentRows: 1
CHUNK_ACCUMULATE (plan_node_id=-1):
CommonMetrics:
- IsSubordinate
- CloseTime: 440ns
- OperatorTotalTime: 1.605us
- PrepareTime: 6us
- PullChunkNum: 1
- PullRowNum: 1
- PullTotalTime: 97ns
- PushChunkNum: 1
- PushRowNum: 1
- PushTotalTime: 679ns
- SetFinishedTime: 172ns
- SetFinishingTime: 217ns
UniqueMetrics:
PROJECT (plan_node_id=2):
CommonMetrics:
- CloseTime: 8.229us
- OperatorAllocatedMemoryUsage: 2.109 KB
- OperatorDeallocatedMemoryUsage: 936.000 B
- OperatorPeakMemoryUsage: 1.203 KB
- OperatorTotalTime: 33.587us
- PrepareTime: 7.979us
- PullChunkNum: 1
- PullRowNum: 1
- PullTotalTime: 267ns
- PushChunkNum: 1
- PushRowNum: 1
- PushTotalTime: 24.838us
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 76ns
- SetFinishingTime: 177ns
UniqueMetrics:
- CommonSubExprComputeTime: 380ns
- ExprComputeTime: 22.437us
AGGREGATE_BLOCKING_SOURCE (plan_node_id=1):
CommonMetrics:
- CloseTime: 38.152us
- JoinRuntimeFilterEvaluate: 0
- JoinRuntimeFilterHashTime: 0ns
- JoinRuntimeFilterInputRows: 0
- JoinRuntimeFilterOutputRows: 0
- JoinRuntimeFilterTime: 0ns
- OperatorAllocatedMemoryUsage: 25.734 KB
- OperatorDeallocatedMemoryUsage: 42.827 MB
- OperatorPeakMemoryUsage: 0.000 B
- OperatorTotalTime: 71.769us
- PrepareTime: 5.946us
- PullChunkNum: 1
- PullRowNum: 1
- PullTotalTime: 33.322us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 157ns
- SetFinishingTime: 138ns
UniqueMetrics:
Pipeline (id=2):
- ActiveTime: 35.325ms
- BlockByInputEmpty: 1.203K (1203)
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverPrepareTime: 95.593us
- DriverTotalTime: 3s532ms
- OverheadTime: 7.696ms
- PeakDriverQueueSize: 2
- PendingTime: 3s435ms
- InputEmptyTime: 3s437ms
- FirstInputEmptyTime: 48.720ms
- FollowupInputEmptyTime: 3s388ms
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 1.204K (1204)
- ScheduleTime: 61.749ms
- TotalDegreeOfParallelism: 1
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
AGGREGATE_BLOCKING_SINK (plan_node_id=1):
CommonMetrics:
- CloseTime: 16.179us
- OperatorAllocatedMemoryUsage: 19.625 KB
- OperatorDeallocatedMemoryUsage: 42.826 MB
- OperatorPeakMemoryUsage: 0.000 B
- OperatorTotalTime: 25.248ms
- PrepareTime: 78.455us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1.211K (1211)
- PushRowNum: 4.960M (4959697)
- PushTotalTime: 25.231ms
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 34ns
- SetFinishingTime: 622ns
UniqueMetrics:
- AggregateFunctions: min(scan_date_time), max(scan_date_time)
- AggComputeTime: 15.579ms
- AggFuncComputeTime: 15.193ms
- ChunkBufferPeakMem: 0.000 B
- ChunkBufferPeakSize: 0
- ExprComputeTime: 1.628ms
- ExprReleaseTime: 8.423ms
- GetResultsTime: 13.726us
- HashTableMemoryUsage: 4.023 KB
- HashTableSize: 0
- InputRowCount: 4.960M (4959697)
- PassThroughRowCount: 0
- ResultAggAppendTime: 0ns
- ResultGroupByAppendTime: 0ns
- ResultIteratorTime: 0ns
- RowsReturned: 0
- StateAllocate: 0ns
- StateDestroy: 0ns
- StreamingTime: 0ns
LOCAL_EXCHANGE_SOURCE (plan_node_id=1):
CommonMetrics:
- IsSubordinate
- CloseTime: 177ns
- OperatorTotalTime: 2.380ms
- PrepareTime: 4.779us
- PullChunkNum: 1.211K (1211)
- PullRowNum: 4.960M (4959697)
- PullTotalTime: 2.379ms
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 829ns
- SetFinishingTime: 58ns
UniqueMetrics:
Pipeline (id=1):
- ActiveTime: 668.966us
- __MAX_OF_ActiveTime: 836.387us
- __MIN_OF_ActiveTime: 569.427us
- BlockByInputEmpty: 1.210K (1210)
- __MAX_OF_BlockByInputEmpty: 76
- __MIN_OF_BlockByInputEmpty: 75
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 16
- DriverPrepareTime: 27.523us
- __MAX_OF_DriverPrepareTime: 43.403us
- __MIN_OF_DriverPrepareTime: 21.870us
- DriverTotalTime: 3s532ms
- __MAX_OF_DriverTotalTime: 3s532ms
- __MIN_OF_DriverTotalTime: 3s532ms
- OverheadTime: 471.908us
- __MAX_OF_OverheadTime: 640.503us
- __MIN_OF_OverheadTime: 398.918us
- PeakDriverQueueSize: 120
- __MAX_OF_PeakDriverQueueSize: 15
- __MIN_OF_PeakDriverQueueSize: 0
- PendingTime: 3s525ms
- __MAX_OF_PendingTime: 3s528ms
- __MIN_OF_PendingTime: 3s518ms
- InputEmptyTime: 3s525ms
- __MAX_OF_InputEmptyTime: 3s529ms
- __MIN_OF_InputEmptyTime: 3s522ms
- FirstInputEmptyTime: 76.169ms
- __MAX_OF_FirstInputEmptyTime: 101.305ms
- __MIN_OF_FirstInputEmptyTime: 48.665ms
- FollowupInputEmptyTime: 3s449ms
- __MAX_OF_FollowupInputEmptyTime: 3s477ms
- __MIN_OF_FollowupInputEmptyTime: 3s427ms
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 1.226K (1226)
- __MAX_OF_ScheduleCount: 77
- __MIN_OF_ScheduleCount: 76
- ScheduleTime: 6.187ms
- __MAX_OF_ScheduleTime: 12.694ms
- __MIN_OF_ScheduleTime: 2.608ms
- TotalDegreeOfParallelism: 16
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
LOCAL_EXCHANGE_SINK (plan_node_id=1):
CommonMetrics:
- IsSubordinate
- CloseTime: 208ns
- __MAX_OF_CloseTime: 373ns
- __MIN_OF_CloseTime: 127ns
- OperatorTotalTime: 80.811us
- __MAX_OF_OperatorTotalTime: 170.237us
- __MIN_OF_OperatorTotalTime: 64.919us
- PrepareTime: 6.852us
- __MAX_OF_PrepareTime: 9.664us
- __MIN_OF_PrepareTime: 5.569us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1.211K (1211)
- __MAX_OF_PushChunkNum: 76
- __MIN_OF_PushChunkNum: 75
- PushRowNum: 4.960M (4959697)
- __MAX_OF_PushRowNum: 311.296K (311296)
- __MIN_OF_PushRowNum: 307.200K (307200)
- PushTotalTime: 80.164us
- __MAX_OF_PushTotalTime: 169.825us
- __MIN_OF_PushTotalTime: 64.328us
- SetFinishedTime: 87ns
- __MAX_OF_SetFinishedTime: 173ns
- __MIN_OF_SetFinishedTime: 30ns
- SetFinishingTime: 351ns
- __MAX_OF_SetFinishingTime: 800ns
- __MIN_OF_SetFinishingTime: 148ns
UniqueMetrics:
- ShuffleNum: 1
- Type: Passthrough
- LocalExchangePeakMemoryUsage: 36.001 KB
LOCAL_EXCHANGE_SOURCE (plan_node_id=0):
CommonMetrics:
- IsSubordinate
- CloseTime: 400ns
- __MAX_OF_CloseTime: 910ns
- __MIN_OF_CloseTime: 177ns
- OperatorTotalTime: 116.246us
- __MAX_OF_OperatorTotalTime: 139.403us
- __MIN_OF_OperatorTotalTime: 99.061us
- PrepareTime: 6.834us
- __MAX_OF_PrepareTime: 15.654us
- __MIN_OF_PrepareTime: 4.410us
- PullChunkNum: 1.211K (1211)
- __MAX_OF_PullChunkNum: 76
- __MIN_OF_PullChunkNum: 75
- PullRowNum: 4.960M (4959697)
- __MAX_OF_PullRowNum: 311.296K (311296)
- __MIN_OF_PullRowNum: 307.200K (307200)
- PullTotalTime: 113.643us
- __MAX_OF_PullTotalTime: 136.289us
- __MIN_OF_PullTotalTime: 95.513us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 2.082us
- __MAX_OF_SetFinishedTime: 2.938us
- __MIN_OF_SetFinishedTime: 1.100us
- SetFinishingTime: 120ns
- __MAX_OF_SetFinishingTime: 226ns
- __MIN_OF_SetFinishingTime: 54ns
UniqueMetrics:
Pipeline (id=0):
- ActiveTime: 17.992ms
- BlockByInputEmpty: 1.210K (1210)
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverPrepareTime: 63.553us
- DriverTotalTime: 3s532ms
- OverheadTime: 9.236ms
- PeakDriverQueueSize: 80
- PendingTime: 3s428ms
- InputEmptyTime: 3s431ms
- FirstInputEmptyTime: 48.492ms
- FollowupInputEmptyTime: 3s382ms
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 1.211K (1211)
- ScheduleTime: 85.345ms
- TotalDegreeOfParallelism: 1
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
LOCAL_EXCHANGE_SINK (plan_node_id=0):
CommonMetrics:
- IsSubordinate
- CloseTime: 372ns
- OperatorTotalTime: 1.404ms
- PrepareTime: 11.522us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1.211K (1211)
- PushRowNum: 4.960M (4959697)
- PushTotalTime: 1.401ms
- SetFinishedTime: 23ns
- SetFinishingTime: 1.741us
UniqueMetrics:
- ShuffleNum: 16
- Type: Passthrough
- LocalExchangePeakMemoryUsage: 72.002 KB
CONNECTOR_SCAN (plan_node_id=0):
CommonMetrics:
- CloseTime: 189.773us
- JoinRuntimeFilterEvaluate: 0
- JoinRuntimeFilterHashTime: 0ns
- JoinRuntimeFilterInputRows: 0
- JoinRuntimeFilterOutputRows: 0
- JoinRuntimeFilterTime: 0ns
- OperatorAllocatedMemoryUsage: 44.068 MB
- OperatorDeallocatedMemoryUsage: 673.977 KB
- OperatorPeakMemoryUsage: 43.410 MB
- OperatorTotalTime: 7.351ms
- PrepareTime: 21.838us
- PullChunkNum: 1.211K (1211)
- PullRowNum: 4.960M (4959697)
- PullTotalTime: 7.160ms
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 131ns
- SetFinishingTime: 1.689us
UniqueMetrics:
- AdaptiveIOTasks: True
- DataSourceType: JDBCDataSource
- MorselQueueType: dynamic_morsel_queue
- Query: SELECT scan_date_time FROM DEFECT_WAFER
- SharedScan: False
- ChunkBufferCapacity: 64
- DefaultChunkBufferCapacity: 64
- IOTaskExecTime: 3s526ms
- FillChunkTime: 1s424ms
- IOCounter: 1.211K (1211)
- IOTime: 2s34ms
- MemAllocFailed: 0
- RowsRead: 4.960M (4959697)
- IOTaskWaitTime: 1.768ms
- MorselsCount: 1
- PeakChunkBufferMemoryUsage: 72.002 KB
- PeakChunkBufferSize: 3
- PeakIOTasks: 1
- PeakScanTaskQueueSize: 0
- ScanTime: 3s528ms
- SubmitTaskCount: 35
- TabletCount: 1