datetime字段存在NULL值时全局排序分页结果错误

【详述】
datetime时间字段如果存在NULL值且行数达到500w左右时,对此字段进行全局排序分页,数据排序错误,建表语句如下:

CREATE TABLE map_test (
id largeint(40) NOT NULL COMMENT “”,
source tinyint(4) NOT NULL COMMENT “”,
date varchar(10) NOT NULL COMMENT “”,
top_name varchar(100) NULL COMMENT “”,
second_name varchar(100) NULL COMMENT “”,
third_name varchar(100) NULL COMMENT “”,
id_arrival bigint(20) NULL COMMENT “”,
t_time datetime NULL COMMENT “”,
oc_time datetime NULL COMMENT “”,
province varchar(300) NULL COMMENT “”,
city varchar(300) NULL COMMENT “”,
area varchar(300) NULL COMMENT “”,
re_time datetime NULL COMMENT “”,
del_time datetime NULL COMMENT “”
) ENGINE=OLAP
PRIMARY KEY(id, source, date)
COMMENT “”
DISTRIBUTED BY HASH(date) BUCKETS 120
PROPERTIES (
“replication_num” = “3”,
“in_memory” = “false”,
“storage_format” = “DEFAULT”,
“enable_persistent_index” = “false”
);

样例数据:

131579564,3,2023-01-25,一级,二级,三级,2023-01-25 10:41:03,2023-01-24 22:34:16,省,市,区,2023-02-03 17:47:12,NULL;
280311488,3,2023-01-25,一级,二级,三级,2023-01-25 10:41:03,2023-01-24 22:34:16,省,市,区,NULL,2023-01-25 16:11:49;
585483588,3,2023-01-25,一级,二级,三级,2023-01-25 10:41:03,2023-01-24 22:34:16,省,市,区,2023-03-03 17:47:12,NULL;
re_time 或 del_time 字段存在NULL值,其余符合时间散列。

目前确认分桶键和主键不影响排序结果。

【背景】
parallel_fragment_exec_instance_num = 1
query_mem_limit = 0

查询分页数据时,发现同样页数数据不一致。

执行以下SQL,多次结果不一致:
SELECT del_time FROM map_test ORDER BY del_time DESC LIMIT 1000,100

如果加上限定条件,即使条件没有过滤任何数据,结果保持一致:
SELECT del_time FROM map_test WHERE del_time > ‘2000-01-01’ ORDER BY del_time DESC LIMIT 1000,100
修正一下,在做千万级别测试时,发现:
SELECT del_time FROM map_test WHERE date> ‘2000-01-01’ ORDER BY del_time DESC LIMIT 1000,100
这种类型查询,也会出现不一致的情况!

【StarRocks版本】:2.3.1
【集群规模】例如:3fe(3 follower)+3be(fe与be混部)
【机器信息】:40C/256G

【附件】
image
image
image

2.3.1/2.5.3 具体的版本时哪个呢,我们复现下

2.3.1和2.5.3都会出现,我原来用的2.3.1后来看到2.3.5的 #13585和2.3.4的 #9698就直接升级到了2.5.3,但是还是有问题

可以把执行计划发下吗,有问题的SQL

PLAN FRAGMENT 0
OUTPUT EXPRS:14: del_time
PARTITION: UNPARTITIONED

RESULT SINK

2:MERGING-EXCHANGE
offset: 1000
limit: 100

PLAN FRAGMENT 1
OUTPUT EXPRS:
PARTITION: RANDOM

STREAM DATA SINK
EXCHANGE ID: 02
UNPARTITIONED

1:TOP-N
| order by: <slot 14> 14: del_time DESC
| offset: 0
| limit: 1100
|
0:OlapScanNode
TABLE: map_test
PREAGGREGATION: ON
partitions=1/1
rollup: map_test
tabletRatio=120/120
tabletList=378444,378448,378452,378456,378460,378464,378468,378472,378476,378480 …
cardinality=4248760
avgRowSize=1.0
numNodes=0

查询期间,没有新增数据,是吧?

对,导入数据完成后才进行的查询,导入结束之后,没有任何数据变更操作

可以获取下Profile吗,多次执行获取多个Profile

这是我获取的两次执行结果不一样的Profile:

第一次:

Query:
Summary:
- Query ID: f78750ee-c2db-11ed-bfea-2cea7fe99153
- Start Time: 2023-03-15 10:49:12
- End Time: 2023-03-15 10:49:12
- Total: 112ms
- Query Type: Query
- Query State: EOF
- StarRocks Version: 2.3.1
- User: root
- Default Db: default_cluster:dwd
- Sql Statement: SELECT del_time FROM map_test ORDER BY del_time DESC LIMIT 1000,100
- QueryCpuCost: 56ms
- QueryMemCost: 11.806MB
- Variables: parallel_fragment_exec_instance_num=1,pipeline_dop=0
- Collect Profile Time: 28ms
Planner:
- Total: 1ms / 1
Execution Profile f78750ee-c2db-11ed-bfea-2cea7fe99153:
- ExecutionTotalTime: 105.935ms
Fragment 0:
- BackendNum: 1
- InstanceNum: 1
- MemoryLimit: 80.00 GB
- PeakMemoryUsage: 85.65 KB
Pipeline (id=0):
- ActiveTime: 304.41us
- BlockByInputEmpty: 1
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverTotalTime: 105.935ms
- OverheadTime: 304.41us
- PendingTime: 105.584ms
- InputEmptyTime: 105.586ms
- FirstInputEmptyTime: 105.503ms
- FollowupInputEmptyTime: 82.434us
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 2
- ScheduleTime: 47.636us
- TotalDegreeOfParallelism: 1
- YieldByTimeLimit: 0
RESULT_SINK:
CommonMetrics:
- CloseTime: 7.74us
- OperatorTotalTime: 96.544us
- PeakMemoryUsage: 0.00
- PrepareTime: 16.142us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1
- PushRowNum: 100
- PushTotalTime: 89.284us
- SetFinishedTime: 23ns
- SetFinishingTime: 163ns
UniqueMetrics:
LIMIT (plan_node_id=2):
CommonMetrics:
- CloseTime: 2.218us
- OperatorTotalTime: 2.740us
- PeakMemoryUsage: 0.00
- PrepareTime: 34.469us
- PullChunkNum: 1
- PullRowNum: 100
- PullTotalTime: 182ns
- PushChunkNum: 1
- PushRowNum: 100
- PushTotalTime: 252ns
- SetFinishedTime: 23ns
- SetFinishingTime: 65ns
UniqueMetrics:
EXCHANGE_MERGE_SORT_SOURCE (plan_node_id=2):
CommonMetrics:
- CloseTime: 507ns
- OperatorTotalTime: 196.371us
- PeakMemoryUsage: 0.00
- PrepareTime: 80.234us
- PullChunkNum: 2
- PullRowNum: 100
- PullTotalTime: 184.559us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 117ns
- SetFinishingTime: 11.188us
UniqueMetrics:
- BytesPassThrough: 9.68 KB
- BytesReceived: 10.41 KB
- DecompressChunkTime: 45.274us
- DeserializeChunkTime: 33.787us
- MergeSortedChunks: 159.800us
- ReceiverProcessTotalTime: 105.672us
- RequestReceived: 4
- SenderTotalTime: 104.65us
- SenderWaitLockTime: 1.543us
Fragment 1:
- BackendNum: 3
- InstanceNum: 3
- MemoryLimit: 40.00 GB
- PeakMemoryUsage: 31.89 MB
- __MAX_OF_PeakMemoryUsage: 14.37 MB
- __MIN_OF_PeakMemoryUsage: 5.72 MB
Pipeline (id=2):
- ActiveTime: 624.122us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverTotalTime: 46.368ms
- __MAX_OF_DriverTotalTime: 98.262ms
- __MIN_OF_DriverTotalTime: 9.41ms
- OverheadTime: 624.122us
- PendingTime: 45.547ms
- __MAX_OF_PendingTime: 97.496ms
- __MIN_OF_PendingTime: 8.274ms
- InputEmptyTime: 43.39ms
- __MAX_OF_InputEmptyTime: 96.996ms
- __MIN_OF_InputEmptyTime: 8.87ms
- FirstInputEmptyTime: 43.39ms
- __MAX_OF_FirstInputEmptyTime: 96.996ms
- __MIN_OF_FirstInputEmptyTime: 8.87ms
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 2.510ms
- __MAX_OF_PendingFinishTime: 6.840ms
- __MIN_OF_PendingFinishTime: 189.69us
- PreconditionBlockTime: 0ns
- ScheduleCount: 3
- ScheduleTime: 197.25us
- TotalDegreeOfParallelism: 3
- YieldByTimeLimit: 0
EXCHANGE_SINK (plan_node_id=2):
CommonMetrics:
- CloseTime: 9.517us
- OperatorTotalTime: 98.976us
- PeakMemoryUsage: 0.00
- PrepareTime: 45.272us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 3
- PushRowNum: 3.3K (3300)
- PushTotalTime: 32.248us
- SetFinishedTime: 29ns
- SetFinishingTime: 57.181us
UniqueMetrics:
- DestID: 2
- DestFragments: f78750eec2db11ed-bfea2cea7fe99157
- PartType: UNPARTITIONED
- BytesPassThrough: 9.68 KB
- __MAX_OF_BytesPassThrough: 9.68 KB
- __MIN_OF_BytesPassThrough: 0.00
- BytesSent: 10.41 KB
- __MAX_OF_BytesSent: 5.21 KB
- __MIN_OF_BytesSent: 0.00
- CompressTime: 22.610us
- NetworkTime: 3.249ms
- __MAX_OF_NetworkTime: 9.637ms
- __MIN_OF_NetworkTime: 0ns
- OverallThroughput: 540.390625 KB/sec
- __MAX_OF_OverallThroughput: 540.390625 KB/sec
- __MIN_OF_OverallThroughput: 0.0 /sec
- RequestSent: 2
- __MAX_OF_RequestSent: 1
- __MIN_OF_RequestSent: 0
- SerializeChunkTime: 4.482us
- ShuffleHashTime: 0ns
- UncompressedBytes: 19.37 KB
- __MAX_OF_UncompressedBytes: 9.68 KB
- __MIN_OF_UncompressedBytes: 0.00
- WaitTime: 2.648ms
- __MAX_OF_WaitTime: 6.963ms
- __MIN_OF_WaitTime: 336.283us
LIMIT (plan_node_id=1):
CommonMetrics:
- CloseTime: 427ns
- OperatorTotalTime: 1.597us
- PeakMemoryUsage: 0.00
- PrepareTime: 12.3us
- PullChunkNum: 3
- PullRowNum: 3.3K (3300)
- PullTotalTime: 245ns
- PushChunkNum: 3
- PushRowNum: 3.3K (3300)
- PushTotalTime: 682ns
- SetFinishedTime: 157ns
- SetFinishingTime: 85ns
UniqueMetrics:
LOCAL_MERGE_SORT_SOURCE (plan_node_id=1):
CommonMetrics:
- CloseTime: 111.815us
- OperatorTotalTime: 634.164us
- PeakMemoryUsage: 0.00
- PrepareTime: 9.303us
- PullChunkNum: 3
- PullRowNum: 3.3K (3300)
- PullTotalTime: 521.897us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 91ns
- SetFinishingTime: 360ns
UniqueMetrics:
Pipeline (id=1):
- ActiveTime: 3.424ms
- __MAX_OF_ActiveTime: 9.107ms
- __MIN_OF_ActiveTime: 773.721us
- BlockByInputEmpty: 388
- __MAX_OF_BlockByInputEmpty: 24
- __MIN_OF_BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 20
- DriverTotalTime: 21.414ms
- __MAX_OF_DriverTotalTime: 97.617ms
- __MIN_OF_DriverTotalTime: 1.803ms
- OverheadTime: 3.424ms
- __MAX_OF_OverheadTime: 9.107ms
- __MIN_OF_OverheadTime: 773.721us
- PendingTime: 16.137ms
- __MAX_OF_PendingTime: 92.289ms
- __MIN_OF_PendingTime: 61.931us
- InputEmptyTime: 16.219ms
- __MAX_OF_InputEmptyTime: 92.311ms
- __MIN_OF_InputEmptyTime: 61.777us
- FirstInputEmptyTime: 62.794us
- FollowupInputEmptyTime: 16.156ms
- __MAX_OF_FollowupInputEmptyTime: 92.207ms
- __MIN_OF_FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 453
- __MAX_OF_ScheduleCount: 25
- __MIN_OF_ScheduleCount: 1
- ScheduleTime: 1.851ms
- __MAX_OF_ScheduleTime: 6.211ms
- __MIN_OF_ScheduleTime: 1.16ms
- TotalDegreeOfParallelism: 60
- YieldByTimeLimit: 0
PARTITION_SORT_SINK (plan_node_id=1):
CommonMetrics:
- CloseTime: 7.292us
- OperatorTotalTime: 2.300ms
- __MAX_OF_OperatorTotalTime: 7.482ms
- __MIN_OF_OperatorTotalTime: 4.625us
- PeakMemoryUsage: 0.00
- PrepareTime: 20.208us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1.065K (1065)
- __MAX_OF_PushChunkNum: 67
- __MIN_OF_PushChunkNum: 0
- PushRowNum: 4.24876M (4248760)
- __MAX_OF_PushRowNum: 270.078K (270078)
- __MIN_OF_PushRowNum: 0
- PushTotalTime: 147.889us
- __MAX_OF_PushTotalTime: 6.535ms
- __MIN_OF_PushTotalTime: 0ns
- SetFinishedTime: 29ns
- SetFinishingTime: 2.145ms
- __MAX_OF_SetFinishingTime: 6.231ms
- __MIN_OF_SetFinishingTime: 437ns
UniqueMetrics:
- SortKeys: 14: del_time DESC
- SortType: TopN
- BuildingTime: 271.984us
- MergingTime: 93.830us
- OutputTime: 0ns
- SortingTime: 1.883ms
- __MAX_OF_SortingTime: 6.37ms
- __MIN_OF_SortingTime: 0ns
OLAP_SCAN (plan_node_id=0):
CommonMetrics:
- CloseTime: 647.875us
- OperatorTotalTime: 1.303ms
- PeakMemoryUsage: 0.00
- PrepareTime: 19.120us
- PullChunkNum: 25.808K (25808)
- __MAX_OF_PullChunkNum: 925
- __MIN_OF_PullChunkNum: 2
- PullRowNum: 4.24876M (4248760)
- __MAX_OF_PullRowNum: 270.078K (270078)
- __MIN_OF_PullRowNum: 0
- PullTotalTime: 655.405us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 178ns
- SetFinishingTime: 174ns
UniqueMetrics:
- MorselQueueType: fixed_morsel_queue
- Rollup: map_test
- Table: map_test
- BytesRead: 36.47 MB
- __MAX_OF_BytesRead: 1.79 MB
- __MIN_OF_BytesRead: 0.00
- CachedPagesNum: 0
- ChunkBufferCapacity: 3.84K (3840)
- CompressedBytesRead: 17.52 MB
- __MAX_OF_CompressedBytesRead: 840.04 KB
- __MIN_OF_CompressedBytesRead: 0.00
- CreateSegmentIter: 18.79us
- DefaultChunkBufferCapacity: 3.84K (3840)
- IOTime: 10.674ms
- __MAX_OF_IOTime: 81.349ms
- __MIN_OF_IOTime: 0ns
- MorselsCount: 120
- PeakChunkBufferSize: 112
- __MAX_OF_PeakChunkBufferSize: 43
- __MIN_OF_PeakChunkBufferSize: 33
- PushdownPredicates: 0
- RawRowsRead: 4.24876M (4248760)
- __MAX_OF_RawRowsRead: 208.175K (208175)
- __MIN_OF_RawRowsRead: 0
- ReadPagesNum: 546
- __MAX_OF_ReadPagesNum: 26
- __MIN_OF_ReadPagesNum: 0
- RowsRead: 4.24876M (4248760)
- __MAX_OF_RowsRead: 208.175K (208175)
- __MIN_OF_RowsRead: 0
- ScanTime: 11.353ms
- __MAX_OF_ScanTime: 83.816ms
- __MIN_OF_ScanTime: 2.37us
- SegmentInit: 64.760us
- BitmapIndexFilter: 0ns
- BitmapIndexFilterRows: 0
- BloomFilterFilterRows: 0
- SegmentZoneMapFilterRows: 0
- ShortKeyFilterRows: 0
- ZoneMapIndexFilterRows: 0
- SegmentRead: 11.257ms
- __MAX_OF_SegmentRead: 83.581ms
- __MIN_OF_SegmentRead: 0ns
- BlockFetch: 6.455ms
- __MAX_OF_BlockFetch: 69.661ms
- __MIN_OF_BlockFetch: 0ns
- BlockFetchCount: 1.065K (1065)
- __MAX_OF_BlockFetchCount: 51
- __MIN_OF_BlockFetchCount: 0
- BlockSeek: 4.795ms
- __MAX_OF_BlockSeek: 47.81ms
- __MIN_OF_BlockSeek: 0ns
- BlockSeekCount: 546
- __MAX_OF_BlockSeekCount: 26
- __MIN_OF_BlockSeekCount: 0
- ChunkCopy: 0ns
- DecompressT: 85.500us
- DelVecFilterRows: 0
- IndexLoad: 0ns
- PredFilter: 0ns
- PredFilterRows: 0
- RowsetsReadCount: 120
- SegmentsReadCount: 56
- __MAX_OF_SegmentsReadCount: 1
- __MIN_OF_SegmentsReadCount: 0
- TotalColumnsDataPageCount: 546
- __MAX_OF_TotalColumnsDataPageCount: 26
- __MIN_OF_TotalColumnsDataPageCount: 0
- SubmitIOTaskCount: 120
- TabletCount: 120
- UncompressedBytesRead: 20.16 MB
- __MAX_OF_UncompressedBytesRead: 991.42 KB
- __MIN_OF_UncompressedBytesRead: 0.00
Pipeline (id=0):
- ActiveTime: 23.728us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverTotalTime: 1.420ms
- OverheadTime: 23.728us
- PendingTime: 0ns
- InputEmptyTime: 0ns
- FirstInputEmptyTime: 0ns
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 3
- ScheduleTime: 1.397ms
- TotalDegreeOfParallelism: 3
- YieldByTimeLimit: 0
NOOP_SINK (plan_node_id=0):
CommonMetrics:
- CloseTime: 384ns
- OperatorTotalTime: 529ns
- PeakMemoryUsage: 0.00
- PrepareTime: 11.213us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 31ns
- SetFinishingTime: 113ns
UniqueMetrics:
OLAP_SCAN_PREPARE (plan_node_id=0):
CommonMetrics:
- CloseTime: 7.341us
- OperatorTotalTime: 26.439us
- PeakMemoryUsage: 0.00
- PrepareTime: 188.485us
- PullChunkNum: 3
- PullRowNum: 0
- PullTotalTime: 18.873us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 71ns
- SetFinishingTime: 153ns
UniqueMetrics:

第二次:

Query:
Summary:
- Query ID: 2f44e031-c2dc-11ed-bfea-2cea7fe99153
- Start Time: 2023-03-15 10:50:45
- End Time: 2023-03-15 10:50:46
- Total: 70ms
- Query Type: Query
- Query State: EOF
- StarRocks Version: 2.3.1
- User: root
- Default Db: default_cluster:dwd
- Sql Statement: SELECT del_time FROM map_test ORDER BY del_time DESC LIMIT 1000,100
- QueryCpuCost: 186ms
- QueryMemCost: 17.215MB
- Variables: parallel_fragment_exec_instance_num=1,pipeline_dop=0
- Collect Profile Time: 14ms
Planner:
- Total: 2ms / 1
Execution Profile 2f44e031-c2dc-11ed-bfea-2cea7fe99153:
- ExecutionTotalTime: 65.249ms
Fragment 0:
- BackendNum: 1
- InstanceNum: 1
- MemoryLimit: 80.00 GB
- PeakMemoryUsage: 33.04 KB
Pipeline (id=0):
- ActiveTime: 620.552us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverTotalTime: 65.249ms
- OverheadTime: 620.552us
- PendingTime: 64.548ms
- InputEmptyTime: 64.548ms
- FirstInputEmptyTime: 64.548ms
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 1
- ScheduleTime: 79.745us
- TotalDegreeOfParallelism: 1
- YieldByTimeLimit: 0
RESULT_SINK:
CommonMetrics:
- CloseTime: 7.95us
- OperatorTotalTime: 159.681us
- PeakMemoryUsage: 0.00
- PrepareTime: 37.479us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1
- PushRowNum: 100
- PushTotalTime: 152.97us
- SetFinishedTime: 49ns
- SetFinishingTime: 440ns
UniqueMetrics:
LIMIT (plan_node_id=2):
CommonMetrics:
- CloseTime: 316ns
- OperatorTotalTime: 1.373us
- PeakMemoryUsage: 0.00
- PrepareTime: 30.174us
- PullChunkNum: 1
- PullRowNum: 100
- PullTotalTime: 282ns
- PushChunkNum: 1
- PushRowNum: 100
- PushTotalTime: 551ns
- SetFinishedTime: 52ns
- SetFinishingTime: 172ns
UniqueMetrics:
EXCHANGE_MERGE_SORT_SOURCE (plan_node_id=2):
CommonMetrics:
- CloseTime: 962ns
- OperatorTotalTime: 452.596us
- PeakMemoryUsage: 0.00
- PrepareTime: 90.266us
- PullChunkNum: 1
- PullRowNum: 100
- PullTotalTime: 436.986us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 253ns
- SetFinishingTime: 14.395us
UniqueMetrics:
- BytesPassThrough: 9.68 KB
- BytesReceived: 11.54 KB
- DecompressChunkTime: 39.974us
- DeserializeChunkTime: 42.648us
- MergeSortedChunks: 378.671us
- ReceiverProcessTotalTime: 143.223us
- RequestReceived: 4
- SenderTotalTime: 141.272us
- SenderWaitLockTime: 1.801us
Fragment 1:
- BackendNum: 3
- InstanceNum: 3
- MemoryLimit: 40.00 GB
- PeakMemoryUsage: 39.71 MB
- __MAX_OF_PeakMemoryUsage: 17.21 MB
- __MIN_OF_PeakMemoryUsage: 11.12 MB
Pipeline (id=2):
- ActiveTime: 810.753us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverTotalTime: 45.20ms
- __MAX_OF_DriverTotalTime: 54.628ms
- __MIN_OF_DriverTotalTime: 26.773ms
- OverheadTime: 810.753us
- PendingTime: 43.748ms
- __MAX_OF_PendingTime: 53.412ms
- __MIN_OF_PendingTime: 25.839ms
- InputEmptyTime: 43.119ms
- __MAX_OF_InputEmptyTime: 52.983ms
- __MIN_OF_InputEmptyTime: 25.85ms
- FirstInputEmptyTime: 43.119ms
- __MAX_OF_FirstInputEmptyTime: 52.983ms
- __MIN_OF_FirstInputEmptyTime: 25.85ms
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 631.792us
- PreconditionBlockTime: 0ns
- ScheduleCount: 3
- ScheduleTime: 461.610us
- TotalDegreeOfParallelism: 3
- YieldByTimeLimit: 0
EXCHANGE_SINK (plan_node_id=2):
CommonMetrics:
- CloseTime: 16.10us
- OperatorTotalTime: 164.19us
- PeakMemoryUsage: 0.00
- PrepareTime: 72.873us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 3
- PushRowNum: 3.3K (3300)
- PushTotalTime: 51.194us
- SetFinishedTime: 56ns
- SetFinishingTime: 96.758us
UniqueMetrics:
- DestID: 2
- DestFragments: 2f44e031c2dc11ed-bfea2cea7fe99157
- PartType: UNPARTITIONED
- BytesPassThrough: 9.68 KB
- __MAX_OF_BytesPassThrough: 9.68 KB
- __MIN_OF_BytesPassThrough: 0.00
- BytesSent: 11.54 KB
- __MAX_OF_BytesSent: 6.33 KB
- __MIN_OF_BytesSent: 0.00
- CompressTime: 37.129us
- NetworkTime: 1.394ms
- OverallThroughput: 1.3044872283935547 MB/sec
- __MAX_OF_OverallThroughput: 1.3044872283935547 MB/sec
- __MIN_OF_OverallThroughput: 0.0 /sec
- RequestSent: 2
- __MAX_OF_RequestSent: 1
- __MIN_OF_RequestSent: 0
- SerializeChunkTime: 6.716us
- ShuffleHashTime: 0ns
- UncompressedBytes: 19.37 KB
- __MAX_OF_UncompressedBytes: 9.68 KB
- __MIN_OF_UncompressedBytes: 0.00
- WaitTime: 997.452us
LIMIT (plan_node_id=1):
CommonMetrics:
- CloseTime: 818ns
- OperatorTotalTime: 2.455us
- PeakMemoryUsage: 0.00
- PrepareTime: 24.89us
- PullChunkNum: 3
- PullRowNum: 3.3K (3300)
- PullTotalTime: 344ns
- PushChunkNum: 3
- PushRowNum: 3.3K (3300)
- PushTotalTime: 906ns
- SetFinishedTime: 210ns
- SetFinishingTime: 175ns
UniqueMetrics:
LOCAL_MERGE_SORT_SOURCE (plan_node_id=1):
CommonMetrics:
- CloseTime: 303.106us
- OperatorTotalTime: 948.46us
- PeakMemoryUsage: 0.00
- PrepareTime: 21.553us
- PullChunkNum: 3
- PullRowNum: 3.3K (3300)
- PullTotalTime: 644.407us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 139ns
- SetFinishingTime: 394ns
UniqueMetrics:
Pipeline (id=1):
- ActiveTime: 7.529ms
- __MAX_OF_ActiveTime: 17.678ms
- __MIN_OF_ActiveTime: 2.667ms
- BlockByInputEmpty: 281
- __MAX_OF_BlockByInputEmpty: 27
- __MIN_OF_BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 20
- DriverTotalTime: 14.515ms
- __MAX_OF_DriverTotalTime: 54.324ms
- __MIN_OF_DriverTotalTime: 4.199ms
- OverheadTime: 7.529ms
- __MAX_OF_OverheadTime: 17.678ms
- __MIN_OF_OverheadTime: 2.667ms
- PendingTime: 4.520ms
- __MAX_OF_PendingTime: 46.227ms
- __MIN_OF_PendingTime: 67.961us
- InputEmptyTime: 4.585ms
- __MAX_OF_InputEmptyTime: 46.242ms
- __MIN_OF_InputEmptyTime: 67.760us
- FirstInputEmptyTime: 138.408us
- FollowupInputEmptyTime: 4.446ms
- __MAX_OF_FollowupInputEmptyTime: 46.177ms
- __MIN_OF_FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 347
- __MAX_OF_ScheduleCount: 29
- __MIN_OF_ScheduleCount: 1
- ScheduleTime: 2.465ms
- TotalDegreeOfParallelism: 60
- YieldByTimeLimit: 0
PARTITION_SORT_SINK (plan_node_id=1):
CommonMetrics:
- CloseTime: 10.383us
- OperatorTotalTime: 4.295ms
- __MAX_OF_OperatorTotalTime: 14.273ms
- __MIN_OF_OperatorTotalTime: 7.831us
- PeakMemoryUsage: 0.00
- PrepareTime: 33.426us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 1.065K (1065)
- __MAX_OF_PushChunkNum: 54
- __MIN_OF_PushChunkNum: 0
- PushRowNum: 4.24876M (4248760)
- __MAX_OF_PushRowNum: 215.569K (215569)
- __MIN_OF_PushRowNum: 0
- PushTotalTime: 65.779us
- SetFinishedTime: 59ns
- SetFinishingTime: 4.219ms
- __MAX_OF_SetFinishingTime: 14.53ms
- __MIN_OF_SetFinishingTime: 1.85us
UniqueMetrics:
- SortKeys: 14: del_time DESC
- SortType: TopN
- BuildingTime: 424.597us
- MergingTime: 117.668us
- OutputTime: 0ns
- SortingTime: 3.673ms
- __MAX_OF_SortingTime: 11.51ms
- __MIN_OF_SortingTime: 0ns
OLAP_SCAN (plan_node_id=0):
CommonMetrics:
- CloseTime: 878.934us
- OperatorTotalTime: 2.746ms
- PeakMemoryUsage: 0.00
- PrepareTime: 32.862us
- PullChunkNum: 53.017K (53017)
- __MAX_OF_PullChunkNum: 3.308K (3308)
- __MIN_OF_PullChunkNum: 2
- PullRowNum: 4.24876M (4248760)
- __MAX_OF_PullRowNum: 215.569K (215569)
- __MIN_OF_PullRowNum: 0
- PullTotalTime: 1.867ms
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 322ns
- SetFinishingTime: 384ns
UniqueMetrics:
- MorselQueueType: fixed_morsel_queue
- Rollup: map_test
- Table: map_test
- BytesRead: 36.47 MB
- __MAX_OF_BytesRead: 1.79 MB
- __MIN_OF_BytesRead: 0.00
- CachedPagesNum: 0
- ChunkBufferCapacity: 3.84K (3840)
- CompressedBytesRead: 17.46 MB
- __MAX_OF_CompressedBytesRead: 887.59 KB
- __MIN_OF_CompressedBytesRead: 0.00
- CreateSegmentIter: 17.880us
- DefaultChunkBufferCapacity: 3.84K (3840)
- IOTime: 2.76ms
- __MAX_OF_IOTime: 48.110ms
- __MIN_OF_IOTime: 0ns
- MorselsCount: 120
- PeakChunkBufferSize: 103
- __MAX_OF_PeakChunkBufferSize: 52
- __MIN_OF_PeakChunkBufferSize: 24
- PushdownPredicates: 0
- RawRowsRead: 4.24876M (4248760)
- __MAX_OF_RawRowsRead: 208.175K (208175)
- __MIN_OF_RawRowsRead: 0
- ReadPagesNum: 546
- __MAX_OF_ReadPagesNum: 26
- __MIN_OF_ReadPagesNum: 0
- RowsRead: 4.24876M (4248760)
- __MAX_OF_RowsRead: 208.175K (208175)
- __MIN_OF_RowsRead: 0
- ScanTime: 3.326ms
- __MAX_OF_ScanTime: 49.541ms
- __MIN_OF_ScanTime: 4.134us
- SegmentInit: 138.513us
- __MAX_OF_SegmentInit: 6.178ms
- __MIN_OF_SegmentInit: 0ns
- BitmapIndexFilter: 0ns
- BitmapIndexFilterRows: 0
- BloomFilterFilterRows: 0
- SegmentZoneMapFilterRows: 0
- ShortKeyFilterRows: 0
- ZoneMapIndexFilterRows: 0
- SegmentRead: 3.149ms
- __MAX_OF_SegmentRead: 49.358ms
- __MIN_OF_SegmentRead: 0ns
- BlockFetch: 2.190ms
- __MAX_OF_BlockFetch: 32.254ms
- __MIN_OF_BlockFetch: 0ns
- BlockFetchCount: 1.065K (1065)
- __MAX_OF_BlockFetchCount: 51
- __MIN_OF_BlockFetchCount: 0
- BlockSeek: 948.812us
- __MAX_OF_BlockSeek: 25.668ms
- __MIN_OF_BlockSeek: 0ns
- BlockSeekCount: 546
- __MAX_OF_BlockSeekCount: 26
- __MIN_OF_BlockSeekCount: 0
- ChunkCopy: 0ns
- DecompressT: 104.963us
- DelVecFilterRows: 0
- IndexLoad: 0ns
- PredFilter: 0ns
- PredFilterRows: 0
- RowsetsReadCount: 120
- SegmentsReadCount: 56
- __MAX_OF_SegmentsReadCount: 1
- __MIN_OF_SegmentsReadCount: 0
- TotalColumnsDataPageCount: 546
- __MAX_OF_TotalColumnsDataPageCount: 26
- __MIN_OF_TotalColumnsDataPageCount: 0
- SubmitIOTaskCount: 120
- TabletCount: 120
- UncompressedBytesRead: 20.16 MB
- __MAX_OF_UncompressedBytesRead: 991.48 KB
- __MIN_OF_UncompressedBytesRead: 0.00
Pipeline (id=0):
- ActiveTime: 39.567us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverTotalTime: 2.454ms
- OverheadTime: 39.567us
- PendingTime: 0ns
- InputEmptyTime: 0ns
- FirstInputEmptyTime: 0ns
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 3
- ScheduleTime: 2.414ms
- TotalDegreeOfParallelism: 3
- YieldByTimeLimit: 0
NOOP_SINK (plan_node_id=0):
CommonMetrics:
- CloseTime: 695ns
- OperatorTotalTime: 1.31us
- PeakMemoryUsage: 0.00
- PrepareTime: 27.574us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 63ns
- SetFinishingTime: 272ns
UniqueMetrics:
OLAP_SCAN_PREPARE (plan_node_id=0):
CommonMetrics:
- CloseTime: 32.424us
- OperatorTotalTime: 58.378us
- PeakMemoryUsage: 0.00
- PrepareTime: 231.844us
- PullChunkNum: 3
- PullRowNum: 0
- PullTotalTime: 25.290us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 155ns
- SetFinishingTime: 508ns
UniqueMetrics:

这个最新的分支有pr合入修复了相关的问题,详请关注版本的更新,下个小版本升级验证下。