【详述】相同资源条件下，涉及大表join、滑窗操作时，StarRocks的查询性能不如Spark-SQL
【背景】两种查询引擎的性能验证
【业务影响】不能满足业务对实时性的要求
【是否存算分离】否
【StarRocks版本】3.1.4
【集群规模】1fe+3be（fe与be混部）
【机器信息】三台机器，每台配置：16核+64G内存
【附件】
表table_a和表table_b的行数均是千万级
SQL语句：
SELECT
EventIndex, A.neId, A.cellId, A.callId, A.longitude, A.latitude, A.time, B.eventId
ROW_NUMBER() OVER (PARTITION BY A.neId, A.cellId, A.callId, A.time ORDER BY B.eventId,
ABS(A.time - B.time)) rn
FROM
table_a A
LEFT JOIN
table_b B
ON A.neId=B.neId AND A.callId=B.callId
AND
(
ABS(A.time - B.time) < 18000000
AND ABS(A.time - B.time) < ABS(A.time - B.previous_time)
AND ABS(A.time - B.time) <= ABS(A.time - B.next_time)
)；
Spark-SQL耗时：60.256秒
StarRocks耗时：92.44秒
麻烦您这边帮忙获取下starrocks这个SQL执行的profile。
另外辛苦试下将WHERE条件里的这些删掉，sr里执行时间会快一些吗
AND
(
ABS(A.time - B.time) < 18000000
AND ABS(A.time - B.time) < ABS(A.time - B.previous_time)
AND ABS(A.time - B.time) <= ABS(A.time - B.next_time)
)
去掉where条件，执行时间相差不多
profile咋提供给你，复制粘贴到回复报403
麻烦参照文档获取下profile：https://docs.starrocks.io/zh/docs/3.1/administration/query_profile_overview/
另外当前存在形如a.col3<b.col2这类的比较时速度较慢的情况，这个目前在优化中
以及想请教下，怎么把sql的查询结果，直接写入到hdfs中，这样会不会比写入内部表快？
profile可以保存在文件里上传下
保存到hdfs中可以使用select into outfile的方式：
SELECT * FROM tbl
INTO OUTFILE “hdfs://path/to/result_”
FORMAT AS CSV
PROPERTIES
(
“broker.name” = “my_broker”,
“broker.username” = “starrocks”,
“column_separator” = “,”,
“line_delimiter” = “\n”,
“max_file_size” = “100MB”
);
我们尝试过返回limit 10, 不做大数据量的返回，但是对比结果还是StarRocks无优势
可以试下把SQL中有关ABS(A.time - B.time)、 ABS(A.time - B.previous_time)、 ABS(A.time - B.next_time)的条件去掉看下时间。
另外就原SQL麻烦用这种方式上传文件的形式，帮忙提供下加limit和不加limit的profile
公司网络有限制，无法上传文件，只能复制文本，抱歉了
Fragment 2:
- BackendAddresses: 7.189.49.132:9060,7.189.49.48:9060,7.189.52.23:9060
- InstanceIds: b69ceae5-adca-11ee-8bb6-02422059220f,b69ceae5-adca-11ee-8bb6-024220592211,b69ceae5-adca-11ee-8bb6-024220592210
- BackendNum: 3
- BackendProfileMergeTime: 2.789ms
- __MAX_OF_BackendProfileMergeTime: 3.091ms
- __MIN_OF_BackendProfileMergeTime: 2.381ms
- FragmentInstancePrepareTime: 198.217us
- __MAX_OF_FragmentInstancePrepareTime: 248.060us
- __MIN_OF_FragmentInstancePrepareTime: 155.478us
- prepare-fragment-ctx: 14.325us
- __MAX_OF_prepare-fragment-ctx: 18.877us
- __MIN_OF_prepare-fragment-ctx: 11.284us
- prepare-pipeline-driver: 39.289us
- __MAX_OF_prepare-pipeline-driver: 47.112us
- __MIN_OF_prepare-pipeline-driver: 28.760us
- prepare-query-ctx: 2.228us
- __MAX_OF_prepare-query-ctx: 2.672us
- __MIN_OF_prepare-query-ctx: 1.790us
- prepare-runtime-state: 39.289us
- __MAX_OF_prepare-runtime-state: 47.112us
- __MIN_OF_prepare-runtime-state: 28.760us
- InitialProcessDriverCount: 104
- __MAX_OF_InitialProcessDriverCount: 40
- __MIN_OF_InitialProcessDriverCount: 32
- InitialProcessMem: 40.149 GB
- __MAX_OF_InitialProcessMem: 13.408 GB
- __MIN_OF_InitialProcessMem: 13.357 GB
- InstanceAllocatedMemoryUsage: 11.251 GB
- __MAX_OF_InstanceAllocatedMemoryUsage: 3.796 GB
- __MIN_OF_InstanceAllocatedMemoryUsage: 3.722 GB
- InstanceDeallocatedMemoryUsage: 10.380 GB
- __MAX_OF_InstanceDeallocatedMemoryUsage: 3.490 GB
- __MIN_OF_InstanceDeallocatedMemoryUsage: 3.440 GB
- InstanceNum: 3
- InstancePeakMemoryUsage: 178.620 MB
- __MAX_OF_InstancePeakMemoryUsage: 188.394 MB
- __MIN_OF_InstancePeakMemoryUsage: 168.160 MB
- QueryMemoryLimit: 45.739 GB
Pipeline (id=1):
- ActiveTime: 400.725ms
- __MAX_OF_ActiveTime: 1s203ms
- __MIN_OF_ActiveTime: 531.372us
- BlockByInputEmpty: 58
- __MAX_OF_BlockByInputEmpty: 7
- __MIN_OF_BlockByInputEmpty: 1
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 7
- DriverPrepareTime: 95.618us
- __MAX_OF_DriverPrepareTime: 132.517us
- __MIN_OF_DriverPrepareTime: 71.238us
- DriverTotalTime: 1s242ms
- __MAX_OF_DriverTotalTime: 1s274ms
- __MIN_OF_DriverTotalTime: 1s177ms
- OverheadTime: 5.302ms
- __MAX_OF_OverheadTime: 41.772ms
- __MIN_OF_OverheadTime: 0ns
- PeakDriverQueueSize: 138
- __MAX_OF_PeakDriverQueueSize: 11
- __MIN_OF_PeakDriverQueueSize: 4
- PendingTime: 808.937ms
- __MAX_OF_PendingTime: 1s273ms
- __MIN_OF_PendingTime: 7.201ms
- InputEmptyTime: 591.592ms
- __MAX_OF_InputEmptyTime: 1s236ms
- __MIN_OF_InputEmptyTime: 1.595ms
- FirstInputEmptyTime: 55.017us
- __MAX_OF_FirstInputEmptyTime: 61.848us
- __MIN_OF_FirstInputEmptyTime: 45.056us
- FollowupInputEmptyTime: 591.537ms
- __MAX_OF_FollowupInputEmptyTime: 1s236ms
- __MIN_OF_FollowupInputEmptyTime: 1.535ms
- OutputFullTime: 0ns
- PendingFinishTime: 217.361ms
- __MAX_OF_PendingFinishTime: 444.956ms
- __MIN_OF_PendingFinishTime: 5.016ms
- PreconditionBlockTime: 0ns
- ScheduleCount: 137
- __MAX_OF_ScheduleCount: 12
- __MIN_OF_ScheduleCount: 2
- ScheduleTime: 32.620ms
- __MAX_OF_ScheduleTime: 92.503ms
- __MIN_OF_ScheduleTime: 265.179us
- TotalDegreeOfParallelism: 21
- __MAX_OF_TotalDegreeOfParallelism: 7
- __MIN_OF_TotalDegreeOfParallelism: 7
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 58
- __MAX_OF_YieldByTimeLimit: 10
- __MIN_OF_YieldByTimeLimit: 0
EXCHANGE_SINK (plan_node_id=3):
CommonMetrics:
- CloseTime: 2.983us
- __MAX_OF_CloseTime: 23.575us
- __MIN_OF_CloseTime: 153ns
- OperatorAllocatedMemoryUsage: 3.194 GB
- __MAX_OF_OperatorAllocatedMemoryUsage: 478.485 MB
- __MIN_OF_OperatorAllocatedMemoryUsage: 1.813 KB
- OperatorDeallocatedMemoryUsage: 2.582 GB
- __MAX_OF_OperatorDeallocatedMemoryUsage: 412.500 MB
- __MIN_OF_OperatorDeallocatedMemoryUsage: 960.000 B
- OperatorPeakMemoryUsage: 29.855 MB
- __MAX_OF_OperatorPeakMemoryUsage: 77.983 MB
- __MIN_OF_OperatorPeakMemoryUsage: 128.000 B
- OperatorTotalTime: 393.434ms
- __MAX_OF_OperatorTotalTime: 1s186ms
- __MIN_OF_OperatorTotalTime: 10.443us
- PrepareTime: 60.258us
- __MAX_OF_PrepareTime: 86.719us
- __MIN_OF_PrepareTime: 42.101us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 5.772K (5772)
- __MAX_OF_PushChunkNum: 900
- __MIN_OF_PushChunkNum: 0
- PushRowNum: 23.640M (23639836)
- __MAX_OF_PushRowNum: 3.686M (3685577)
- __MIN_OF_PushRowNum: 0
- PushTotalTime: 389.595ms
- __MAX_OF_PushTotalTime: 1s184ms
- __MIN_OF_PushTotalTime: 0ns
- SetFinishedTime: 86ns
- __MAX_OF_SetFinishedTime: 181ns
- __MIN_OF_SetFinishedTime: 26ns
- SetFinishingTime: 3.835ms
- __MAX_OF_SetFinishingTime: 13.948ms
- __MIN_OF_SetFinishingTime: 10.153us
UniqueMetrics:
- ChannelNum: 3
- DestFragments: b69ceae5adca11ee-8bb6024220592212, b69ceae5adca11ee-8bb6024220592213, b69ceae5adca11ee-8bb6024220592214
- DestID: 3
- PartType: HASH_PARTITIONED
- PipelineLevelShuffle: Yes
- ShuffleNumPerChannel: 8
- TotalShuffleNum: 24
- BytesPassThrough: 676.595 MB
- __MAX_OF_BytesPassThrough: 105.470 MB
- __MIN_OF_BytesPassThrough: 0.000 B
- BytesSent: 692.795 MB
- __MAX_OF_BytesSent: 230.957 MB
- __MIN_OF_BytesSent: 230.908 MB
- BytesUnsent: 0.000 B
- CompressTime: 0ns
- CompressedBytes: 0.000 B
- NetworkBandwidth: 785.676 MB/sec
- __MAX_OF_NetworkBandwidth: 329.902 MB/sec
- __MIN_OF_NetworkBandwidth: 202.947 MB/sec
- NetworkTime: 917.089ms
- __MAX_OF_NetworkTime: 1s137ms
- __MIN_OF_NetworkTime: 699.994ms
- OverallThroughput: 571.581 MB/sec
- __MAX_OF_OverallThroughput: 202.259 MB/sec
- __MIN_OF_OverallThroughput: 184.386 MB/sec
- OverallTime: 1s214ms
- __MAX_OF_OverallTime: 1s252ms
- __MIN_OF_OverallTime: 1s141ms
- RequestSent: 1.983K (1983)
- __MAX_OF_RequestSent: 663
- __MIN_OF_RequestSent: 660
- RequestUnsent: 0
- RpcAvgTime: 40.093ms
- __MAX_OF_RpcAvgTime: 66.973ms
- __MIN_OF_RpcAvgTime: 10.661ms
- RpcCount: 3.957K (3957)
- __MAX_OF_RpcCount: 1.322K (1322)
- __MIN_OF_RpcCount: 1.317K (1317)
- SenderInputBytes: 1.321 GB
- __MAX_OF_SenderInputBytes: 210.976 MB
- __MIN_OF_SenderInputBytes: 0.000 B
- SerializeChunkTime: 47.506ms
- __MAX_OF_SerializeChunkTime: 125.398ms
- __MIN_OF_SerializeChunkTime: 0ns
- SerializedBytes: 692.795 MB
- __MAX_OF_SerializedBytes: 107.558 MB
- __MIN_OF_SerializedBytes: 0.000 B
- ShuffleChunkAppendCounter: 138.528K (138528)
- __MAX_OF_ShuffleChunkAppendCounter: 21.600K (21600)
- __MIN_OF_ShuffleChunkAppendCounter: 0
- ShuffleChunkAppendTime: 202.378ms
- __MAX_OF_ShuffleChunkAppendTime: 609.144ms
- __MIN_OF_ShuffleChunkAppendTime: 0ns
- ShuffleHashTime: 18.555ms
- __MAX_OF_ShuffleHashTime: 73.728ms
- __MIN_OF_ShuffleHashTime: 0ns
- WaitTime: 200.153ms
- __MAX_OF_WaitTime: 422.918ms
- __MIN_OF_WaitTime: 5.943ms
OLAP_SCAN (plan_node_id=2):
CommonMetrics:
- CloseTime: 441.893us
- __MAX_OF_CloseTime: 889.338us
- __MIN_OF_CloseTime: 13.112us
- JoinRuntimeFilterEvaluate: 0
- JoinRuntimeFilterHashTime: 0ns
- JoinRuntimeFilterInputRows: 0
- JoinRuntimeFilterOutputRows: 0
- JoinRuntimeFilterTime: 0ns
- OperatorAllocatedMemoryUsage: 10.058 GB
- __MAX_OF_OperatorAllocatedMemoryUsage: 1.563 GB
- __MIN_OF_OperatorAllocatedMemoryUsage: 5.453 KB
- OperatorDeallocatedMemoryUsage: 7.859 GB
- __MAX_OF_OperatorDeallocatedMemoryUsage: 1.223 GB
- __MIN_OF_OperatorDeallocatedMemoryUsage: 3.227 KB
- OperatorPeakMemoryUsage: 107.319 MB
- __MAX_OF_OperatorPeakMemoryUsage: 348.175 MB
- __MIN_OF_OperatorPeakMemoryUsage: 2.227 KB
- OperatorTotalTime: 1.991ms
- __MAX_OF_OperatorTotalTime: 3.774ms
- __MIN_OF_OperatorTotalTime: 512.547us
- PrepareTime: 16.632us
- __MAX_OF_PrepareTime: 25.686us
- __MIN_OF_PrepareTime: 11.924us
- PullChunkNum: 5.772K (5772)
- __MAX_OF_PullChunkNum: 900
- __MIN_OF_PullChunkNum: 0
- PullRowNum: 23.640M (23639836)
- __MAX_OF_PullRowNum: 3.686M (3685577)
- __MIN_OF_PullRowNum: 0
- PullTotalTime: 1.548ms
- __MAX_OF_PullTotalTime: 2.875ms
- __MIN_OF_PullTotalTime: 495.633us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 580ns
- __MAX_OF_SetFinishedTime: 8.560us
- __MIN_OF_SetFinishedTime: 37ns
- SetFinishingTime: 737ns
- __MAX_OF_SetFinishingTime: 1.611us
- __MIN_OF_SetFinishingTime: 363ns
UniqueMetrics:
- BufferUnplugThreshold: 32
- MorselQueueType: physical_split_morsel_queue
- Rollup: INTRA_FREQ_JOIN_NSA_FLAG_2
- SharedScan: False
- Table: INTRA_FREQ_JOIN_NSA_FLAG_2
- BufferUnplugCount: 26
- __MAX_OF_BufferUnplugCount: 4
- __MIN_OF_BufferUnplugCount: 0
- BytesRead: 1.982 GB
- __MAX_OF_BytesRead: 158.179 MB
- __MIN_OF_BytesRead: 90.000 MB
- CachedPagesNum: 50
- __MAX_OF_CachedPagesNum: 5
- __MIN_OF_CachedPagesNum: 0
- ChunkBufferCapacity: 448
- CompressedBytesRead: 262.221 MB
- __MAX_OF_CompressedBytesRead: 20.328 MB
- __MIN_OF_CompressedBytesRead: 11.574 MB
- DefaultChunkBufferCapacity: 448
- IOTaskExecTime: 319.961ms
- __MAX_OF_IOTaskExecTime: 501.128ms
- __MIN_OF_IOTaskExecTime: 188.163ms
- CreateSegmentIter: 217.681us
- __MAX_OF_CreateSegmentIter: 356.576us
- __MIN_OF_CreateSegmentIter: 11.812us
- GetDelVec: 0ns
- GetDeltaColumnGroup: 206.269us
- __MAX_OF_GetDeltaColumnGroup: 339.785us
- __MIN_OF_GetDeltaColumnGroup: 2.041us
- GetRowsets: 161ns
- __MAX_OF_GetRowsets: 254ns
- __MIN_OF_GetRowsets: 102ns
- IOTime: 20.429ms
- __MAX_OF_IOTime: 89.499ms
- __MIN_OF_IOTime: 6.935ms
- ReadPKIndex: 0ns
- SegmentInit: 454.362us
- __MAX_OF_SegmentInit: 1.292ms
- __MIN_OF_SegmentInit: 128.319us
- BitmapIndexFilter: 0ns
- BitmapIndexFilterRows: 0
- BitmapIndexIteratorInit: 2.648us
- __MAX_OF_BitmapIndexIteratorInit: 4.408us
- __MIN_OF_BitmapIndexIteratorInit: 1.397us
- BloomFilterFilter: 0ns
- BloomFilterFilterRows: 0
- ColumnIteratorInit: 292.940us
- __MAX_OF_ColumnIteratorInit: 1.167ms
- __MIN_OF_ColumnIteratorInit: 12.591us
- SegmentRuntimeZoneMapFilterRows: 0
- SegmentZoneMapFilterRows: 0
- ShortKeyFilter: 49.008us
- __MAX_OF_ShortKeyFilter: 121.758us
- __MIN_OF_ShortKeyFilter: 17.839us
- ShortKeyFilterRows: 0
- ZoneMapIndexFilterRows: 0
- ZoneMapIndexFiter: 1.070us
- __MAX_OF_ZoneMapIndexFiter: 1.945us
- __MIN_OF_ZoneMapIndexFiter: 571ns
- SegmentRead: 304.068ms
- __MAX_OF_SegmentRead: 487.860ms
- __MIN_OF_SegmentRead: 179.351ms
- BlockFetch: 302.120ms
- __MAX_OF_BlockFetch: 486.034ms
- __MIN_OF_BlockFetch: 177.860ms
- BlockFetchCount: 5.772K (5772)
- __MAX_OF_BlockFetchCount: 450
- __MIN_OF_BlockFetchCount: 256
- BlockSeek: 1.102ms
- __MAX_OF_BlockSeek: 1.586ms
- __MIN_OF_BlockSeek: 759.011us
- BlockSeekCount: 25.800K (25800)
- __MAX_OF_BlockSeekCount: 2.017K (2017)
- __MIN_OF_BlockSeekCount: 1.141K (1141)
- ChunkCopy: 0ns
- DecompressT: 6.171ms
- __MAX_OF_DecompressT: 39.166ms
- __MIN_OF_DecompressT: 1.729ms
- DelVecFilterRows: 0
- PredFilter: 0ns
- PredFilterRows: 0
- RowsetsReadCount: 18
- __MAX_OF_RowsetsReadCount: 1
- __MIN_OF_RowsetsReadCount: 1
- SegmentsReadCount: 18
- __MAX_OF_SegmentsReadCount: 1
- __MIN_OF_SegmentsReadCount: 1
- TotalColumnsDataPageCount: 78.012K (78012)
- __MAX_OF_TotalColumnsDataPageCount: 4.334K (4334)
- __MIN_OF_TotalColumnsDataPageCount: 4.334K (4334)
- IOTaskWaitTime: 82.799ms
- __MAX_OF_IOTaskWaitTime: 196.343ms
- __MIN_OF_IOTaskWaitTime: 3.831ms
- MorselsCount: 18
- __MAX_OF_MorselsCount: 2
- __MIN_OF_MorselsCount: 0
- PeakChunkBufferSize: 212
- PeakIOTasks: 0
- __MAX_OF_PeakIOTasks: 2
- __MIN_OF_PeakIOTasks: 0
- PeakScanTaskQueueSize: 63
- __MAX_OF_PeakScanTaskQueueSize: 8
- __MIN_OF_PeakScanTaskQueueSize: 0
- PushdownPredicates: 0
- RawRowsRead: 23.640M (23639836)
- __MAX_OF_RawRowsRead: 1.843M (1842913)
- __MIN_OF_RawRowsRead: 1.049M (1048576)
- ReadPagesNum: 26.147K (26147)
- __MAX_OF_ReadPagesNum: 2.039K (2039)
- __MIN_OF_ReadPagesNum: 1.156K (1156)
- RowsRead: 23.640M (23639836)
- __MAX_OF_RowsRead: 1.843M (1842913)
- __MIN_OF_RowsRead: 1.049M (1048576)
- ScanTime: 402.761ms
- __MAX_OF_ScanTime: 635.490ms
- __MIN_OF_ScanTime: 218.268ms
- SubmitTaskCount: 108
- __MAX_OF_SubmitTaskCount: 16
- __MIN_OF_SubmitTaskCount: 0
- TabletCount: 6
- __MAX_OF_TabletCount: 2
- __MIN_OF_TabletCount: 2
- UncompressedBytesRead: 267.208 MB
- __MAX_OF_UncompressedBytesRead: 20.712 MB
- __MIN_OF_UncompressedBytesRead: 11.787 MB
Pipeline (id=0):
- ActiveTime: 41.298us
- __MAX_OF_ActiveTime: 44.256us
- __MIN_OF_ActiveTime: 36.284us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverPrepareTime: 53.944us
- __MAX_OF_DriverPrepareTime: 69.146us
- __MIN_OF_DriverPrepareTime: 46.178us
- DriverTotalTime: 67.487us
- __MAX_OF_DriverTotalTime: 72.304us
- __MIN_OF_DriverTotalTime: 59.500us
- OverheadTime: 0ns
- PeakDriverQueueSize: 0
- PendingTime: 0ns
- InputEmptyTime: 0ns
- FirstInputEmptyTime: 0ns
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 3
- __MAX_OF_ScheduleCount: 1
- __MIN_OF_ScheduleCount: 1
- ScheduleTime: 26.188us
- __MAX_OF_ScheduleTime: 28.048us
- __MIN_OF_ScheduleTime: 23.216us
- TotalDegreeOfParallelism: 3
- __MAX_OF_TotalDegreeOfParallelism: 1
- __MIN_OF_TotalDegreeOfParallelism: 1
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
NOOP_SINK (plan_node_id=2):
CommonMetrics:
- IsSubordinate
- CloseTime: 136ns
- __MAX_OF_CloseTime: 139ns
- __MIN_OF_CloseTime: 133ns
- OperatorAllocatedMemoryUsage: 0.000 B
- OperatorDeallocatedMemoryUsage: 0.000 B
- OperatorPeakMemoryUsage: 0.000 B
- OperatorTotalTime: 275ns
- __MAX_OF_OperatorTotalTime: 287ns
- __MIN_OF_OperatorTotalTime: 256ns
- PrepareTime: 11.297us
- __MAX_OF_PrepareTime: 14.971us
- __MIN_OF_PrepareTime: 8.983us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 36ns
- __MAX_OF_SetFinishedTime: 42ns
- __MIN_OF_SetFinishedTime: 28ns
- SetFinishingTime: 102ns
- __MAX_OF_SetFinishingTime: 112ns
- __MIN_OF_SetFinishingTime: 89ns
UniqueMetrics:
OLAP_SCAN_PREPARE (plan_node_id=2):
CommonMetrics:
- IsSubordinate
- CloseTime: 7.072us
- __MAX_OF_CloseTime: 10.149us
- __MIN_OF_CloseTime: 5.453us
- OperatorAllocatedMemoryUsage: 15.727 KB
- __MAX_OF_OperatorAllocatedMemoryUsage: 5.242 KB
- __MIN_OF_OperatorAllocatedMemoryUsage: 5.242 KB
- OperatorDeallocatedMemoryUsage: 2.039 KB
- __MAX_OF_OperatorDeallocatedMemoryUsage: 696.000 B
- __MIN_OF_OperatorDeallocatedMemoryUsage: 696.000 B
- OperatorPeakMemoryUsage: 4.563 KB
- OperatorTotalTime: 42.600us
- __MAX_OF_OperatorTotalTime: 48.310us
- __MIN_OF_OperatorTotalTime: 36.196us
- PrepareTime: 19.796us
- __MAX_OF_PrepareTime: 25.915us
- __MIN_OF_PrepareTime: 16.321us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 35.362us
- __MAX_OF_PullTotalTime: 37.988us
- __MIN_OF_PullTotalTime: 30.603us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 63ns
- __MAX_OF_SetFinishedTime: 74ns
- __MIN_OF_SetFinishedTime: 53ns
- SetFinishingTime: 103ns
- __MAX_OF_SetFinishingTime: 111ns
- __MIN_OF_SetFinishingTime: 87ns
UniqueMetrics:
Fragment 3:
- BackendAddresses: 7.189.49.132:9060,7.189.49.48:9060,7.189.52.23:9060
- InstanceIds: b69ceae5-adca-11ee-8bb6-02422059220e,b69ceae5-adca-11ee-8bb6-02422059220d,b69ceae5-adca-11ee-8bb6-02422059220c
- BackendNum: 3
- BackendProfileMergeTime: 3.527ms
- __MAX_OF_BackendProfileMergeTime: 5.350ms
- __MIN_OF_BackendProfileMergeTime: 2.196ms
- FragmentInstancePrepareTime: 232.234us
- __MAX_OF_FragmentInstancePrepareTime: 296.250us
- __MIN_OF_FragmentInstancePrepareTime: 169.204us
- prepare-fragment-ctx: 18.672us
- __MAX_OF_prepare-fragment-ctx: 21.705us
- __MIN_OF_prepare-fragment-ctx: 12.868us
- prepare-pipeline-driver: 49.028us
- __MAX_OF_prepare-pipeline-driver: 63.845us
- __MIN_OF_prepare-pipeline-driver: 34.988us
- prepare-query-ctx: 2.658us
- __MAX_OF_prepare-query-ctx: 2.981us
- __MIN_OF_prepare-query-ctx: 2.085us
- prepare-runtime-state: 49.028us
- __MAX_OF_prepare-runtime-state: 63.845us
- __MIN_OF_prepare-runtime-state: 34.988us
- InitialProcessDriverCount: 104
- __MAX_OF_InitialProcessDriverCount: 40
- __MIN_OF_InitialProcessDriverCount: 32
- InitialProcessMem: 40.149 GB
- __MAX_OF_InitialProcessMem: 13.408 GB
- __MIN_OF_InitialProcessMem: 13.357 GB
- InstanceAllocatedMemoryUsage: 209.625 GB
- __MAX_OF_InstanceAllocatedMemoryUsage: 69.996 GB
- __MIN_OF_InstanceAllocatedMemoryUsage: 69.742 GB
- InstanceDeallocatedMemoryUsage: 192.806 GB
- __MAX_OF_InstanceDeallocatedMemoryUsage: 64.366 GB
- __MIN_OF_InstanceDeallocatedMemoryUsage: 64.153 GB
- InstanceNum: 3
- InstancePeakMemoryUsage: 3.300 GB
- __MAX_OF_InstancePeakMemoryUsage: 3.515 GB
- __MIN_OF_InstancePeakMemoryUsage: 3.103 GB
- QueryMemoryLimit: 45.739 GB
Pipeline (id=0):
- ActiveTime: 47.969us
- __MAX_OF_ActiveTime: 50.231us
- __MIN_OF_ActiveTime: 43.567us
- BlockByInputEmpty: 0
- BlockByOutputFull: 0
- BlockByPrecondition: 0
- DegreeOfParallelism: 1
- DriverPrepareTime: 55.042us
- __MAX_OF_DriverPrepareTime: 70.180us
- __MIN_OF_DriverPrepareTime: 45.213us
- DriverTotalTime: 94.245us
- __MAX_OF_DriverTotalTime: 119.915us
- __MIN_OF_DriverTotalTime: 77.183us
- OverheadTime: 1.019us
- __MAX_OF_OverheadTime: 2.180us
- __MIN_OF_OverheadTime: 0ns
- PeakDriverQueueSize: 0
- PendingTime: 0ns
- InputEmptyTime: 0ns
- FirstInputEmptyTime: 0ns
- FollowupInputEmptyTime: 0ns
- OutputFullTime: 0ns
- PendingFinishTime: 0ns
- PreconditionBlockTime: 0ns
- ScheduleCount: 3
- __MAX_OF_ScheduleCount: 1
- __MIN_OF_ScheduleCount: 1
- ScheduleTime: 46.275us
- __MAX_OF_ScheduleTime: 76.348us
- __MIN_OF_ScheduleTime: 27.073us
- TotalDegreeOfParallelism: 3
- __MAX_OF_TotalDegreeOfParallelism: 1
- __MIN_OF_TotalDegreeOfParallelism: 1
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 0
NOOP_SINK (plan_node_id=0):
CommonMetrics:
- IsSubordinate
- CloseTime: 175ns
- __MAX_OF_CloseTime: 189ns
- __MIN_OF_CloseTime: 151ns
- OperatorAllocatedMemoryUsage: 0.000 B
- OperatorDeallocatedMemoryUsage: 0.000 B
- OperatorPeakMemoryUsage: 0.000 B
- OperatorTotalTime: 310ns
- __MAX_OF_OperatorTotalTime: 337ns
- __MIN_OF_OperatorTotalTime: 283ns
- PrepareTime: 11.817us
- __MAX_OF_PrepareTime: 14.833us
- __MIN_OF_PrepareTime: 10.166us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- SetFinishedTime: 32ns
- __MAX_OF_SetFinishedTime: 40ns
- __MIN_OF_SetFinishedTime: 28ns
- SetFinishingTime: 103ns
- __MAX_OF_SetFinishingTime: 112ns
- __MIN_OF_SetFinishingTime: 93ns
UniqueMetrics:
OLAP_SCAN_PREPARE (plan_node_id=0):
CommonMetrics:
- IsSubordinate
- CloseTime: 5.539us
- __MAX_OF_CloseTime: 6.241us
- __MIN_OF_CloseTime: 4.908us
- OperatorAllocatedMemoryUsage: 25.195 KB
- __MAX_OF_OperatorAllocatedMemoryUsage: 8.398 KB
- __MIN_OF_OperatorAllocatedMemoryUsage: 8.398 KB
- OperatorDeallocatedMemoryUsage: 4.852 KB
- __MAX_OF_OperatorDeallocatedMemoryUsage: 1.617 KB
- __MIN_OF_OperatorDeallocatedMemoryUsage: 1.617 KB
- OperatorPeakMemoryUsage: 6.781 KB
- OperatorTotalTime: 47.146us
- __MAX_OF_OperatorTotalTime: 51.293us
- __MIN_OF_OperatorTotalTime: 41.077us
- PrepareTime: 19.204us
- __MAX_OF_PrepareTime: 23.944us
- __MIN_OF_PrepareTime: 15.057us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 41.436us
- __MAX_OF_PullTotalTime: 44.891us
- __MIN_OF_PullTotalTime: 35.466us
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 53ns
- __MAX_OF_SetFinishedTime: 55ns
- __MIN_OF_SetFinishedTime: 53ns
- SetFinishingTime: 116ns
- __MAX_OF_SetFinishingTime: 155ns
- __MIN_OF_SetFinishingTime: 88ns
UniqueMetrics:
Pipeline (id=1):
- ActiveTime: 6s242ms
- __MAX_OF_ActiveTime: 9s277ms
- __MIN_OF_ActiveTime: 3s122ms
- BlockByInputEmpty: 87
- __MAX_OF_BlockByInputEmpty: 11
- __MIN_OF_BlockByInputEmpty: 1
- BlockByOutputFull: 1.802K (1802)
- __MAX_OF_BlockByOutputFull: 152
- __MIN_OF_BlockByOutputFull: 1
- BlockByPrecondition: 0
- DegreeOfParallelism: 8
- DriverPrepareTime: 98.502us
- __MAX_OF_DriverPrepareTime: 141.795us
- __MIN_OF_DriverPrepareTime: 74.576us
- DriverTotalTime: 13s796ms
- __MAX_OF_DriverTotalTime: 14s384ms
- __MIN_OF_DriverTotalTime: 13s221ms
- OverheadTime: 47.363ms
- __MAX_OF_OverheadTime: 114.109ms
- __MIN_OF_OverheadTime: 13.011ms
- PeakDriverQueueSize: 186
- __MAX_OF_PeakDriverQueueSize: 12
- __MIN_OF_PeakDriverQueueSize: 4
- PendingTime: 7s315ms
- __MAX_OF_PendingTime: 10s433ms
- __MIN_OF_PendingTime: 3s896ms
- InputEmptyTime: 3s297ms
- __MAX_OF_InputEmptyTime: 6s442ms
- __MIN_OF_InputEmptyTime: 14.857ms
- FirstInputEmptyTime: 75.993us
- __MAX_OF_FirstInputEmptyTime: 98.901us
- __MIN_OF_FirstInputEmptyTime: 56.241us
- FollowupInputEmptyTime: 3s297ms
- __MAX_OF_FollowupInputEmptyTime: 6s442ms
- __MIN_OF_FollowupInputEmptyTime: 14.759ms
- OutputFullTime: 2s621ms
- __MAX_OF_OutputFullTime: 5s29ms
- __MIN_OF_OutputFullTime: 1s65ms
- PendingFinishTime: 1s398ms
- __MAX_OF_PendingFinishTime: 3s358ms
- __MIN_OF_PendingFinishTime: 31.460ms
- PreconditionBlockTime: 0ns
- ScheduleCount: 2.925K (2925)
- __MAX_OF_ScheduleCount: 200
- __MIN_OF_ScheduleCount: 66
- ScheduleTime: 238.795ms
- __MAX_OF_ScheduleTime: 404.151ms
- __MIN_OF_ScheduleTime: 28.115ms
- TotalDegreeOfParallelism: 24
- __MAX_OF_TotalDegreeOfParallelism: 8
- __MIN_OF_TotalDegreeOfParallelism: 8
- YieldByLocalWait: 0
- YieldByPreempt: 0
- YieldByTimeLimit: 1.031K (1031)
- __MAX_OF_YieldByTimeLimit: 81
- __MIN_OF_YieldByTimeLimit: 19
EXCHANGE_SINK (plan_node_id=1):
CommonMetrics:
- CloseTime: 1.237us
- __MAX_OF_CloseTime: 10.532us
- __MIN_OF_CloseTime: 133ns
- OperatorAllocatedMemoryUsage: 52.637 GB
- __MAX_OF_OperatorAllocatedMemoryUsage: 4.179 GB
- __MIN_OF_OperatorAllocatedMemoryUsage: 1.018 GB
- OperatorDeallocatedMemoryUsage: 33.485 GB
- __MAX_OF_OperatorDeallocatedMemoryUsage: 2.925 GB
- __MIN_OF_OperatorDeallocatedMemoryUsage: 474.733 MB
- OperatorPeakMemoryUsage: 818.766 MB
- __MAX_OF_OperatorPeakMemoryUsage: 1.256 GB
- __MIN_OF_OperatorPeakMemoryUsage: 549.466 MB
- OperatorTotalTime: 6s179ms
- __MAX_OF_OperatorTotalTime: 9s122ms
- __MIN_OF_OperatorTotalTime: 3s96ms
- PrepareTime: 60.334us
- __MAX_OF_PrepareTime: 91.579us
- __MIN_OF_PrepareTime: 46.486us
- PullChunkNum: 0
- PullRowNum: 0
- PullTotalTime: 0ns
- PushChunkNum: 9.528K (9528)
- __MAX_OF_PushChunkNum: 719
- __MIN_OF_PushChunkNum: 189
- PushRowNum: 38.893M (38893279)
- __MAX_OF_PushRowNum: 2.937M (2936647)
- __MIN_OF_PushRowNum: 771.366K (771366)
- PushTotalTime: 6s146ms
- __MAX_OF_PushTotalTime: 9s91ms
- __MIN_OF_PushTotalTime: 3s58ms
- SetFinishedTime: 116ns
- __MAX_OF_SetFinishedTime: 182ns
- __MIN_OF_SetFinishedTime: 69ns
- SetFinishingTime: 33.497ms
- __MAX_OF_SetFinishingTime: 56.663ms
- __MIN_OF_SetFinishingTime: 14.692ms
UniqueMetrics:
- ChannelNum: 3
- DestFragments: b69ceae5adca11ee-8bb6024220592212, b69ceae5adca11ee-8bb6024220592213, b69ceae5adca11ee-8bb6024220592214
- DestID: 1
- PartType: HASH_PARTITIONED
- PipelineLevelShuffle: Yes
- ShuffleNumPerChannel: 8
- TotalShuffleNum: 24
- BytesPassThrough: 9.582 GB
- __MAX_OF_BytesPassThrough: 807.135 MB
- __MIN_OF_BytesPassThrough: 162.679 MB
- BytesSent: 13.667 GB
- __MAX_OF_BytesSent: 4.562 GB
- __MIN_OF_BytesSent: 4.548 GB
- BytesUnsent: 0.000 B
- CompressTime: 0ns
- CompressedBytes: 0.000 B
- NetworkBandwidth: 12.506 GB/sec
- __MAX_OF_NetworkBandwidth: 5.422 GB/sec
- __MIN_OF_NetworkBandwidth: 2.463 GB/sec
- NetworkTime: 1s224ms
- __MAX_OF_NetworkTime: 1s846ms
- __MIN_OF_NetworkTime: 840.434ms
- OverallThroughput: 1.014 GB/sec
- __MAX_OF_OverallThroughput: 362.111 MB/sec
- __MIN_OF_OverallThroughput: 330.277 MB/sec
- OverallTime: 13s503ms
- __MAX_OF_OverallTime: 14s145ms
- __MIN_OF_OverallTime: 12s859ms
- RequestSent: 6.626K (6626)
- __MAX_OF_RequestSent: 2.217K (2217)
- __MIN_OF_RequestSent: 2.202K (2202)
- RequestUnsent: 0
- RpcAvgTime: 27.955ms
- __MAX_OF_RpcAvgTime: 44.883ms
- __MIN_OF_RpcAvgTime: 17.383ms
- RpcCount: 9.958K (9958)
- __MAX_OF_RpcCount: 3.324K (3324)
- __MIN_OF_RpcCount: 3.315K (3315)
- SenderInputBytes: 19.149 GB
- __MAX_OF_SenderInputBytes: 1.609 GB
- __MIN_OF_SenderInputBytes: 331.493 MB
- SerializeChunkTime: 530.673ms
- __MAX_OF_SerializeChunkTime: 758.995ms
- __MIN_OF_SerializeChunkTime: 241.188ms
- SerializedBytes: 13.667 GB
- __MAX_OF_SerializedBytes: 1.153 GB
- __MIN_OF_SerializedBytes: 235.337 MB
- ShuffleChunkAppendCounter: 228.672K (228672)
- __MAX_OF_ShuffleChunkAppendCounter: 17.256K (17256)
- __MIN_OF_ShuffleChunkAppendCounter: 4.536K (4536)
- ShuffleChunkAppendTime: 4s882ms
- __MAX_OF_ShuffleChunkAppendTime: 7s370ms
- __MIN_OF_ShuffleChunkAppendTime: 2s541ms
- ShuffleHashTime: 34.972ms
- __MAX_OF_ShuffleHashTime: 111.795ms
- __MIN_OF_ShuffleHashTime: 12.112ms
- WaitTime: 4s105ms
- __MAX_OF_WaitTime: 5s606ms
- __MIN_OF_WaitTime: 2s822ms
OLAP_SCAN (plan_node_id=0):
CommonMetrics:
- CloseTime: 515.457us
- __MAX_OF_CloseTime: 916.108us
- __MIN_OF_CloseTime: 381.936us
- JoinRuntimeFilterEvaluate: 0
- JoinRuntimeFilterHashTime: 0ns
- JoinRuntimeFilterInputRows: 0
- JoinRuntimeFilterOutputRows: 0
- JoinRuntimeFilterTime: 0ns
- OperatorAllocatedMemoryUsage: 189.272 GB
- __MAX_OF_OperatorAllocatedMemoryUsage: 15.962 GB
- __MIN_OF_OperatorAllocatedMemoryUsage: 3.097 GB
- OperatorDeallocatedMemoryUsage: 149.203 GB
- __MAX_OF_OperatorDeallocatedMemoryUsage: 12.600 GB
- __MIN_OF_OperatorDeallocatedMemoryUsage: 2.437 GB
- OperatorPeakMemoryUsage: 1.671 GB
- __MAX_OF_OperatorPeakMemoryUsage: 3.362 GB
- __MIN_OF_OperatorPeakMemoryUsage: 677.280 MB
- OperatorTotalTime: 15.568ms
- __MAX_OF_OperatorTotalTime: 108.299ms
- __MIN_OF_OperatorTotalTime: 2.227ms
- PrepareTime: 18.162us
- __MAX_OF_PrepareTime: 25.589us
- __MIN_OF_PrepareTime: 11.273us
- PullChunkNum: 9.528K (9528)
- __MAX_OF_PullChunkNum: 719
- __MIN_OF_PullChunkNum: 189
- PullRowNum: 38.893M (38893279)
- __MAX_OF_PullRowNum: 2.937M (2936647)
- __MIN_OF_PullRowNum: 771.366K (771366)
- PullTotalTime: 15.051ms
- __MAX_OF_PullTotalTime: 107.885ms
- __MIN_OF_PullTotalTime: 1.730ms
- PushChunkNum: 0
- PushRowNum: 0
- PushTotalTime: 0ns
- RuntimeBloomFilterNum: 0
- RuntimeInFilterNum: 0
- SetFinishedTime: 295ns
- __MAX_OF_SetFinishedTime: 781ns
- __MIN_OF_SetFinishedTime: 104ns
- SetFinishingTime: 1.068us
- __MAX_OF_SetFinishingTime: 3.531us
- __MIN_OF_SetFinishingTime: 352ns
UniqueMetrics:
- BufferUnplugThreshold: 32
- MorselQueueType: physical_split_morsel_queue
- Rollup: INTRA_FREQ_READ
- SharedScan: False
- Table: INTRA_FREQ_READ
- BufferUnplugCount: 33
- __MAX_OF_BufferUnplugCount: 3
- __MIN_OF_BufferUnplugCount: 1
- BytesRead: 28.727 GB
- __MAX_OF_BytesRead: 901.094 MB
- __MIN_OF_BytesRead: 493.914 MB
- CachedPagesNum: 1.974K (1974)
- __MAX_OF_CachedPagesNum: 47
- __MIN_OF_CachedPagesNum: 0
- ChunkBufferCapacity: 512
- CompressedBytesRead: 4.450 GB
- __MAX_OF_CompressedBytesRead: 142.060 MB
- __MIN_OF_CompressedBytesRead: 73.140 MB
- DefaultChunkBufferCapacity: 512
- IOTaskExecTime: 3s976ms
- __MAX_OF_IOTaskExecTime: 9s285ms
- __MIN_OF_IOTaskExecTime: 1s164ms
- CreateSegmentIter: 184.273us
- __MAX_OF_CreateSegmentIter: 297.571us
- __MIN_OF_CreateSegmentIter: 3.848us
- GetDelVec: 0ns
- GetDeltaColumnGroup: 174.456us
- __MAX_OF_GetDeltaColumnGroup: 284.034us
- __MIN_OF_GetDeltaColumnGroup: 708ns
- GetRowsets: 162ns
- __MAX_OF_GetRowsets: 242ns
- __MIN_OF_GetRowsets: 101ns
- IOTime: 2s373ms
- __MAX_OF_IOTime: 7s741ms
- __MIN_OF_IOTime: 52.435ms
- ReadPKIndex: 0ns
- SegmentInit: 8.667ms
- __MAX_OF_SegmentInit: 38.718ms
- __MIN_OF_SegmentInit: 236.225us
- BitmapIndexFilter: 0ns
- BitmapIndexFilterRows: 0
- BitmapIndexIteratorInit: 5.835us
- __MAX_OF_BitmapIndexIteratorInit: 17.362us
- __MIN_OF_BitmapIndexIteratorInit: 2.839us
- BloomFilterFilter: 0ns
- BloomFilterFilterRows: 0
- ColumnIteratorInit: 8.419ms
- __MAX_OF_ColumnIteratorInit: 38.464ms
- __MIN_OF_ColumnIteratorInit: 35.346us
- SegmentRuntimeZoneMapFilterRows: 0
- SegmentZoneMapFilterRows: 0
- ShortKeyFilter: 1.020us
- __MAX_OF_ShortKeyFilter: 3.245us
- __MIN_OF_ShortKeyFilter: 538ns
- ShortKeyFilterRows: 0
- ZoneMapIndexFilterRows: 0
- ZoneMapIndexFiter: 1.054us
- __MAX_OF_ZoneMapIndexFiter: 2.124us
- __MIN_OF_ZoneMapIndexFiter: 476ns
- SegmentRead: 3s933ms
- __MAX_OF_SegmentRead: 9s261ms
- __MIN_OF_SegmentRead: 1s86ms
- BlockFetch: 3s922ms
- __MAX_OF_BlockFetch: 9s255ms
- __MIN_OF_BlockFetch: 1s80ms
- BlockFetchCount: 9.528K (9528)
- __MAX_OF_BlockFetchCount: 265
- __MIN_OF_BlockFetchCount: 189
- BlockSeek: 6.911ms
- __MAX_OF_BlockSeek: 91.785ms
- __MIN_OF_BlockSeek: 2.422ms
- BlockSeekCount: 418.650K (418650)
- __MAX_OF_BlockSeekCount: 12.854K (12854)
- __MIN_OF_BlockSeekCount: 6.918K (6918)
- ChunkCopy: 0ns
- DecompressT: 11.122ms
- __MAX_OF_DecompressT: 49.079ms
- __MIN_OF_DecompressT: 6.482ms
- DelVecFilterRows: 0
- PredFilter: 0ns
- PredFilterRows: 0
- RowsetsReadCount: 48
- __MAX_OF_RowsetsReadCount: 1
- __MIN_OF_RowsetsReadCount: 1
- SegmentsReadCount: 48
- __MAX_OF_SegmentsReadCount: 1
- __MIN_OF_SegmentsReadCount: 1
- TotalColumnsDataPageCount: 3.356M (3355624)
- __MAX_OF_TotalColumnsDataPageCount: 69.925K (69925)
- __MIN_OF_TotalColumnsDataPageCount: 69.888K (69888)
- IOTaskWaitTime: 82.506ms
- __MAX_OF_IOTaskWaitTime: 166.962ms
- __MIN_OF_IOTaskWaitTime: 7.825ms
- MorselsCount: 48
- __MAX_OF_MorselsCount: 3
- __MIN_OF_MorselsCount: 1
- PeakChunkBufferSize: 453
- PeakIOTasks: 2
- __MAX_OF_PeakIOTasks: 3
- __MIN_OF_PeakIOTasks: 1
- PeakScanTaskQueueSize: 116
- __MAX_OF_PeakScanTaskQueueSize: 7
- __MIN_OF_PeakScanTaskQueueSize: 2
- PushdownPredicates: 0
- RawRowsRead: 38.893M (38893279)
- __MAX_OF_RawRowsRead: 1.083M (1082814)
- __MIN_OF_RawRowsRead: 771.366K (771366)
- ReadPagesNum: 421.705K (421705)
- __MAX_OF_ReadPagesNum: 12.909K (12909)
- __MIN_OF_ReadPagesNum: 7.060K (7060)
- RowsRead: 38.893M (38893279)
- __MAX_OF_RowsRead: 1.083M (1082814)
- __MIN_OF_RowsRead: 771.366K (771366)
- ScanTime: 4s58ms
- __MAX_OF_ScanTime: 9s348ms
- __MIN_OF_ScanTime: 1s196ms
- SubmitTaskCount: 814
- __MAX_OF_SubmitTaskCount: 50
- __MIN_OF_SubmitTaskCount: 13
- TabletCount: 6
- __MAX_OF_TabletCount: 2
- __MIN_OF_TabletCount: 2
- UncompressedBytesRead: 4.482 GB
- __MAX_OF_UncompressedBytesRead: 142.976 MB
- __MIN_OF_UncompressedBytesRead: 73.912 MB
SQL中有关ABS(A.time - B.time)、 ABS(A.time - B.previous_time)、 ABS(A.time - B.next_time)的条件去掉，时间相差不多
你们spark是什么配置的
Spark配置：
–conf “spark.executor.instances=12”
–conf “spark.executor.memory=8g”
–conf “spark.driver.memory=10g”
–conf “spark.driver.cores=4”
–conf “spark.executor.cores=4”
SR配置：
【集群规模】1fe+3be（fe与be混部）
【机器信息】三台机器，每台配置：16核+64G内存
二者的内存和核数基本拉齐
你好, 相关profile文档可以提供文件格式的附件吗?
那麻烦执行下explain analyze + sql的结果, 看能不能截屏发一下
看到之前回复发的了.