【详述】SR单表并发查询性能下降
【背景】做过哪些操作？
业务上对re_keyword_asin_info_ts_tag 表进行并发并发查询，查询的性能下降
单并发情况查询在 0.1s 内能返回，业务并发(50至100)提升后查询性能不稳定，查询响应时间在1-3s 左右
re_keyword_asin_info_ts_tag表结构:
CREATE TABLE re_keyword_asin_info_ts_tag (
country varchar(4) NOT NULL COMMENT “”,
asin varchar(16) NOT NULL COMMENT “”,
md5_id varchar(16) NOT NULL COMMENT “”,
keyword varchar(6553) NULL COMMENT “”,
group_ts varchar(1048576) NULL COMMENT “”
) ENGINE=OLAP
PRIMARY KEY(country, asin, md5_id)
COMMENT “OLAP”
DISTRIBUTED BY HASH(country, asin) BUCKETS 128
PROPERTIES (
“replication_num” = “1”,
“in_memory” = “false”,
“storage_format” = “DEFAULT”,
“enable_persistent_index” = “false”
);
查询语句:
SELECT re_keyword_asin_info_ts_tag.asin AS re_keyword_asin_info_ts_tag_asin
, re_keyword_asin_info_ts_tag.group_ts AS re_keyword_asin_info_ts_tag_group_ts
FROM re_keyword_asin_info_ts_tag
WHERE re_keyword_asin_info_ts_tag.country = ‘MX’ AND re_keyword_asin_info_ts_tag.keyword = ‘libreta norma’ AND re_keyword_asin_info_ts_tag.asin IN (‘B084MMDVBT’, ‘B0869KPY98’, ‘B082HPCXRY’, ‘B08C6BLKC2’, ‘B07LFHQTYW’, ‘B013WB7KGU’, ‘B08FKKJBBR’,‘B0778QTQ76’, ‘B08P5BYXQK’, ‘B073XBKH74’, ‘B08GFH7BCQ’, ‘B073X8VY9B’, ‘B08HS87GZN’, ‘B08N439LBD’, ‘B08GTJXTC6’, ‘B002HG0JDS’, ‘B08VF9B772’, ‘B08HSFWV5C’, ‘B08YWZZHN3’, ‘B08T8VP773’, ‘B092Q54MXR’, ‘B08X92PD5S’, ‘B08D6SYWTG’, ‘B08C75VZBD’, ‘B09ZTTL69Y’, ‘B07GZVB3MQ’, ‘B07HNK5QZC’, ‘B0040YNYSM’, ‘B00ZDH7B66’, ‘B00ZDHEQC8’, ‘B08TWK22TG’, ‘B08CTVSVBZ’, ‘6072110894’, ‘B08R7V62GV’, ‘B0B5W3HRNJ’, ‘B085ZZLC4G’, ‘B07DKSVV16’, ‘B07NVWQ2N3’, ‘B09N9WX5S6’, ‘B08C6C756F’, ‘B099RCFPY1’, ‘B0B9W132YP’, ‘B08HZFKDTX’, ‘B07V4KTGWS’, ‘B08V23P4HK’, ‘B00VXXLESK’, ‘B07PFHWSRB’, ‘B0969B84P6’, ‘B00ZDHC0EO’, ‘B07145M2T4’, ‘B09HR7S6Y6’, ‘B00P9U2BXU’, ‘B01NBDR4I3’, ‘B07PMNLVW5’, ‘B09T7CZ32X’, ‘1477029044’, ‘B09234RLFP’, ‘B084RMSG1Z’, ‘B07DKJCN4P’, ‘B07L445BHJ’)
;
【业务影响】
【StarRocks版本】2.3.4
【集群规模】2fe（2 follower）+ 12be
【机器信息】FE 16C 64G BE 32C/128G/万兆 SSD 3.5T*2
【联系方式】yangrong.juxfe@gmail.com
【附件】
非pipeline 模式下的profile
none_pipeline_profile.txt (36.5 KB)
pipeline模式下的profile
pipeline_profile.txt (25.3 KB)