为了更快的定位您的问题,请提供以下信息,谢谢
【详述】在模糊检索时,发现表达式and的优先级更高,查询效率也高;但 or 的优先级没有变化
【背景】对多个关键词进行模糊查询验证性能
【业务影响】关键词数量过多,查询变慢
【是否存算分离】否
【StarRocks版本】2.5
【集群规模】3fe(1 follower+2observer)+ 12be(fe与be独立部署)
【机器信息】CPU虚拟核/内存/网卡, 48C/128G/万兆
【联系方式】社区群12-金谡-jinsu@moojing.com
【附件】
- fe.log/beINFO/相应截图
- 慢查询:
- Profile信息
- 并行度:show variables like ‘%parallel_fragment_exec_instance_num%’;
- pipeline是否开启:show variables like ‘%pipeline%’;
- be节点cpu和内存使用率截图
- 查询报错:
- query_dump,怎么获取query_dump文件
- be crash
- be.out
- 外表查询报错
- be.out和fe.warn.log
有一张商品表,title字段为string ,存的是奶粉行业的商品标题(大部分标题都含"奶");业务需要对商品标题进行关键词模糊检索
- be.out和fe.warn.log
-
第一组关键词 奶 or 123 or … or 889 (共两百个关键词)
当"奶" 在最左侧和最右侧时,查询效率基本没差别
-
第一组关键词 奶 and 123 and… and 889 (共两百个关键词)
当"奶" 在最左侧和最右侧时,查询效率差别比较大
对and条件,看起来解析器在 查到第一个词后就认定本条件为否,效率比较高;
但 对 or条件, 第一个词满足条件后还在继续匹配后面的其他条件,效率比较低;
请问查询解析器是否有相关的逻辑处理?
SQL:
select count(*) item_count from (select t1.item_id, max(t1.time) time from item2 t1 left join shops_tmall t3 on t1.shop_id=t3.shop_id left join fix_brands_v2 t4 on t1.brand_id=t4.bid left join [shuffle] item2_cp p1 on t1.cat1 = p1.cat1 and t1.item_id = p1.item_id and t1.time = p1.time left JOIN [broadcast] item_patch_1752465071 c1 ON t1.cat1 = c1.cat1 AND t1.time = c1.time AND t1.item_id = c1.item_id AND c1.username = ‘jinsu@moojing.com’ left JOIN [broadcast] item_patch_1752465071 c2 ON t1.cat1 = c2.cat1 AND t1.time = c2.time AND t1.item_id = c2.item_id AND c2.username is null and (t1.cat2 = c2.cat2) left join [shuffle] item_online_time ot1 on t1.cat1 = ot1.cat1 and t1.item_id=ot1.item_id and ot1.online_time is not null left join [broadcast] item_custom_rule r1 on t1.cat1 = r1.cat1 and t1.item_id = r1.item_id and r1.username = ‘jinsu@moojing.com’ where ‘jinsu@moojing.com’ = ‘jinsu@moojing.com’ and (((((t1.cat2=‘201791002’ and t1.cat1=‘50026316’) or ((t1.cat1 = ‘50026316’ and (t1.cat2 in (‘50010422’))))) ))) and (t1.time in (‘2025-01-01’, ‘2025-02-01’, ‘2025-03-01’, ‘2025-04-01’, ‘2025-05-01’, ‘2025-06-01’, ‘2025-07-01’, ‘2025-08-01’, ‘2025-09-01’)) and (t4.plat = ‘taobao’ or t4.plat is null)
and ((replace(lower(t1.title), " ", “”) like lower(’%\xe5\xa5\xb6%’) and replace(lower(t1.title), " ", “”) like lower(’%8018%’) and replace(lower(t1.title), " ", “”) like lower(’%6692%’) and replace(lower(t1.title), " ", “”) like lower(’%7125%’) and replace(lower(t1.title), " ", “”) like lower(’%4737%’) and replace(lower(t1.title), " ", “”) like lower(’%8662%’) and replace(lower(t1.title), " ", “”) like lower(’%7905%’) and replace(lower(t1.title), " ", “”) like lower(’%2099%’) and replace(lower(t1.title), " ", “”) like lower(’%6633%’) and replace(lower(t1.title), " ", “”) like lower(’%5250%’) and replace(lower(t1.title), " ", “”) like lower(’%3946%’) and replace(lower(t1.title), " ", “”) like lower(’%580%’) and replace(lower(t1.title), " ", “”) like lower(’%3397%’) and replace(lower(t1.title), " ", “”) like lower(’%6225%’) and replace(lower(t1.title), " ", “”) like lower(’%538%’) and replace(lower(t1.title), " ", “”) like lower(’%2097%’) and replace(lower(t1.title), " ", “”) like lower(’%9771%’) and replace(lower(t1.title), " ", “”) like lower(’%4668%’) and replace(lower(t1.title), " ", “”) like lower(’%1604%’) and replace(lower(t1.title), " ", “”) like lower(’%14%’) and replace(lower(t1.title), " ", “”) like lower(’%1535%’) and replace(lower(t1.title), " ", “”) like lower(’%860%’) and replace(lower(t1.title), " ", “”) like lower(’%6992%’) and replace(lower(t1.title), " ", “”) like lower(’%4577%’) and replace(lower(t1.title), " ", “”) like lower(’%3250%’) and replace(lower(t1.title), " ", “”) like lower(’%8663%’) and replace(lower(t1.title), " ", “”) like lower(’%6769%’) and replace(lower(t1.title), " ", “”) like lower(’%3226%’) and replace(lower(t1.title), " ", “”) like lower(’%5951%’) and replace(lower(t1.title), " ", “”) like lower(’%2334%’) and replace(lower(t1.title), " ", “”) like lower(’%3061%’) and replace(lower(t1.title), " ", “”) like lower(’%1912%’) and replace(lower(t1.title), " ", “”) like lower(’%6617%’) and replace(lower(t1.title), " ", “”) like lower(’%5140%’) and replace(lower(t1.title), " ", “”) like lower(’%6037%’) and replace(lower(t1.title), " ", “”) like lower(’%9495%’) and replace(lower(t1.title), " ", “”) like lower(’%7623%’) and replace(lower(t1.title), " ", “”) like lower(’%7869%’) and replace(lower(t1.title), " ", “”) like lower(’%9632%’) and replace(lower(t1.title), " ", “”) like lower(’%1889%’) and replace(lower(t1.title), " ", “”) like lower(’%3719%’) and replace(lower(t1.title), " ", “”) like lower(’%9027%’) and replace(lower(t1.title), " ", “”) like lower(’%5997%’) and replace(lower(t1.title), " ", “”) like lower(’%8656%’) and replace(lower(t1.title), " ", “”) like lower(’%4663%’) and replace(lower(t1.title), " ", “”) like lower(’%6970%’) and replace(lower(t1.title), " ", “”) like lower(’%4224%’) and replace(lower(t1.title), " ", “”) like lower(’%223%’) and replace(lower(t1.title), " ", “”) like lower(’%2773%’) and replace(lower(t1.title), " ", “”) like lower(’%3118%’) and replace(lower(t1.title), " ", “”) like lower(’%6842%’) and replace(lower(t1.title), " ", “”) like lower(’%8441%’) and replace(lower(t1.title), " ", “”) like lower(’%8006%’) and replace(lower(t1.title), " ", “”) like lower(’%6518%’) and replace(lower(t1.title), " ", “”) like lower(’%4589%’) and replace(lower(t1.title), " ", “”) like lower(’%8237%’) and replace(lower(t1.title), " ", “”) like lower(’%9409%’) and replace(lower(t1.title), " ", “”) like lower(’%7145%’) and replace(lower(t1.title), " ", “”) like lower(’%4276%’) and replace(lower(t1.title), " ", “”) like lower(’%8781%’) and replace(lower(t1.title), " ", “”) like lower(’%8570%’) and replace(lower(t1.title), " ", “”) like lower(’%788%’) and replace(lower(t1.title), " ", “”) like lower(’%2941%’) and replace(lower(t1.title), " ", “”) like lower(’%5410%’) and replace(lower(t1.title), " ", “”) like lower(’%593%’) and replace(lower(t1.title), " ", “”) like lower(’%5784%’) and replace(lower(t1.title), " ", “”) like lower(’%4166%’) and replace(lower(t1.title), " ", “”) like lower(’%1771%’) and replace(lower(t1.title), " ", “”) like lower(’%2609%’) and replace(lower(t1.title), " ", “”) like lower(’%2856%’) and replace(lower(t1.title), " ", “”) like lower(’%5550%’) and replace(lower(t1.title), " ", “”) like lower(’%5533%’) and replace(lower(t1.title), " ", “”) like lower(’%9559%’) and replace(lower(t1.title), " ", “”) like lower(’%7062%’) and replace(lower(t1.title), " ", “”) like lower(’%1972%’) and replace(lower(t1.title), " ", “”) like lower(’%3603%’) and replace(lower(t1.title), " ", “”) like lower(’%7403%’) and replace(lower(t1.title), " ", “”) like lower(’%3921%’) and replace(lower(t1.title), " ", “”) like lower(’%5485%’) and replace(lower(t1.title), " ", “”) like lower(’%7785%’) and replace(lower(t1.title), " ", “”) like lower(’%9989%’) and replace(lower(t1.title), " ", “”) like lower(’%2596%’) and replace(lower(t1.title), " ", “”) like lower(’%8184%’) and replace(lower(t1.title), " ", “”) like lower(’%7627%’) and replace(lower(t1.title), " ", “”) like lower(’%3281%’) and replace(lower(t1.title), " ", “”) like lower(’%9957%’) and replace(lower(t1.title), " ", “”) like lower(’%1909%’) and replace(lower(t1.title), " ", “”) like lower(’%8644%’) and replace(lower(t1.title), " ", “”) like lower(’%7421%’) and replace(lower(t1.title), " ", “”) like lower(’%2119%’) and replace(lower(t1.title), " ", “”) like lower(’%4255%’) and replace(lower(t1.title), " ", “”) like lower(’%183%’) and replace(lower(t1.title), " ", “”) like lower(’%219%’) and replace(lower(t1.title), " ", “”) like lower(’%2565%’) and replace(lower(t1.title), " ", “”) like lower(’%2535%’) and replace(lower(t1.title), " ", “”) like lower(’%3185%’) and replace(lower(t1.title), " ", “”) like lower(’%4847%’) and replace(lower(t1.title), " ", “”) like lower(’%6911%’) and replace(lower(t1.title), " ", “”) like lower(’%8042%’) and replace(lower(t1.title), " ", “”) like lower(’%8246%’) and replace(lower(t1.title), " ", “”) like lower(’%1113%’) and replace(lower(t1.title), " ", “”) like lower(’%5070%’) and replace(lower(t1.title), " ", “”) like lower(’%2689%’) and replace(lower(t1.title), " ", “”) like lower(’%5798%’) and replace(lower(t1.title), " ", “”) like lower(’%9931%’) and replace(lower(t1.title), " ", “”) like lower(’%7838%’) and replace(lower(t1.title), " ", “”) like lower(’%7717%’) and replace(lower(t1.title), " ", “”) like lower(’%2881%’) and replace(lower(t1.title), " ", “”) like lower(’%7360%’) and replace(lower(t1.title), " ", “”) like lower(’%5058%’) and replace(lower(t1.title), " ", “”) like lower(’%8452%’) and replace(lower(t1.title), " ", “”) like lower(’%9819%’) and replace(lower(t1.title), " ", “”) like lower(’%2800%’) and replace(lower(t1.title), " ", “”) like lower(’%5135%’) and replace(lower(t1.title), " ", “”) like lower(’%4870%’) and replace(lower(t1.title), " ", “”) like lower(’%5498%’) and replace(lower(t1.title), " ", “”) like lower(’%4775%’) and replace(lower(t1.title), " ", “”) like lower(’%570%’) and replace(lower(t1.title), " ", “”) like lower(’%2589%’) and replace(lower(t1.title), " ", “”) like lower(’%6924%’) and replace(lower(t1.title), " ", “”) like lower(’%7451%’) and replace(lower(t1.title), " ", “”) like lower(’%5611%’) and replace(lower(t1.title), " ", “”) like lower(’%8507%’) and replace(lower(t1.title), " ", “”) like lower(’%4613%’) and replace(lower(t1.title), " ", “”) like lower(’%1075%’) and replace(lower(t1.title), " ", “”) like lower(’%5604%’) and replace(lower(t1.title), " ", “”) like lower(’%9670%’) and replace(lower(t1.title), " ", “”) like lower(’%2366%’) and replace(lower(t1.title), " ", “”) like lower(’%2024%’) and replace(lower(t1.title), " ", “”) like lower(’%8893%’) and replace(lower(t1.title), " ", “”) like lower(’%127%’) and replace(lower(t1.title), " ", “”) like lower(’%9234%’) and replace(lower(t1.title), " ", “”) like lower(’%8096%’) and replace(lower(t1.title), " ", “”) like lower(’%6649%’) and replace(lower(t1.title), " ", “”) like lower(’%9051%’) and replace(lower(t1.title), " ", “”) like lower(’%5149%’) and replace(lower(t1.title), " ", “”) like lower(’%8066%’) and replace(lower(t1.title), " ", “”) like lower(’%9488%’) and replace(lower(t1.title), " ", “”) like lower(’%9392%’) and replace(lower(t1.title), " ", “”) like lower(’%9690%’) and replace(lower(t1.title), " ", “”) like lower(’%9886%’) and replace(lower(t1.title), " ", “”) like lower(’%1221%’) and replace(lower(t1.title), " ", “”) like lower(’%2932%’) and replace(lower(t1.title), " ", “”) like lower(’%7199%’) and replace(lower(t1.title), " ", “”) like lower(’%1385%’) and replace(lower(t1.title), " ", “”) like lower(’%1086%’) and replace(lower(t1.title), " ", “”) like lower(’%1236%’) and replace(lower(t1.title), " ", “”) like lower(’%2153%’) and replace(lower(t1.title), " ", “”) like lower(’%902%’) and replace(lower(t1.title), " ", “”) like lower(’%8886%’) and replace(lower(t1.title), " ", “”) like lower(’%1089%’) and replace(lower(t1.title), " ", “”) like lower(’%7450%’) and replace(lower(t1.title), " ", “”) like lower(’%259%’) and replace(lower(t1.title), " ", “”) like lower(’%2904%’) and replace(lower(t1.title), " ", “”) like lower(’%9410%’) and replace(lower(t1.title), " ", “”) like lower(’%312%’) and replace(lower(t1.title), " ", “”) like lower(’%5631%’) and replace(lower(t1.title), " ", “”) like lower(’%4633%’) and replace(lower(t1.title), " ", “”) like lower(’%9001%’) and replace(lower(t1.title), " ", “”) like lower(’%6553%’) and replace(lower(t1.title), " ", “”) like lower(’%7301%’) and replace(lower(t1.title), " ", “”) like lower(’%4877%’) and replace(lower(t1.title), " ", “”) like lower(’%3533%’) and replace(lower(t1.title), " ", “”) like lower(’%4962%’) and replace(lower(t1.title), " ", “”) like lower(’%387%’) and replace(lower(t1.title), " ", “”) like lower(’%7657%’) and replace(lower(t1.title), " ", “”) like lower(’%6491%’) and replace(lower(t1.title), " ", “”) like lower(’%3534%’) and replace(lower(t1.title), " ", “”) like lower(’%1452%’) and replace(lower(t1.title), " ", “”) like lower(’%4977%’) and replace(lower(t1.title), " ", “”) like lower(’%1306%’) and replace(lower(t1.title), " ", “”) like lower(’%2352%’) and replace(lower(t1.title), " ", “”) like lower(’%6772%’) and replace(lower(t1.title), " ", “”) like lower(’%275%’) and replace(lower(t1.title), " ", “”) like lower(’%3168%’) and replace(lower(t1.title), " ", “”) like lower(’%7949%’) and replace(lower(t1.title), " ", “”) like lower(’%9554%’) and replace(lower(t1.title), " ", “”) like lower(’%365%’) and replace(lower(t1.title), " ", “”) like lower(’%4339%’) and replace(lower(t1.title), " ", “”) like lower(’%6685%’) and replace(lower(t1.title), " ", “”) like lower(’%798%’) and replace(lower(t1.title), " ", “”) like lower(’%9492%’) and replace(lower(t1.title), " ", “”) like lower(’%1477%’) and replace(lower(t1.title), " ", “”) like lower(’%3143%’) and replace(lower(t1.title), " ", “”) like lower(’%2255%’) and replace(lower(t1.title), " ", “”) like lower(’%4398%’) and replace(lower(t1.title), " ", “”) like lower(’%2224%’) and replace(lower(t1.title), " ", “”) like lower(’%6124%’) and replace(lower(t1.title), " ", “”) like lower(’%2234%’) and replace(lower(t1.title), " ", “”) like lower(’%2433%’) and replace(lower(t1.title), " ", “”) like lower(’%9765%’) and replace(lower(t1.title), " ", “”) like lower(’%1840%’) and replace(lower(t1.title), " ", “”) like lower(’%6666%’) and replace(lower(t1.title), " ", “”) like lower(’%5045%’) and replace(lower(t1.title), " ", “”) like lower(’%7804%’) and replace(lower(t1.title), " ", “”) like lower(’%9109%’) and replace(lower(t1.title), " ", “”) like lower(’%1081%’) and replace(lower(t1.title), " ", “”) like lower(’%593%’) and replace(lower(t1.title), " ", “”) like lower(’%9296%’) and replace(lower(t1.title), " ", “”) like lower(’%6269%’)
and replace(lower(t1.title), " ", “”) like lower(’%3647%’))) and (coalesce(c1.sold, c2.sold, t1.sold) > 0.0) and t1.item_id is not null group by t1.item_id) tt0

