【详述】问题详细描述
【背景】做过哪些操作?BI报表查询
【业务影响】
【StarRocks版本】2.5.3
【集群规模】3fe(3 follower)+3be(fe与be混部)
【机器信息】80C/256G/万兆
【联系方式】18813292740
【附件】
W0316 10:27:51.822055 118850 pipeline_driver_executor.cpp:139] [Driver] Process error, query_id=22df2160-c3a2-11ed-966a-067ced6696cf, instance_id=22df2160-c3a2-11ed-966a-067ced6696d1, status=Memory limit exceeded: Memory of process exceed limit. read and decompress page Used: 61849363656, Limit: 61847529062. Mem usage has exceed the limit of BE
/root/starrocks/be/src/formats/parquet/column_chunk_reader.cpp:133 CurrentThread::mem_tracker()->check_mem_limit(“read and decompress page”)
/root/starrocks/be/src/formats/parquet/column_chunk_reader.cpp:163 _read_and_decompress_page_data(compressed_size, uncompressed_size, true)
/root/starrocks/be/src/formats/parquet/column_chunk_reader.cpp:109 _parse_data_page()
/root/starrocks/be/src/formats/parquet/stored_column_reader.cpp:566 _reader->load_page()
/root/starrocks/be/src/formats/parquet/stored_column_reader.cpp:528 _next_selected_page(records_to_read, content_type, &records_to_skip, dst)
/root/starrocks/be/src/formats/parquet/column_reader.h:47 prepare_batch(num_records, content_type, column)
/root/starrocks/be/src/connector/hive_connector.cpp:409 _scanner->get_next(state, chunk)
/root/starrocks/be/src/exec/pipeline/scan/scan_operator.cpp:197 _get_scan_status()be.INFO.log.20230314-184008 (38.1 MB)
curl -XGET -s http://BE_IP:BE_HTTP_PORT/metrics | grep “^starrocks_be_.*_mem_bytes|^starrocks_be_tcmalloc_bytes_in_use” 看下具体内存占用呢
也遇到过查询报内存不足,starrocks不能用磁盘吗,能接受慢但不该直接报错
3.0支持算子落盘了