【详述】存算分离集群从3.2.2升级到3.3.0后,读取hive catalog表报错,数据为parquet格式,下面sql,where里有buss_code条件就报错,有其他字段的条件不报错。
select * from hc.default
.t_lms_t_lmt_adjust_case_info
where dt=20230718 and buss_code=‘RL0001’ limit 100
报错如下:
SQL 错误 [1064] [42000]: FileReader::get_next failed. reason = Internal error: def levels need to parsed: 2125824, def levels parsed: 1048576
be/src/formats/parquet/stored_column_reader.cpp:389 _decode_levels(&cur_to_skip, &level_parsed, &def_levels)
be/src/formats/parquet/stored_column_reader.cpp:323 _lazy_skip_values(range.begin())
be/src/formats/parquet/group_reader.cpp:172 _column_readers[slot_id]->read_range(range, filter, (*chunk)->get_column_by_slot_id(slot_id).get())
be/src/formats/parquet/group_reader.cpp:138 _read_range(_lazy_column_indices, r, &chunk_filter, &lazy_chunk), file = hdfs://nameservice1/user/hive/warehouse/t_lms_t_lmt_adjust_case_info/dt=20230718/merge_part-00000-20f0416b-3444-40b0-bd98-4a012a46fd2f-c000.snappy.parquet
【业务影响】大
【是否存算分离】是
【StarRocks版本】3.3.0
【集群规模】3fe(1 leader + 2 follower)+3cn
【机器信息】fe(8C/32G/万兆), cn(32C/256G/万兆)
【联系方式】微信 rayxai