为了更快的定位您的问题,请提供以下信息,谢谢
【详述】
上一个sr版本为2.5.8,由于fe启动异常不得已升级到3.1.11版本,升级之后执行。通过truncate table table_name drop partition(p20240527,20240526) 执行删除分区数据的操作,非常的慢或者说根本没有办法执行成功。而通过delete删除分区数据方式是正常的。2.5.8版本truncate分区数据是正常的。
【背景】
升级到3.1.11之后,从hive同步数据至sr时,修改两个参数:“tablet_create_timeout_second”=“320”,“routine_load_unstable_threshold_second” = “5400”
其它参数跟2.5.8时期的一致,没有做任何调整。
【业务影响】
【是否存算分离】否
【StarRocks版本】例如:3.1.11
【集群规模】例如:4fe(3 follower+1observer)+4be(fe与be混部)
【机器信息】CPU虚拟核/内存/网卡,例如:24C/64G/万兆
【联系方式】qq邮箱:564685964@qq.com.
【附件】fe.conf 配置文件如下:
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
“License”); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
“AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
#####################################################################
The uppercase properties are read and exported by bin/start_fe.sh.
To see all Frontend configurations,
see fe/src/org/apache/doris/common/Config.java
#####################################################################
the output dir of stderr and stdout
LOG_DIR = ${DORIS_HOME}/log
DATE = “$(date +%Y%m%d-%H%M%S)”
JAVA_OPTS="-Xmx25600m -XX:+UseMembar -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=7 -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+CMSClassUnloadingEnabled -XX:-CMSPar
allelRemarkEnabled -XX:CMSInitiatingOccupancyFraction=80 -XX:SoftRefLRUPolicyMSPerMB=0 -Xloggc:$DORIS_HOME/log/fe.gc.log.$DATE"
For jdk 9+, this JAVA_OPTS will be used as default JVM options
JAVA_OPTS_FOR_JDK_9="-Xmx8192m -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=7 -XX:+CMSClassUnloadingEnabled -XX:-CMSParallelRemarkEnabled -XX:CMSInitiatingOccupancyFraction=80 -XX:SoftRefLRUPolicyMSPerMB=0 -Xl
og:gc*:$DORIS_HOME/log/fe.gc.log.$DATE:time"
the lowercase properties are read by main program.
INFO, WARN, ERROR, FATAL
sys_log_level = INFO
store metadata, create it if it is not exist.
Default value is ${DORIS_HOME}/doris-meta
meta_dir = ${DORIS_HOME}/doris-meta
meta_dir = /datacenter/fe/meta
http_port = 8030
rpc_port = 9020
query_port = 9030
edit_log_port = 9010
mysql_service_nio_enabled = true
Choose one if there are more than one ip except loopback address.
Note that there should at most one ip match this list.
If no ip match this rule, will choose one randomly.
use CIDR format, e.g. 10.10.10.0/24
Default value is empty.
priority_networks = 10.10.10.0/24;192.168.0.0/16
priority_networks=172.16.31.0/24
Advanced configurations
log_roll_size_mb = 1024
sys_log_dir = /datacenter/fe/log
sys_log_roll_num = 10
sys_log_verbose_modules =
audit_log_dir = /datacenter/fe/log
audit_log_modules = slow_query, query
audit_log_roll_num = 10
meta_delay_toleration_second = 10
qe_max_connection = 1024
max_conn_per_user = 100
qe_query_timeout_second = 300
qe_slow_log_ms = 5000
max_routine_load_task_num_per_be = 100
max_routine_load_job_num = 500
enable_statistic_collect = true
hive_meta_cache_refresh_interval_s=3600
ignore_unknown_id = true
ignore_unknown_log_id = true
enable_hms_events_incremental_sync=true
hms_events_polling_interval_ms=20000
hms_events_batch_size_per_rpc=1000
enable_hms_parallel_process_evens=true
hms_process_events_parallel_num=10
enable_hms_events_incremental_sync=true
hms_events_polling_interval_ms=5000
hms_events_batch_size_per_rpc=500
enable_hms_parallel_process_evens=true
hms_process_events_parallel_num=4
tablet_create_timeout_second=320
routine_load_unstable_threshold_second =5400