【业务影响】数据查询结果不一致,该表无删除操作,查询期间也无导入任务
【StarRocks版本】例如:2.5.10
【集群规模】例如:3fe + 12be
【联系方式】微信ID: zzDuke1688
【做过什么操作】之前其他表有过类似情况,原因没有排查到,解决方案是重建表 数据重新导入之后再多次查询结果一致,show proc ‘/statistic’; 中也没有不健康tablet;尝试使用FE主节点和从节点查询均有该问题。
【背景】:表结构:
CREATE TABLE `xxxxx` (
`token_address` varchar(42) NOT NULL COMMENT "",
`account_address` varchar(42) NOT NULL COMMENT "",
`start_at` date NOT NULL COMMENT "",
`end_at` date NULL COMMENT "",
`balance` double NULL DEFAULT "0" COMMENT "",
`symbol` varchar(200) NULL COMMENT "",
`start_block` bigint(20) NULL COMMENT "",
`end_block` bigint(20) NULL COMMENT "",
`etl_time` datetime NOT NULL COMMENT ""
) ENGINE=OLAP
PRIMARY KEY(`token_address`, `account_address`, `start_at`)
COMMENT "token balance "
PARTITION BY RANGE(`start_at`)
(PARTITION p0 VALUES [("2015-01-01"), ("2018-01-01")),
PARTITION p201801 VALUES [("2018-01-01"), ("2018-06-01")),
..........
PARTITION p202310 VALUES [("2023-10-01"), ("2023-11-01")))
DISTRIBUTED BY HASH(`token_address`, `account_address`, `start_at`) BUCKETS 20
PROPERTIES (
"replication_num" = "3",
"dynamic_partition.enable" = "true",
"dynamic_partition.time_unit" = "MONTH",
"dynamic_partition.time_zone" = "Etc/UTC",
"dynamic_partition.start" = "-2147483648",
"dynamic_partition.end" = "2",
"dynamic_partition.prefix" = "p",
"dynamic_partition.buckets" = "32",
"dynamic_partition.history_partition_num" = "0",
"dynamic_partition.replication_num" = "3",
"dynamic_partition.start_day_of_month" = "1",
"in_memory" = "false",
"storage_format" = "V2",
"enable_persistent_index" = "true",
"compression" = "LZ4"
);
【现象】:
mysql> select now();
+---------------------+
| now() |
+---------------------+
| 2023-08-15 10:09:09 |
+---------------------+
1 row in set (0.00 sec)
mysql> select count(*) from dws_token_balance_history_eth_dil;
+------------+
| count(*) |
+------------+
| 1545819724 |
+------------+
1 row in set (0.16 sec)
mysql> select now();
+---------------------+
| now() |
+---------------------+
| 2023-08-15 10:09:14 |
+---------------------+
1 row in set (0.01 sec)
mysql> select count(*) from dws_token_balance_history_eth_dil;
+------------+
| count(*) |
+------------+
| 1545819097 |
+------------+
1 row in set (0.16 sec)
mysql> show frontends;
+------------------------------------+-----------------+-------------+----------+-----------+---------+----------+-----------+------+-------+-------------------+---------------------+----------+--------+---------------------+----------------+
| Name | IP | EditLogPort | HttpPort | QueryPort | RpcPort | Role | ClusterId | Join | Alive | ReplayedJournalId | LastHeartbeat | IsHelper | ErrMsg | StartTime | Version |
+------------------------------------+-----------------+-------------+----------+-----------+---------+----------+-----------+------+-------+-------------------+---------------------+----------+--------+---------------------+----------------+
| 192.168.100.102_9010_1639122375786 | 192.168.100.102 | 9010 | 8030 | 9030 | 9020 | LEADER | 127394295 | true | true | 831415193 | 2023-08-15 10:09:20 | true | | 2023-08-08 05:28:26 | 2.5.10-9feb716 |
| 192.168.100.103_9010_1659417153866 | 192.168.100.103 | 9010 | 8030 | 9030 | 9020 | FOLLOWER | 127394295 | true | true | 831415186 | 2023-08-15 10:09:20 | true | | 2023-08-08 05:29:01 | 2.5.10-9feb716 |
| 192.168.100.101_9010_1639115964538 | 192.168.100.101 | 9010 | 8030 | 9030 | 9020 | FOLLOWER | 127394295 | true | true | 831415186 | 2023-08-15 10:09:20 | true | | 2023-08-08 05:27:46 | 2.5.10-9feb716 |
+------------------------------------+-----------------+-------------+----------+-----------+---------+----------+-----------+------+-------+-------------------+---------------------+----------+--------+---------------------+----------------+
3 rows in set (0.00 sec)