因为Log4j升级重启了fe和be的服务。执行一批写入后发现某一个节点be服务没有起来。多次重启还是错误。 看日志奇怪的发现有是端口问题，但是没有启动前端口是没有占用的。主要原因应该是副本不一致。有谁遇到过吗？如何修正此问题了？
查看日志错误如下:
W1214 19:38:15.911962 15709 engine_clone_task.cpp:170] Fail to load tablet from snapshot: Internal error: tablet already exist. schema_hash_dir=/home/StarRocks-1.19.2/be/storage/data/0/17286/1491134878 signature=17286
W1214 19:38:15.911978 15709 engine_clone_task.cpp:182] Removing /home/StarRocks-1.19.2/be/storage/data/0/17286
W1214 19:38:15.912119 15709 task_worker_pool.cpp:918] clone failed. signature: 17286
W1214 19:38:22.340134 15708 engine_clone_task.cpp:170] Fail to load tablet from snapshot: Internal error: tablet already exist. schema_hash_dir=/home/StarRocks-1.19.2/be/storage/data/1/17856/937925265 signature=17856
W1214 19:38:22.340165 15708 engine_clone_task.cpp:182] Removing /home/StarRocks-1.19.2/be/storage/data/1/17856
W1214 19:38:22.380254 15708 task_worker_pool.cpp:918] clone failed. signature: 17856
W1214 20:06:57.816783 30012 utils.cpp:90] Fail to get master client from cache. host= port=0 code=THRIFT_RPC_ERROR
W1214 20:06:57.816813 30012 task_worker_pool.cpp:1116] Fail to report task to :0, err=-1
W1214 20:07:07.826745 30008 engine_clone_task.cpp:170] Fail to load tablet from snapshot: Internal error: tablet already exist. schema_hash_dir=/home/StarRocks-1.19.2/be/storage/data/1/17286/1491134878 signature=17286
W1214 20:07:07.826769 30008 engine_clone_task.cpp:182] Removing /home/StarRocks-1.19.2/be/storage/data/1/17286
W1214 20:07:07.826901 30008 task_worker_pool.cpp:918] clone failed. signature: 17286
be.INFO日志如下
I1214 19:38:10.731454 15820 ev_http_server.cpp:99] EvHttpServer worker start, id=47
I1214 19:38:10.731642 15426 thrift_server.cpp:351] ThriftServer ‘heartbeat’ started on port: 9050
I1214 19:38:11.722134 15714 task_worker_pool.cpp:1139] Waiting to receive first heartbeat from frontend
I1214 19:38:11.722260 15715 task_worker_pool.cpp:1201] Waiting to receive first heartbeat from frontend
I1214 19:38:12.722229 15714 task_worker_pool.cpp:1139] Waiting to receive first heartbeat from frontend
I1214 19:38:12.722352 15715 task_worker_pool.cpp:1201] Waiting to receive first heartbeat from frontend
I1214 19:38:12.840399 15879 heartbeat_server.cpp:57] get heartbeat from FE.host:192.168.102.132, port:9020, cluster id:695164470, counter:1
I1214 19:38:12.840416 15879 heartbeat_server.cpp:116] master change. new master host: 192.168.102.132. port: 9020. epoch: 8
I1214 19:38:12.840420 15879 heartbeat_server.cpp:136] get token. token: 9fd66d63-d8b4-482f-bea5-cba5899d1343
I1214 19:38:12.840423 15879 heartbeat_server.cpp:157] Master FE is changed or restarted. report tablet and disk info immediately
I1214 19:38:13.722368 15714 data_dir.cpp:727] path: /home/StarRocks-1.19.2/be/storage total capacity: 528311816192, available capacity: 182844493824
I1214 19:38:13.722440 15715 tablet_manager.cpp:942] Reporting all tablets info
I1214 19:38:13.722505 15715 tablet_manager.cpp:947] Found 0 expired tablet transactions
I1214 19:38:13.722551 15715 tablet_manager.cpp:979] Reported all 21 tablets info
I1214 19:38:13.724146 15714 data_dir.cpp:727] path: /home/StarRocks-1.19.2/be/storage total capacity: 528311816192, available capacity: 182844493824
I1214 19:38:13.724228 15715 tablet_manager.cpp:942] Reporting all tablets info
I1214 19:38:13.724243 15715 tablet_manager.cpp:947] Found 0 expired tablet transactions
I1214 19:38:13.724273 15715 tablet_manager.cpp:979] Reported all 21 tablets info
I1214 19:38:15.903141 15937 task_worker_pool.cpp:178] submitting task. type=CLONE, signature=17856
I1214 19:38:15.903187 15937 task_worker_pool.cpp:190] success to submit task. type=CLONE, signature=17856, task_count_in_queue=1
I1214 19:38:15.903200 15937 task_worker_pool.cpp:178] submitting task. type=CLONE, signature=17286
I1214 19:38:15.903214 15937 task_worker_pool.cpp:190] success to submit task. type=CLONE, signature=17286, task_count_in_queue=2
I1214 19:38:15.903259 15708 task_worker_pool.cpp:864] get clone task. signature:17856
I1214 19:38:15.903281 15709 task_worker_pool.cpp:864] get clone task. signature:17286
I1214 19:38:15.903312 15709 engine_clone_task.cpp:127] Creating a new replica of tablet 17286 by clone. committed_version=2 signature=17286
I1214 19:38:15.903292 15708 engine_clone_task.cpp:127] Creating a new replica of tablet 17856 by clone. committed_version=2 signature=17856
I1214 19:38:15.903375 15709 storage_engine.cpp:861] Obtained shard path=/home/StarRocks-1.19.2/be/storage/data/0
I1214 19:38:15.903375 15708 storage_engine.cpp:861] Obtained shard path=/home/StarRocks-1.19.2/be/storage/data/1
I1214 19:38:15.906436 15708 engine_clone_task.cpp:402] Downloading http://192.168.102.132:18040/api/_tablet/_download?token=9fd66d63-d8b4-482f-bea5-cba5899d1343&file=/home/StarRocks-1.19.2/be/storage/snapshot/20211214193815.108.180//17856/937925265/0200000000000012734644890284bdc388391f6d3db1fe90_0.dat to /home/StarRocks-1.19.2/be/storage/data/1/17856/937925265/0200000000000012734644890284bdc388391f6d3db1fe90_0.dat. bytes=212562386 timeout=4151
I1214 19:38:15.907538 15709 engine_clone_task.cpp:402] Downloading http://192.168.102.132:18040/api/_tablet/_download?token=9fd66d63-d8b4-482f-bea5-cba5899d1343&file=/home/StarRocks-1.19.2/be/storage/snapshot/20211214193815.107.180//17286/1491134878/020000000000004fc14f5732c60da3583732942c53b833b5_0.dat to /home/StarRocks-1.19.2/be/storage/data/0/17286/1491134878/020000000000004fc14f5732c60da3583732942c53b833b5_0.dat. bytes=9042 timeout=300
I1214 19:38:15.909682 15709 engine_clone_task.cpp:402] Downloading http://192.168.102.132:18040/api/_tablet/_download?token=9fd66d63-d8b4-482f-bea5-cba5899d1343&file=/home/StarRocks-1.19.2/be/storage/snapshot/20211214193815.107.180//17286/1491134878/meta to /home/StarRocks-1.19.2/be/storage/data/0/17286/1491134878/meta. bytes=444 timeout=300
I1214 19:38:15.910574 15709 engine_clone_task.cpp:429] Copied tablet 17286. bytes=9486 cost=3 ms rate=3.162 MB/s
I1214 19:38:15.911794 15709 engine_clone_task.cpp:284] Cloned snapshot from http://192.168.102.132:18040/api/_tablet/_download?token=9fd66d63-d8b4-482f-bea5-cba5899d1343&file=/home/StarRocks-1.19.2/be/storage/snapshot/20211214193815.107.180//17286/1491134878/ to /home/StarRocks-1.19.2/be/storage/data/0/17286/1491134878
I1214 19:38:15.911811 15709 tablet_manager.cpp:1459] Loading tablet 17286 from snapshot /home/StarRocks-1.19.2/be/storage/data/0/17286/1491134878
W1214 19:38:15.911962 15709 engine_clone_task.cpp:170] Fail to load tablet from snapshot: Internal error: tablet already exist. schema_hash_dir=/home/StarRocks-1.19.2/be/storage/data/0/17286/1491134878 signature=17286
W1214 19:38:15.911978 15709 engine_clone_task.cpp:182] Removing /home/StarRocks-1.19.2/be/storage/data/0/17286
W1214 19:38:15.912119 15709 task_worker_pool.cpp:918] clone failed. signature: 17286
I1214 19:38:15.913034 15709 task_worker_pool.cpp:254] finish task success.
I1214 19:38:15.913043 15709 task_worker_pool.cpp:214] remove task info. type=CLONE, signature=17286, queue_size=1
I1214 19:38:22.332566 15708 engine_clone_task.cpp:402] Downloading http://192.168.102.132:18040/api/_tablet/_download?token=9fd66d63-d8b4-482f-bea5-cba5899d1343&file=/home/StarRocks-1.19.2/be/storage/snapshot/20211214193815.108.180//17856/937925265/meta to /home/StarRocks-1.19.2/be/storage/data/1/17856/937925265/meta. bytes=3025 timeout=300
I1214 19:38:22.339392 15708 engine_clone_task.cpp:429] Copied tablet 17856. bytes=212565411 cost=6433 ms rate=33.043 MB/s
I1214 19:38:22.339927 15708 engine_clone_task.cpp:284] Cloned snapshot from http://192.168.102.132:18040/api/_tablet/_download?token=9fd66d63-d8b4-482f-bea5-cba5899d1343&file=/home/StarRocks-1.19.2/be/storage/snapshot/20211214193815.108.180//17856/937925265/ to /home/StarRocks-1.19.2/be/storage/data/1/17856/937925265
I1214 19:38:22.339947 15708 tablet_manager.cpp:1459] Loading tablet 17856 from snapshot /home/StarRocks-1.19.2/be/storage/data/1/17856/937925265
W1214 19:38:22.340134 15708 engine_clone_task.cpp:170] Fail to load tablet from snapshot: Internal error: tablet already exist. schema_hash_dir=/home/StarRocks-1.19.2/be/storage/data/1/17856/937925265 signature=17856
W1214 19:38:22.340165 15708 engine_clone_task.cpp:182] Removing /home/StarRocks-1.19.2/be/storage/data/1/17856
W1214 19:38:22.380I1214 19:49:08.857376 30809 daemon.cpp:277] version 1.19.2 RELEASE (build b04a782)
Built on 2021-11-20 20:25:16 by jenkins@ci01