【详述】kafka持续导入任务状态是RUNNING 但没有在消费 offset没有在动
【背景】今天突然没有在采集了，但状态还是RUNNING
【业务影响】
【StarRocks版本】例如：2.4.3
【集群规模】例如：2fe（1 follower+2observer）+6be（fe与be混部）
| 396299 | bd_t_event_log | 2022-12-21 14:48:41 | NULL | NULL | tdxdb | bd_t_event_log | RUNNING | KAFKA | 5 |
show routine load task where jobname =‘bd_t_event_log’;
±-------------------------------------±--------±----------±-------±--------------------±--------------------±--------------------±--------±------±----------------------------±-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| TaskId | TxnId | TxnStatus | JobId | CreateTime | LastScheduledTime | ExecuteStartTime | Timeout | BeId | DataSourceProperties | Message |
±-------------------------------------±--------±----------±-------±--------------------±--------------------±--------------------±--------±------±----------------------------±-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 2543db8d-9935-4ac8-9678-dd6c1715a158 | -1 | UNKNOWN | 396299 | 2022-12-30 09:29:31 | 2022-12-30 09:30:51 | NULL | 60 | -1 | {“4”:79833678} | check task ready to execute failed, err: failed to send proxy request to TNetworkAddress(hostname:192.168.2.231, port:8061) err failed to send proxy request to TNetworkAddress(hostname:192.168.2.231, port:8061) err [too busy to get kafka info, please check the kafka broker status, or set internal_service_async_thread_num bigger] |
| dc326c7f-0d98-4b13-99b2-2047b439f8b3 | 3861250 | UNKNOWN | 396299 | 2022-12-30 09:29:41 | 2022-12-30 09:30:11 | 2022-12-30 09:30:11 | 60 | 10003 | {“2”:79735530,“7”:79733801} | task submitted to execute |
| e56fd325-2ad1-4d67-a62f-81ddf25ce986 | -1 | UNKNOWN | 396299 | 2022-12-30 09:30:46 | 2022-12-30 09:30:56 | NULL | 60 | -1 | {“1”:80342649,“6”:76413179} | check task ready to execute failed, err: failed to send proxy request to TNetworkAddress(hostname:192.168.2.219, port:8061) err failed to send proxy request to TNetworkAddress(hostname:192.168.2.219, port:8061) err [too busy to get kafka info, please check the kafka broker status, or set internal_service_async_thread_num bigger] |
| 22bfcc4c-e6ad-461c-abbc-21845363ec08 | -1 | UNKNOWN | 396299 | 2022-12-30 09:30:51 | NULL | NULL | 60 | -1 | {“3”:79702935} | previous task aborted because of timeout by txn manager |
| 07291548-5d82-4ed8-906f-7e006bdb155c | -1 | UNKNOWN | 396299 | 2022-12-30 09:30:56 | NULL | NULL | 60 | -1 | {“0”:83775988,“5”:80197421} | NULL |
这块有提示，确认下kafka的broker状态是正常的吗
kafka的broker状态都是正常的，其他的还在正常消费
这台be的info日志上传下