事务无法被kill,报错The transaction is not able to be killed

【TDengine 使用环境】
生产环境

【TDengine 版本】

3.4.0.9

【操作系统以及版本】

ubuntu

【部署方式】容器/非容器部署

非容器部署

【集群节点数】

3

【集群副本数】

3

【描述业务影响】

情况:集群内部正在执行两个 trim-db(清理数据库残留/过期数据的后台任务,事务 ID 为 112058112060)。这两个任务需要连到 node1 上执行,但 node1offline 状态。所以任务陷入了无限重试的死循环(已经失败了 27 次,状态一直报 Unable to establish connection)。这应该怎么解决

影响:事务卡住无法KILL,导致业务无法操作create、drop操作

【问题复现路径/shan】做过哪些操作出现的问题

【遇到的问题:问题现象及影响】

【资源配置】

【报错完整截图】(不要大段的粘贴报错代码,论坛直接看报错代码不直观)

发下具体 taosdlog 看下吧

03/20 13:58:56.096550 02398785 C MND INFO trans:112060, execute transaction in process response
03/20 13:58:56.096552 02398785 C MND INFO trans:112060, continue to execute stage:redoAction in transContext, createTime:1772180954788
03/20 13:58:56.096554 02398785 C MND ERROR trans:112060, all 2 actions executed, code:0x503
03/20 13:58:56.096556 02398785 C MND INFO trans:112060, redoAction:1 execute status is reset
03/20 13:58:56.096557 02398785 C MND INFO trans:112060, redoAction:1 reset, errCode:-2147482365, startTime:1774000736096
03/20 13:58:56.096559 02398785 C MND ERROR trans:112060, failed to execute redoActions since:Vnode is closed or removed, code:0x80000503, in transContext
03/20 13:58:56.096562 02398785 C MND ERROR trans:112060, stage keep on redoAction since Vnode is closed or removed, failedTimes:1641
03/20 13:58:56.096564 02398785 C MND INFO vgId:1, trans:112060, start to send rsp, stage:redoAction failedTimes:1641 code:0x80000503
03/20 13:58:56.096565 02398785 C MND INFO vgId:1, trans:112060, start to lock rpc array
03/20 13:58:56.096567 02398785 C MND INFO vgId:1, trans:112060, release transaction
03/20 13:58:56.096571 02398785 C MND INFO trans:112058, redoAction:0 response is received, msgType:vnode-trim, QID:0x0:0x465a10aaf079a2d9, received code:0x80000503(Vnode is closed or removed), accept:0x0(success) retry:0x0(success)
03/20 13:58:56.096573 02398785 C MND INFO trans:112058, execute transaction in process response
03/20 13:58:56.096574 02398785 C MND INFO trans:112058, continue to execute stage:redoAction in transContext, createTime:1772180954773
03/20 13:58:56.096575 02398785 C MND ERROR trans:112058, all 1 actions executed, code:0x503
03/20 13:58:56.096578 02398785 C MND INFO trans:112058, redoAction:0 execute status is reset
03/20 13:58:56.096579 02398785 C MND INFO trans:112058, redoAction:0 reset, errCode:-2147482365, startTime:1774000736096
03/20 13:58:56.096581 02398785 C MND ERROR trans:112058, failed to execute redoActions since:Vnode is closed or removed, code:0x80000503, in transContext
03/20 13:58:56.096583 02398785 C MND ERROR trans:112058, stage keep on redoAction since Vnode is closed or removed, failedTimes:1641
03/20 13:58:56.096584 02398785 C MND INFO vgId:1, trans:112058, start to send rsp, stage:redoAction failedTimes:1641 code:0x80000503
03/20 13:58:56.096586 02398785 C MND INFO vgId:1, trans:112058, start to lock rpc array
03/20 13:58:56.096587 02398785 C MND INFO vgId:1, trans:112058, release transaction

帮忙看看,这是taosd日志