【kafka-connect-tdengine】sink连接器 create TDengine Connection超时

问题:sink连接器 create TDengine Connection超时

环境

操作系统 Ubuntu 22.04
Java jdk 1.8.0_452、
Kafka kafka_2.12-3.2.0
TDengine 3.3.5
Kafka Connect插件 taosdata-kafka-connect-tdengine-1.1.6.zip
JDBC Driver (connect-1.1.6中官方依赖版本taos-jdbcdriver 3.3.3)

现状

启动连接器成功,bin/connect-distributed.sh config/connect-distributed.properties ,观察connect.log日志中无特别报错异常;

开启连接器成功,curl -X POST -d @sink-dome.json http://localhost:8083/connectors -H “Content-Type: application/json” 日志中未发现特别异常,存在 “Kafka Connect started ”;

向kafka中推数据,出现TDengine连接超时日志:cat test-data.txt | bin/kafka-console-producer.sh --broker-list localhost:9092 --topic meters 向kafka中推送数据成功(借用kafka工具验证topic中确切有数据),观察connect.log日志中提示 create TDengine Connection超时,存在以下提示:

[2025-11-07 12:10:47,748] INFO [TDengineSinkConnector|task-0] [Consumer clientId=connector-consumer-TDengineSinkConnector-0, groupId=connect-TDengineSinkConnector] Resetting offset for partition meters-0 to position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[10.1.1.117:9092 (id: 0 rack: null)], epoch=0}}. (org.apache.kafka.clients.consumer.internals.SubscriptionState:399)

[2025-11-07 12:10:47,761] INFO [TDengineSinkConnector|task-0] create TDengine Connection, Attempt 0 of 5 (com.taosdata.kafka.connect.db.TSDBConnectionProvider:34)

[2025-11-07 12:15:47,752] INFO [TDengineSinkConnector|task-0] [Consumer clientId=connector-consumer-TDengineSinkConnector-0, groupId=connect-TDengineSinkConnector] Request joining group due to: consumer pro-actively leaving the group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1045)

[2025-11-07 12:15:47,751] WARN [TDengineSinkConnector|task-0] [Consumer clientId=connector-consumer-TDengineSinkConnector-0, groupId=connect-TDengineSinkConnector] consumer poll timeout has expired. This means the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time processing messages. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1455)

验证taos连接正常,TAOS CLI、 REST API方式验证连接均正常:

taos -h 10.1.1.114 -u root -d test -s “use test; SHOW TABLES;” -p 如期返回;

curl -u root:sjpX$33PP8 http://10.1.1.114:6041/rest/sql -d “show databases”
{“code”:0,“column_meta”:[[“name”,“VARCHAR”,64]],“data”:[[“information_schema”],[“performance_schema”],[“test”]],“rows”:3}

Unable to connect to database on attempt 这种日志才是连接失败后会打印的。
create TDengine Connection, Attempt 0 of 5 是没问题的

为啥会 consumer poll timeout,请问您有排查思路吗?taos cli和restapi方式验证url和账密都没问题

这个 poll time out,是从 Kafaka 中拉取数据,您检查下kafka 配置吧

感谢答复,问题解决了,最终原因是url中端口给配错了,下意识的就配置了taos连接端口6041,应该配置6030;因为端口不对,多次创建TDengine Connection失败,最终自动关闭了kafka消费组组;

此话题已在最后回复的 30 天后被自动关闭。不再允许新回复。