问题:sink连接器 create TDengine Connection超时
环境:
操作系统 Ubuntu 22.04
Java jdk 1.8.0_452、
Kafka kafka_2.12-3.2.0
TDengine 3.3.5
Kafka Connect插件 taosdata-kafka-connect-tdengine-1.1.6.zip
JDBC Driver (connect-1.1.6中官方依赖版本taos-jdbcdriver 3.3.3)
现状:
启动连接器成功,bin/connect-distributed.sh config/connect-distributed.properties ,观察connect.log日志中无特别报错异常;
开启连接器成功,curl -X POST -d @sink-dome.json http://localhost:8083/connectors -H “Content-Type: application/json” 日志中未发现特别异常,存在 “Kafka Connect started ”;
向kafka中推数据,出现TDengine连接超时日志:cat test-data.txt | bin/kafka-console-producer.sh --broker-list localhost:9092 --topic meters 向kafka中推送数据成功(借用kafka工具验证topic中确切有数据),观察connect.log日志中提示 create TDengine Connection超时,存在以下提示:
[2025-11-07 12:10:47,748] INFO [TDengineSinkConnector|task-0] [Consumer clientId=connector-consumer-TDengineSinkConnector-0, groupId=connect-TDengineSinkConnector] Resetting offset for partition meters-0 to position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[10.1.1.117:9092 (id: 0 rack: null)], epoch=0}}. (org.apache.kafka.clients.consumer.internals.SubscriptionState:399)
[2025-11-07 12:10:47,761] INFO [TDengineSinkConnector|task-0] create TDengine Connection, Attempt 0 of 5 (com.taosdata.kafka.connect.db.TSDBConnectionProvider:34)
[2025-11-07 12:15:47,752] INFO [TDengineSinkConnector|task-0] [Consumer clientId=connector-consumer-TDengineSinkConnector-0, groupId=connect-TDengineSinkConnector] Request joining group due to: consumer pro-actively leaving the group (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1045)
[2025-11-07 12:15:47,751] WARN [TDengineSinkConnector|task-0] [Consumer clientId=connector-consumer-TDengineSinkConnector-0, groupId=connect-TDengineSinkConnector] consumer poll timeout has expired. This means the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time processing messages. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1455)
验证taos连接正常,TAOS CLI、 REST API方式验证连接均正常:
taos -h 10.1.1.114 -u root -d test -s “use test; SHOW TABLES;” -p 如期返回;
curl -u root:sjpX$33PP8 http://10.1.1.114:6041/rest/sql -d “show databases”
{“code”:0,“column_meta”:[[“name”,“VARCHAR”,64]],“data”:[[“information_schema”],[“performance_schema”],[“test”]],“rows”:3}