数据订阅 拉取耗时太长

开源版问题专区
1

Image 这个日志打印17s多，是什么原因？

网络也正常
Image

社区版 3.3.8.1

目前的架构是 6台服务器，其中5台tdengine server，第6台服务器 从其他5台通过数据订阅拉取数据，
每台服务器拉取开了5个线程，一共25个线程，
参数：
properties.setProperty(TMQConstants.CONNECT_TYPE, “ws”);
properties.setProperty(TMQConstants.CONNECT_USER, “root”);
properties.setProperty(TMQConstants.CONNECT_PASS, “taosdata”);
properties.setProperty(TMQConstants.AUTO_OFFSET_RESET, “latest”);
properties.setProperty(TMQConstants.MSG_WITH_TABLE_NAME, “true”);
properties.setProperty(TMQConstants.ENABLE_AUTO_COMMIT, “true”);
properties.setProperty(TMQConstants.AUTO_COMMIT_INTERVAL, “1000”);

5台服务器的数据库创建语句
CREATE DATABASE tpih PRECISION ‘ns’ KEEP 150 VGROUPS 10 CACHEMODEL ‘both’ DURATION 24h BUFFER 16;

image
image1704×351 105 KB

2

TMQConstants.AUTO_OFFSET_RESET 设置为 latest 表示订阅最新数据，poll 时可能没有数据写入。

4

有数据啊 通过sql查了

5

好复现吗？打开 Adapter debug 日志，看看 poll 返回用了多久

7

/etc/taos/taosadapter.toml debug:true

日志是 这些么？

image
image717×219 23.3 KB

8

image
image1114×738 140 KB

9

方便腾讯会议一起看下吗？ 1h 有效
会议时间：2025/11/11 09:19-10:19 (GMT+08:00) 中国标准时间 - 北京

点击链接直接加入会议：

#腾讯会议：180-129-163

复制该信息，打开手机腾讯会议即可参与

10

@TDuser_brAL_9007

11

无法腾讯会议

12

我打包一个日志 稍等

13

11/11 09:32:31.775141 02803895 C QRY INFO QID:0x1b832708b0a0003b init with pTrans:0x2
11/11 09:32:34.391169 02803963 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:34.396336 02803964 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:34.396353 02803964 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:37.391219 02803995 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:37.396143 02803996 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:37.396166 02803996 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:40.391458 02804019 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:40.396301 02804022 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:40.396304 02804023 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:43.391202 02804035 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:43.396076 02803918 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:43.396153 02803917 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:44.801233 02805863 C QRY INFO QID:0x1b832708b3d0003c init with pTrans:0x2
11/11 09:32:44.804401 02803893 C QRY INFO QID:0x200000000000000e init with pTrans:0x2
11/11 09:32:46.391410 02803947 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:46.396358 02803946 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:46.396401 02803949 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:46.775480 02803893 C QRY INFO QID:0x1b832708b450003d init with pTrans:0x2
11/11 09:32:49.391417 02803981 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:49.396231 02803979 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:49.396446 02803982 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:52.391405 02803993 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:52.396183 02804003 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:52.396246 02804006 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:55.391241 02804025 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:55.396289 02804026 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:55.396315 02804026 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:58.391318 02803930 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:32:58.396191 02803931 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:32:58.396218 02803931 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:32:59.801120 02805863 C QRY INFO QID:0x1b832708b780003e init with pTrans:0x2
11/11 09:32:59.804059 02803875 C QRY INFO QID:0x200000000000000f init with pTrans:0x2
11/11 09:33:01.395233 02803956 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:01.400212 02803955 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:01.400268 02803960 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:01.704098 02803875 C QRY INFO QID:0x1b832708b7f0003f init with pTrans:0x2
11/11 09:33:04.400245 02803986 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:04.405245 02803988 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:04.405418 02803987 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:07.405270 02804010 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:07.410293 02804012 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:07.410325 02804011 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:10.410390 02803910 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:10.415286 02804036 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:10.415462 02804037 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:13.415463 02803940 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:13.420294 02803941 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:13.420458 02803942 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:14.730140 02803893 C QRY INFO QID:0x1b832708bb200040 init with pTrans:0x2
11/11 09:33:14.732924 02803875 C QRY INFO QID:0x2000000000000010 init with pTrans:0x2
11/11 09:33:16.420244 02803968 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:16.425279 02803965 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:16.425456 02803969 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:16.704091 02803893 C QRY INFO QID:0x1b832708bba00041 init with pTrans:0x2
11/11 09:33:19.425480 02804003 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:19.430316 02804006 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:19.430338 02804006 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:22.430397 02804024 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:22.435213 02804029 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:22.435236 02804029 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:25.435337 02803919 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:25.440302 02803922 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:25.440330 02803922 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:28.440267 02803945 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:28.445219 02803944 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:28.445254 02803944 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:29.730160 02805863 C QRY INFO QID:0x1b832708bed00042 init with pTrans:0x2
11/11 09:33:29.733433 02803893 C QRY INFO QID:0x2000000000000011 init with pTrans:0x2
11/11 09:33:31.445395 02803983 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:31.450194 02803984 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:31.450258 02803985 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:31.704826 02803875 C QRY INFO QID:0x1b832708bf400043 init with pTrans:0x2
11/11 09:33:34.450278 02804013 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:34.455274 02804012 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:34.455402 02804010 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:37.455258 02803913 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:37.460214 02803924 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:37.460330 02803921 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:40.460479 02803940 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:40.465350 02803942 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:40.465383 02803942 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:43.465339 02803968 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:43.470243 02803965 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:43.470290 02803967 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:44.730503 02803875 C QRY INFO QID:0x1b832708c2700044 init with pTrans:0x2
11/11 09:33:44.733450 02805863 C QRY INFO QID:0x2000000000000012 init with pTrans:0x2
11/11 09:33:46.470614 02804000 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:46.475414 02803992 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:46.475439 02803992 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:46.705512 02803875 C QRY INFO QID:0x1b832708c2f00045 init with pTrans:0x2
11/11 09:33:48.827278 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 start to unsubscribe consumer, status:1
11/11 09:33:48.827298 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 closing poll:440 rows:107258 topics:1, final epoch:1
11/11 09:33:48.827301 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 rows dist begin:
11/11 09:33:48.827303 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 topic:0
11/11 09:33:48.827306 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 0. vgId:3 rows:0
11/11 09:33:48.827308 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 1. vgId:4 rows:53629
11/11 09:33:48.827310 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 2. vgId:5 rows:0
11/11 09:33:48.827312 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 3. vgId:6 rows:0
11/11 09:33:48.827314 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 4. vgId:7 rows:26815
11/11 09:33:48.827316 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 5. vgId:8 rows:0
11/11 09:33:48.827317 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 6. vgId:9 rows:26814
11/11 09:33:48.827346 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 7. vgId:10 rows:0
11/11 09:33:48.827348 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 8. vgId:11 rows:0
11/11 09:33:48.827349 02805647 C TQ INFO topic:1.topic_tpihv1_ls, 9. vgId:12 rows:0
11/11 09:33:48.827352 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 rows dist end
11/11 09:33:48.827452 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 cgroup:GROUP_GK_01_topic_tpihv1_ls, subscribe 0 topics
11/11 09:33:48.827735 02804018 C TQ INFO consumer:0x4e6c2708a1e00132, update noPrivilege:0, topic:1.topic_tpihv1_ls
11/11 09:33:48.829263 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 start to unsubscribe consumer, status:1
11/11 09:33:48.829273 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 closing poll:102 rows:62767 topics:1, final epoch:1
11/11 09:33:48.829276 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 rows dist begin:
11/11 09:33:48.829278 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 topic:0
11/11 09:33:48.829280 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 0. vgId:3 rows:0
11/11 09:33:48.829280 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 start to unsubscribe consumer, status:1
11/11 09:33:48.829282 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 1. vgId:4 rows:0
11/11 09:33:48.829283 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 closing poll:87 rows:73533 topics:1, final epoch:1
11/11 09:33:48.829285 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 2. vgId:5 rows:0
11/11 09:33:48.829286 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 rows dist begin:
11/11 09:33:48.829286 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 3. vgId:6 rows:20922
11/11 09:33:48.829287 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 topic:0
11/11 09:33:48.829288 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 4. vgId:7 rows:0
11/11 09:33:48.829290 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 5. vgId:8 rows:0
11/11 09:33:48.829290 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 0. vgId:3 rows:0
11/11 09:33:48.829292 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 6. vgId:9 rows:0
11/11 09:33:48.829292 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 1. vgId:4 rows:0
11/11 09:33:48.829293 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 7. vgId:10 rows:20923
11/11 09:33:48.829294 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 2. vgId:5 rows:0
11/11 09:33:48.829295 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 8. vgId:11 rows:20922
11/11 09:33:48.829296 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 3. vgId:6 rows:0
11/11 09:33:48.829297 02805646 C TQ INFO topic:1.topic_tpihv1_sa, 9. vgId:12 rows:0
11/11 09:33:48.829298 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 4. vgId:7 rows:19407
11/11 09:33:48.829299 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 rows dist end
11/11 09:33:48.829299 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 5. vgId:8 rows:19406
11/11 09:33:48.829301 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 6. vgId:9 rows:15312
11/11 09:33:48.829303 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 7. vgId:10 rows:19408
11/11 09:33:48.829305 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 8. vgId:11 rows:0
11/11 09:33:48.829306 02805645 C TQ INFO topic:1.topic_tpihv1_ts, 9. vgId:12 rows:0
11/11 09:33:48.829308 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 rows dist end
11/11 09:33:48.829333 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 cgroup:GROUP_GK_01_topic_tpihv1_ts, subscribe 0 topics
11/11 09:33:48.829339 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 cgroup:GROUP_GK_01_topic_tpihv1_sa, subscribe 0 topics
11/11 09:33:48.829516 02805647 C TQ INFO consumer:0x4e6c2708a1e00132, mnd not ready for subscribe, retry:1 in 500ms
11/11 09:33:48.830830 02804019 C TQ INFO consumer:0x4e6c2708a1e00130, update noPrivilege:0, topic:1.topic_tpihv1_ts
11/11 09:33:48.830853 02804019 C TQ INFO consumer:0x4e6c2708a1e00131, update noPrivilege:0, topic:1.topic_tpihv1_sa
11/11 09:33:48.831045 02805645 C TQ INFO consumer:0x4e6c2708a1e00130, mnd not ready for subscribe, retry:1 in 500ms
11/11 09:33:48.832288 02805646 C TQ INFO consumer:0x4e6c2708a1e00131, mnd not ready for subscribe, retry:1 in 500ms
11/11 09:33:49.330053 02805647 C TQ INFO consumer:0x4e6c2708a1e00132, mnd not ready for subscribe, retry:2 in 500ms
11/11 09:33:49.331600 02805645 C TQ INFO consumer:0x4e6c2708a1e00130, mnd not ready for subscribe, retry:2 in 500ms
11/11 09:33:49.332791 02803914 C TQ INFO consumer:0x4e6c2708a1e00131 update ep epoch from 1 to epoch 2, incoming topics:0, existed topics:1
11/11 09:33:49.332803 02803914 C TQ INFO consumer:0x4e6c2708a1e00131 update topic info completed
11/11 09:33:49.332961 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 start to close consumer, status:1
11/11 09:33:49.332969 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 start to unsubscribe consumer, status:1
11/11 09:33:49.332972 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 closing poll:102 rows:62767 topics:0, final epoch:2
11/11 09:33:49.332974 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 rows dist begin:
11/11 09:33:49.332976 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 rows dist end
11/11 09:33:49.332997 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 cgroup:GROUP_GK_01_topic_tpihv1_sa, subscribe 0 topics
11/11 09:33:49.333807 02805646 C TQ ERROR failed to stop ep timer
11/11 09:33:49.333815 02805646 C TQ INFO consumer:0x4e6c2708a1e00131 closed
11/11 09:33:49.830575 02803919 C TQ INFO consumer:0x4e6c2708a1e00132 update ep epoch from 1 to epoch 2, incoming topics:0, existed topics:1
11/11 09:33:49.830590 02803919 C TQ INFO consumer:0x4e6c2708a1e00132 update topic info completed
11/11 09:33:49.830715 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 start to close consumer, status:1
11/11 09:33:49.830722 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 start to unsubscribe consumer, status:1
11/11 09:33:49.830725 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 closing poll:440 rows:107258 topics:0, final epoch:2
11/11 09:33:49.830728 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 rows dist begin:
11/11 09:33:49.830730 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 rows dist end
11/11 09:33:49.830749 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 cgroup:GROUP_GK_01_topic_tpihv1_ls, subscribe 0 topics
11/11 09:33:49.831579 02805647 C TQ ERROR failed to stop ep timer
11/11 09:33:49.831584 02805647 C TQ INFO consumer:0x4e6c2708a1e00132 closed
11/11 09:33:49.832449 02803925 C TQ INFO consumer:0x4e6c2708a1e00130 update ep epoch from 1 to epoch 2, incoming topics:0, existed topics:1
11/11 09:33:49.832472 02803925 C TQ INFO consumer:0x4e6c2708a1e00130 update topic info completed
11/11 09:33:49.832595 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 start to close consumer, status:1
11/11 09:33:49.832602 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 start to unsubscribe consumer, status:1
11/11 09:33:49.832606 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 closing poll:87 rows:73533 topics:0, final epoch:2
11/11 09:33:49.832608 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 rows dist begin:
11/11 09:33:49.832610 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 rows dist end
11/11 09:33:49.832634 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 cgroup:GROUP_GK_01_topic_tpihv1_ts, subscribe 0 topics
11/11 09:33:49.833434 02805645 C TQ ERROR failed to stop ep timer
11/11 09:33:49.833441 02805645 C TQ INFO consumer:0x4e6c2708a1e00130 closed

14

你可以先打开 Adapter debug 日志，用命令 curl --location --request PUT ‘http://127.0.0.1:6041/config’ \
-u root:taosdata \
–data ‘{“log.level”: “debug”}’

然后再复现下。

然后去 /var/log/taos 下看看 taosAdapter 日志中每个命令执行多久。

验证后可以把日志级别再调整回 info

15

image
image1382×814 229 KB

16

image
image1457×707 150 KB
是这个时间么？很短啊，为什么客户端poll就很久

17

image
image1457×615 146 KB

18

image
image1230×860 216 KB

19

你是否复现了问题，把 java 应用 17s 的日志也贴出来吧

20

image
image1537×646 218 KB

image
image1801×783 186 KB

21

我没有配置 min.poll.rows，为什么每次都是积累4096条才poll成功，别的服务器不是这样。不知道是不是这个问题

22

properties.setProperty(TMQConstants.CONNECT_TYPE, “ws”); properties.setProperty(TMQConstants.CONNECT_USER, “root”); properties.setProperty(TMQConstants.CONNECT_PASS, “taosdata”); properties.setProperty(TMQConstants.AUTO_OFFSET_RESET, “latest”); properties.setProperty(TMQConstants.MSG_WITH_TABLE_NAME, “true”); properties.setProperty(TMQConstants.ENABLE_AUTO_COMMIT, “true”); properties.setProperty(TMQConstants.AUTO_COMMIT_INTERVAL, “1000”); properties.setProperty(“min.poll.rows”, “50”); // 加了这行好多了