子表太多导致taosdump备份1个G的数据库长时间运行超过10小时,有什么效率更高的方法

【TDengine 使用环境】
生产环境

【TDengine 版本】3.3.7.5

【操作系统以及版本】

【部署方式】非容器部署

【集群节点数】3

【集群副本数】3

【描述业务影响】长时间备份为完成

.INFO: prod_data_center_ts.ts_small_week_rpt [2653/40657] write avro 100% of SWR2008802765825442167
.INFO: prod_data_center_ts.ts_small_week_rpt [2654/40657] write avro 100% of SWR2013195948789400487
.INFO: prod_data_center_ts.ts_small_flux_data [35469/40695] write avro 100% of SFD2007734707694404015
.INFO: prod_data_center_ts.ts_small_week_rpt [2655/40657] write avro 100% of SWR2009600488656929174
.INFO: prod_data_center_ts.ts_small_week_rpt [2656/40657] write avro 100% of SWR2006226054411780319
.INFO: prod_data_center_ts.ts_small_week_rpt [2657/40657] write avro 100% of SWR1998739338255991361
.INFO: prod_data_center_ts.ts_small_week_rpt [2658/40657] write avro 100% of SWR2008802765825442174
.INFO: prod_data_center_ts.ts_small_week_rpt [2659/40657] write avro 100% of SWR2007726138941047550
.INFO: prod_data_center_ts.ts_small_week_rpt [2660/40657] write avro 100% of SWR2009600488656929092
.INFO: prod_data_center_ts.ts_small_flux_data [35470/40695] write avro 100% of SFD1978995114539286617
.INFO: prod_data_center_ts.ts_small_week_rpt [2661/40657] write avro 100% of SWR2006226054411780276
.INFO: prod_data_center_ts.ts_small_flux_data [35471/40695] write avro 100% of SFD2006265366247440901
.INFO: prod_data_center_ts.ts_small_week_rpt [2662/40657] write avro 100% of SWR2010601599895405015
.INFO: prod_data_center_ts.ts_small_week_rpt [2663/40657] write avro 100% of SWR1998739338255991338
.INFO: prod_data_center_ts.ts_small_week_rpt [2664/40657] write avro 100% of SWR2008802765825442158
.INFO: prod_data_center_ts.ts_small_flux_data [35472/40695] write avro 100% of SFD2008799481425363295
.INFO: prod_data_center_ts.ts_small_week_rpt [2665/40657] write avro 100% of SWR2009600488656928937
.INFO: prod_data_center_ts.ts_small_week_rpt [2666/40657] write avro 100% of SWR2001574167251059464
.INFO: prod_data_center_ts.ts_small_week_rpt [2667/40657] write avro 100% of SWR2006226054411780318
.INFO: prod_data_center_ts.ts_small_week_rpt [2668/40657] write avro 100% of SWR2013195948789400486
.INFO: prod_data_center_ts.ts_small_week_rpt [2669/40657] write avro 100% of SWR2008802765825442140
.INFO: prod_data_center_ts.ts_small_week_rpt [2670/40657] write avro 100% of SWR1998739338255991396
.INFO: prod_data_center_ts.ts_small_flux_data [35473/40695] write avro 100% of SFD2010606950254444787
.INFO: prod_data_center_ts.ts_small_week_rpt [2671/40657] write avro 100% of SWR2009599967124587518
.INFO: prod_data_center_ts.ts_small_week_rpt [2672/40657] write avro 100% of SWR2006226054411780283
.INFO: prod_data_center_ts.ts_small_week_rpt [2673/40657] write avro 100% of SWR1998739338255991353
.INFO: prod_data_center_ts.ts_small_week_rpt [2674/40657] write avro 100% of SWR2008802765825442144
.INFO: prod_data_center_ts.ts_small_week_rpt [2675/40657] write avro 100% of SWR2007726138941047534
.INFO: prod_data_center_ts.ts_small_flux_data [35474/40695] write avro 100% of SFD1998741150727996061
.INFO: prod_data_center_ts.ts_small_week_rpt [2676/40657] write avro 100% of SWR2009599967124587484
.INFO: prod_data_center_ts.ts_small_week_rpt [2677/40657] write avro 100% of SWR2010601599895405021
.INFO: prod_data_center_ts.ts_small_flux_data [35475/40695] write avro 100% of SFD2009599967124586596
.INFO: prod_data_center_ts.ts_small_week_rpt [2678/40657] write avro 100% of SWR2006226054411780311
.INFO: prod_data_center_ts.ts_small_week_rpt [2679/40657] write avro 100% of SWR1998739338255991388
.INFO: prod_data_center_ts.ts_small_week_rpt [2680/40657] write avro 100% of SWR2008802765825442165

建议按照时间段进行切分,缩小每次导出数据的范围

我这个是要做每天的定时备份,建议怎么制定策略

意思是分组导出吗,一次1000个子表 一批,能用taosdump这样做备份吗,具体的参数是什么

每天定时备份,用 -S -E 参数指定备份数据的时间段,每天做个增量备份,每月再做个全量备份配合的来

增量备份还是要用taosdump工具,依赖时间段判断吗

目前我的临时过渡方案是直接每天定时拷贝数据库目录(未停服务),是否可行

这个方法不可行,不停止服务,拷贝数据目录不一定完整。

这样好难搞,一个几个G的数据库备份taosdump命令执行了20个小时还没跑完这样的效率做一次全量备份都很艰难

意思是如果采用这种备份目录的方式会导致整个集群无法正常启动吗