当前位置:   article > 正文

Flink CDC 3.1.0 pipeline 多表合一、分库分表 Mysql写入Doris yaml

Flink CDC 3.1.0 pipeline 多表合一、分库分表 Mysql写入Doris yaml

 多表合一 yaml:

  1. source:
  2. type: mysql
  3. hostname: 172.xxx.xxx.xxx
  4. port: 3306
  5. username: root
  6. password: xxx
  7. tables: sync_db.\.*
  8. server-id: 5400-5404
  9. server-time-zone: Asia/Shanghai
  10. sink:
  11. type: doris
  12. fenodes: 172.xxx.xxx.xxx:8030
  13. username: root
  14. password: xxx
  15. table.create.properties.light_schema_change: true
  16. route:
  17. - source-table: sync_db.\.*
  18. sink-table: sync_db.ods_sync_db
  19. pipeline:
  20. name: Sync MySQL Database to Doris
  21. parallelism: 2

分库分表 yaml:

  1. source:
  2. type: mysql
  3. hostname: 172.xxx.xxx.xxx
  4. port: 3306
  5. username: root
  6. password: xxx
  7. tables: sync_db.\.*
  8. server-id: 5400-5404
  9. server-time-zone: Asia/Shanghai
  10. sink:
  11. type: doris
  12. fenodes: 172.xxx.xxx.xxx:8030
  13. username: root
  14. password: xxx
  15. table.create.properties.light_schema_change: true
  16. route:
  17. - source-table: sync_db.teacher
  18. sink-table: syc.ods_teacher
  19. - source-table: sync_db.student
  20. sink-table: syc.ods_student
  21. pipeline:
  22. name: Sync MySQL Database to Doris
  23. parallelism: 2

声明:本文内容由网友自发贡献,不代表【wpsshop博客】立场,版权归原作者所有,本站不承担相应法律责任。如您发现有侵权的内容,请联系我们。转载请注明出处:https://www.wpsshop.cn/w/码创造者/article/detail/782721
推荐阅读
相关标签
  

闽ICP备14008679号