当前位置:   article > 正文

flink 压测一些参数调优_cluster.evenly-spread-out-slots

cluster.evenly-spread-out-slots
  1. ####### jobmanager config options #######
  2. jobmanager.heap.size: 20000m
  3. cluster.evenly-spread-out-slots: true
  4. ####### timeout config options #######
  5. akka.ask.timeout: 300 s
  6. akka.lookup.timeout: 300 s
  7. web.timeout: 300000
  8. heartbeat.timeout: 600000
  9. resourcemanager.taskmanager-timeout: 900000
  10. jobstore.expiration-time: 36000
  11. ####### restart config options ######
  12. jobmanager.execution.failover-strategy: region
  13. restart-strategy.fixed-delay.delay: 10 s
  14. restart-strategy: fixed-delay
  15. restart-strategy.fixed-delay.attempts: 50
  16. ####### taskmanager config options #######
  17. # totally 10 taskmanagers in one machine.
  18. taskmanager.memory.process.size: 22000m
  19. # configure heap-cutoff-ratio to leave memory to system page cache
  20. containerized.heap-cutoff-ratio: 0.3
  21. taskmanager.memory.managed.size: 8000m
  22. taskmanager.numberOfTaskSlots: 10
  23. # not limit by yarn vcores
  24. yarn.containers.vcores: 1
  25. taskmanager.network.memory.fraction: 0.99
  26. taskmanager.network.memory.min: 64mb
  27. taskmanager.network.memory.max: 2200mb
  28. taskmanager.network.memory.exclusive-buffers-request-timeout-ms: 1000000
  29. taskmanager.network.blocking-shuffle.type: mmap
  30. taskmanager.network.blocking-shuffle.compression.enabled: true

参考地址:

https://github.com/ververica/flink-sql-benchmark/blob/master/flink-tpcds/flink-conf.yaml

flinksql客户端一些配置信息文档:

Configuration | Apache Flink

group by 的状态优化

table.exec.state.ttl=180 s

声明:本文内容由网友自发贡献,不代表【wpsshop博客】立场,版权归原作者所有,本站不承担相应法律责任。如您发现有侵权的内容,请联系我们。转载请注明出处:https://www.wpsshop.cn/w/小惠珠哦/article/detail/941699
推荐阅读
相关标签
  

闽ICP备14008679号