当前位置:   article > 正文

apache-dolphinscheduler-3.2.0伪集群启动,采用mysql数据库_dolphinscheduler3.2.0伪集群部署

dolphinscheduler3.2.0伪集群部署

一、apache-dolphinscheduler介绍

Apache DolphinScheduler 是一个分布式的开源调度系统,它提供了一种可视化、可扩展、高可用的任务调度和数据处理方案。

二、apache-dolphinscheduler下载

2.1、下载apache-dolphinscheduler

https://dolphinscheduler.apache.org/en-us/download/3.2.0

apache-dolphinscheduler-3.2.0

三、apache-dolphinscheduler配置

3.1、配置host,配置免密

3.2、进入/usr/local/bigdata/apache-dolphinschedulerW/bin/env

3.3、修改dolphinscheduler_env.sh

  1. export JAVA_HOME=${JAVA_HOME:-/usr/local/jdk1.8.0_391}
  2. export REGISTRY_ZOOKEEPER_CONNECT_STRING=${REGISTRY_ZOOKEEPER_CONNECT_STRING:-node4:2181}
  3. export DATABASE=${DATABASE:-mysql}
  4. export SPRING_PROFILES_ACTIVE=${DATABASE}
  5. export SPRING_DATASOURCE_URL="jdbc:mysql://192.168.1.103:3306/dolphinscheduler?useUnicode=true&characterEncoding=UTF-8&useSSL=false&allowPublicKeyRetrieval=true"
  6. export SPRING_DATASOURCE_USERNAME=root
  7. export SPRING_DATASOURCE_PASSWORD=123456

3.4、修改install_env.sh

  1. #
  2. # Licensed to the Apache Software Foundation (ASF) under one or more
  3. # contributor license agreements. See the NOTICE file distributed with
  4. # this work for additional information regarding copyright ownership.
  5. # The ASF licenses this file to You under the Apache License, Version 2.0
  6. # (the "License"); you may not use this file except in compliance with
  7. # the License. You may obtain a copy of the License at
  8. #
  9. # http://www.apache.org/licenses/LICENSE-2.0
  10. #
  11. # Unless required by applicable law or agreed to in writing, software
  12. # distributed under the License is distributed on an "AS IS" BASIS,
  13. # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  14. # See the License for the specific language governing permissions and
  15. # limitations under the License.
  16. #
  17. # ---------------------------------------------------------
  18. # INSTALL MACHINE
  19. # ---------------------------------------------------------
  20. # A comma separated list of machine hostname or IP would be installed DolphinScheduler,
  21. # including master, worker, api, alert. If you want to deploy in pseudo-distributed
  22. # mode, just write a pseudo-distributed hostname
  23. # Example for hostnames: ips="ds1,ds2,ds3,ds4,ds5", Example for IPs: ips="192.168.8.1,192.168.8.2,192.168.8.3,192.168.8.4,192.168.8.5"
  24. ips=${ips:-"node4"}
  25. # Port of SSH protocol, default value is 22. For now we only support same port in all `ips` machine
  26. # modify it if you use different ssh port
  27. sshPort=${sshPort:-"22"}
  28. # A comma separated list of machine hostname or IP would be installed Master server, it
  29. # must be a subset of configuration `ips`.
  30. # Example for hostnames: masters="ds1,ds2", Example for IPs: masters="192.168.8.1,192.168.8.2"
  31. masters=${masters:-"node4"}
  32. # A comma separated list of machine <hostname>:<workerGroup> or <IP>:<workerGroup>.All hostname or IP must be a
  33. # subset of configuration `ips`, And workerGroup have default value as `default`, but we recommend you declare behind the hosts
  34. # Example for hostnames: workers="ds1:default,ds2:default,ds3:default", Example for IPs: workers="192.168.8.1:default,192.168.8.2:default,192.168.8.3:default"
  35. workers=${workers:-"node4:default"}
  36. # A comma separated list of machine hostname or IP would be installed Alert server, it
  37. # must be a subset of configuration `ips`.
  38. # Example for hostname: alertServer="ds3", Example for IP: alertServer="192.168.8.3"
  39. alertServer=${alertServer:-"node4"}
  40. # A comma separated list of machine hostname or IP would be installed API server, it
  41. # must be a subset of configuration `ips`.
  42. # Example for hostname: apiServers="ds1", Example for IP: apiServers="192.168.8.1"
  43. apiServers=${apiServers:-"node4"}
  44. # The directory to install DolphinScheduler for all machine we config above. It will automatically be created by `install.sh` script if not exists.
  45. # Do not set this configuration same as the current path (pwd). Do not add quotes to it if you using related path.
  46. installPath=${installPath:-"/tmp/dolphinscheduler"}
  47. # The user to deploy DolphinScheduler for all machine we config above. For now user must create by yourself before running `install.sh`
  48. # script. The user needs to have sudo privileges and permissions to operate hdfs. If hdfs is enabled than the root directory needs
  49. # to be created by this user
  50. deployUser=${deployUser:-"root"}
  51. # The root of zookeeper, for now DolphinScheduler default registry server is zookeeper.
  52. # It will delete ${zkRoot} in the zookeeper when you run install.sh, so please keep it same as registry.zookeeper.namespace in yml files.
  53. # Similarly, if you want to modify the value, please modify registry.zookeeper.namespace in yml files as well.
  54. zkRoot=${zkRoot:-"/dolphinscheduler"}

 3.5、执行install.sh

./install.sh 

3.6、启动zookeeper

3.7、启动结果

  1. node4:default
  2. node4 master server is starting
  3. Begin start master-server......
  4. starting master-server, logging to /tmp/dolphinscheduler/master-server/logs
  5. Overwrite master-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
  6. End start master-server.
  7. node4 worker server is starting
  8. Begin start worker-server......
  9. starting worker-server, logging to /tmp/dolphinscheduler/worker-server/logs
  10. Overwrite worker-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
  11. End start worker-server.
  12. Begin start alert-server......
  13. starting alert-server, logging to /tmp/dolphinscheduler/alert-server/logs
  14. Overwrite alert-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
  15. End start alert-server.
  16. node4 api server is starting
  17. Begin start api-server......
  18. starting api-server, logging to /tmp/dolphinscheduler/api-server/logs
  19. Overwrite api-server/conf/dolphinscheduler_env.sh using bin/env/dolphinscheduler_env.sh.
  20. End start api-server.
  21. query server status
  22. ====================== dolphinscheduler server config =============================
  23. 1.dolphinscheduler server node config hosts:[ node4 ]
  24. 2.master server node config hosts:[ node4 ]
  25. 3.worker server node config hosts:[ node4:default ]
  26. 4.alert server node config hosts:[ node4 ]
  27. 5.api server node config hosts:[ node4 ]
  28. ====================== dolphinscheduler server status =============================
  29. node server state
  30. node4 Begin status master-server......
  31. master-server [ RUNNING ]
  32. End status master-server.
  33. node4 Begin status worker-server......
  34. worker-server [ RUNNING ]
  35. End status worker-server.
  36. node4 Begin status alert-server......
  37. alert-server [ RUNNING ]
  38. End status alert-server.
  39. node4 Begin status api-server......
  40. api-server [ RUNNING ]
  41. End status api-server.
  42. [root@node4 bin]# jps
  43. 61345 WorkerServer
  44. 61395 AlertServer
  45. 61305 MasterServer
  46. 61452 ApiApplicationServer
  47. 61692 Jps
  48. 55391 QuorumPeerMain

3.8、启动伪集群

 ./start-all.sh 

3.9、查看启动进程

  1. [root@node4 bin]# jps
  2. 61345 WorkerServer
  3. 64500 MasterServer
  4. 61452 ApiApplicationServer
  5. 64557 AlertServer
  6. 66396 Jps
  7. 55391 QuorumPeerMain

3.10、关闭伪集群

./stop-all.sh 
  1. [root@node4 bin]# ./stop-all.sh
  2. node4:default
  3. node4 master server is stopping
  4. Begin stop master-server......
  5. stopping master-server
  6. End stop master-server.
  7. node4 worker server is stopping
  8. Begin stop worker-server......
  9. stopping worker-server
  10. End stop worker-server.
  11. Begin stop alert-server......
  12. stopping alert-server
  13. End stop alert-server.
  14. node4 api server is stopping
  15. Begin stop api-server......
  16. stopping api-server
  17. End stop api-server.

四、apache-dolphinscheduler启动

http://192.168.42.142:12345/dolphinscheduler/ui

 

声明:本文内容由网友自发贡献,不代表【wpsshop博客】立场,版权归原作者所有,本站不承担相应法律责任。如您发现有侵权的内容,请联系我们。转载请注明出处:https://www.wpsshop.cn/w/你好赵伟/article/detail/405731
推荐阅读
相关标签
  

闽ICP备14008679号