devbox
很楠不爱3
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

使用docker部署datax和datax-web_datax docker

作者：很楠不爱3 | 2024-02-25 08:11:44

赞

踩

datax docker

1、准备基础镜像，开通所需端口
firewall-cmd --zone=public --add-port=3306/tcp --permanent
firewall-cmd --zone=public --add-port=9527/tcp --permanent
firewall-cmd --reload
systemctl stop docker
systemctl restart docker
docker pull mysql:8.0.27
docker pull linshellfeng/datax_web:3.0.1

注意：datax_web:3.0.1镜像已经整合了datax3.0和datax-web，整合后的镜像大小约990M

2、安装mysql数据库

安装过程参考：

docker安装mysql8实战_风云琪文的博客-CSDN博客_docker安装mysql8docker安装mysql8实战https://blog.csdn.net/weixin_43991475/article/details/1219525483、启动mysql数据库以后，初始化datax_web_db数据库和配置datax_web账号密码
使用root账号登录mysql数据库以后，使用以下脚本初始化datax_web_db数据库和配置datax_web账号密码，注意：xxxxxx替换为自定义的密码

  1.     create database datax_web_db default character set utf8mb4 collate utf8mb4_general_ci;
  2.     create user 'datax_web'@'%' identified with mysql_native_password by 'xxxxxx';
  3.     grant all privileges on datax_web_db.* to 'datax_web'@'%';
  4.     flush privileges;

4、初始化datax_web_db数据库
#执行以下脚本，完成datax_web_db数据库初始化，满足datax_web服务应用需要
使用datax_web登录，然后切换到datax_web_db，复制datax_web.sql的内执行即可，这里不再详细介绍数据库方面的操作。以下为datax_web.sql的内容

  1. /*
  2.  Navicat Premium Data Transfer
  3.  
  4.  Source Server         : localhost
  5.  Source Server Type    : MySQL
  6.  Source Server Version : 50725
  7.  Source Host           : localhost:3306
  8.  Source Schema         : datax_web
  9.  
  10.  Target Server Type    : MySQL
  11.  Target Server Version : 50725
  12.  File Encoding         : 65001
  13.  
  14.  Date: 15/12/2019 22:27:10
  15. */
  16.  
  17. SET NAMES utf8mb4;
  18. SET FOREIGN_KEY_CHECKS = 0;
  19.  
  20. -- ----------------------------
  21. -- Table structure for job_group
  22. -- ----------------------------
  23. DROP TABLE IF EXISTS `job_group`;
  24. CREATE TABLE `job_group`  (
  25.   `id` int(11) NOT NULL AUTO_INCREMENT,
  26.   `app_name` varchar(64) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '执行器AppName',
  27.   `title` varchar(12) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '执行器名称',
  28.   `order` int(11) NOT NULL DEFAULT 0 COMMENT '排序',
  29.   `address_type` tinyint(4) NOT NULL DEFAULT 0 COMMENT '执行器地址类型：0=自动注册、1=手动录入',
  30.   `address_list` varchar(512) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器地址列表，多地址逗号分隔',
  31.   PRIMARY KEY (`id`) USING BTREE
  32. ) ENGINE = InnoDB AUTO_INCREMENT = 2 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  33.  
  34. -- ----------------------------
  35. -- Records of job_group
  36. -- ----------------------------
  37. INSERT INTO `job_group` VALUES (1, 'datax-executor', 'datax执行器', 1, 0, NULL);
  38.  
  39. -- ----------------------------
  40. -- Table structure for job_info
  41. -- ----------------------------
  42. DROP TABLE IF EXISTS `job_info`;
  43. CREATE TABLE `job_info`  (
  44.   `id` int(11) NOT NULL AUTO_INCREMENT,
  45.   `job_group` int(11) NOT NULL COMMENT '执行器主键ID',
  46.   `job_cron` varchar(128) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '任务执行CRON',
  47.   `job_desc` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL,
  48.   `add_time` datetime(0) NULL DEFAULT NULL,
  49.   `update_time` datetime(0) NULL DEFAULT NULL,
  50.   `author` varchar(64) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '作者',
  51.   `alarm_email` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '报警邮件',
  52.   `executor_route_strategy` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器路由策略',
  53.   `executor_handler` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器任务handler',
  54.   `executor_param` varchar(512) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器任务参数',
  55.   `executor_block_strategy` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '阻塞处理策略',
  56.   `executor_timeout` int(11) NOT NULL DEFAULT 0 COMMENT '任务执行超时时间，单位秒',
  57.   `executor_fail_retry_count` int(11) NOT NULL DEFAULT 0 COMMENT '失败重试次数',
  58.   `glue_type` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT 'GLUE类型',
  59.   `glue_source` mediumtext CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL COMMENT 'GLUE源代码',
  60.   `glue_remark` varchar(128) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT 'GLUE备注',
  61.   `glue_updatetime` datetime(0) NULL DEFAULT NULL COMMENT 'GLUE更新时间',
  62.   `child_jobid` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '子任务ID，多个逗号分隔',
  63.   `trigger_status` tinyint(4) NOT NULL DEFAULT 0 COMMENT '调度状态：0-停止，1-运行',
  64.   `trigger_last_time` bigint(13) NOT NULL DEFAULT 0 COMMENT '上次调度时间',
  65.   `trigger_next_time` bigint(13) NOT NULL DEFAULT 0 COMMENT '下次调度时间',
  66.   `job_json` text CHARACTER SET utf8 COLLATE utf8_general_ci NULL COMMENT 'datax运行脚本',
  67.   PRIMARY KEY (`id`) USING BTREE
  68. ) ENGINE = InnoDB AUTO_INCREMENT = 7 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  69.  
  70.  
  71. -- ----------------------------
  72. -- Table structure for job_jdbc_datasource
  73. -- ----------------------------
  74. DROP TABLE IF EXISTS `job_jdbc_datasource`;
  75. CREATE TABLE `job_jdbc_datasource`  (
  76.   `id` bigint(20) NOT NULL AUTO_INCREMENT COMMENT '自增主键',
  77.   `datasource_name` varchar(200) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '数据源名称',
  78.   `datasource_group` varchar(200) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT 'Default' COMMENT '数据源分组',
  79.   `jdbc_username` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '用户名',
  80.   `jdbc_password` varchar(200) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '密码',
  81.   `jdbc_url` varchar(500) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT 'jdbc url',
  82.   `jdbc_driver_class` varchar(200) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT 'jdbc驱动类',
  83.   `status` tinyint(1) NOT NULL DEFAULT 1 COMMENT '状态：0删除 1启用 2禁用',
  84.   `create_by` varchar(20) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '创建人',
  85.   `create_date` datetime(0) NULL DEFAULT CURRENT_TIMESTAMP(0) COMMENT '创建时间',
  86.   `update_by` varchar(20) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '更新人',
  87.   `update_date` datetime(0) NULL DEFAULT NULL COMMENT '更新时间',
  88.   `comments` varchar(1000) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '备注',
  89.   PRIMARY KEY (`id`) USING BTREE
  90. ) ENGINE = InnoDB AUTO_INCREMENT = 6 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci COMMENT = 'jdbc数据源配置' ROW_FORMAT = Dynamic;
  91.  
  92.  
  93. -- ----------------------------
  94. -- Table structure for job_lock
  95. -- ----------------------------
  96. DROP TABLE IF EXISTS `job_lock`;
  97. CREATE TABLE `job_lock`  (
  98.   `lock_name` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '锁名称',
  99.   PRIMARY KEY (`lock_name`) USING BTREE
  100. ) ENGINE = InnoDB CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  101.  
  102. -- ----------------------------
  103. -- Records of job_lock
  104. -- ----------------------------
  105. INSERT INTO `job_lock` VALUES ('schedule_lock');
  106.  
  107. -- ----------------------------
  108. -- Table structure for job_log
  109. -- ----------------------------
  110. DROP TABLE IF EXISTS `job_log`;
  111. CREATE TABLE `job_log`  (
  112.   `id` bigint(20) NOT NULL AUTO_INCREMENT,
  113.   `job_group` int(11) NOT NULL COMMENT '执行器主键ID',
  114.   `job_id` int(11) NOT NULL COMMENT '任务，主键ID',
  115.   `job_desc` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL,
  116.   `executor_address` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器地址，本次执行的地址',
  117.   `executor_handler` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器任务handler',
  118.   `executor_param` varchar(512) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器任务参数',
  119.   `executor_sharding_param` varchar(20) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器任务分片参数，格式如 1/2',
  120.   `executor_fail_retry_count` int(11) NULL DEFAULT 0 COMMENT '失败重试次数',
  121.   `trigger_time` datetime(0) NULL DEFAULT NULL COMMENT '调度-时间',
  122.   `trigger_code` int(11) NOT NULL COMMENT '调度-结果',
  123.   `trigger_msg` text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL COMMENT '调度-日志',
  124.   `handle_time` datetime(0) NULL DEFAULT NULL COMMENT '执行-时间',
  125.   `handle_code` int(11) NOT NULL COMMENT '执行-状态',
  126.   `handle_msg` text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL COMMENT '执行-日志',
  127.   `alarm_status` tinyint(4) NOT NULL DEFAULT 0 COMMENT '告警状态：0-默认、1-无需告警、2-告警成功、3-告警失败',
  128.   `process_id` varchar(20) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT 'datax进程Id',
  129.   `max_id` bigint(20) NULL DEFAULT NULL COMMENT '增量表max id',
  130.   PRIMARY KEY (`id`) USING BTREE,
  131.   INDEX `I_trigger_time`(`trigger_time`) USING BTREE,
  132.   INDEX `I_handle_code`(`handle_code`) USING BTREE
  133. ) ENGINE = InnoDB AUTO_INCREMENT = 0 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  134.  
  135. -- ----------------------------
  136. -- Table structure for job_log_report
  137. -- ----------------------------
  138. DROP TABLE IF EXISTS `job_log_report`;
  139. CREATE TABLE `job_log_report`  (
  140.   `id` int(11) NOT NULL AUTO_INCREMENT,
  141.   `trigger_day` datetime(0) NULL DEFAULT NULL COMMENT '调度-时间',
  142.   `running_count` int(11) NOT NULL DEFAULT 0 COMMENT '运行中-日志数量',
  143.   `suc_count` int(11) NOT NULL DEFAULT 0 COMMENT '执行成功-日志数量',
  144.   `fail_count` int(11) NOT NULL DEFAULT 0 COMMENT '执行失败-日志数量',
  145.   PRIMARY KEY (`id`) USING BTREE,
  146.   UNIQUE INDEX `i_trigger_day`(`trigger_day`) USING BTREE
  147. ) ENGINE = InnoDB AUTO_INCREMENT = 28 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  148.  
  149. -- ----------------------------
  150. -- Records of job_log_report
  151. -- ----------------------------
  152. INSERT INTO `job_log_report` VALUES (20, '2019-12-07 00:00:00', 0, 0, 0);
  153. INSERT INTO `job_log_report` VALUES (21, '2019-12-10 00:00:00', 77, 52, 23);
  154. INSERT INTO `job_log_report` VALUES (22, '2019-12-11 00:00:00', 9, 2, 11);
  155. INSERT INTO `job_log_report` VALUES (23, '2019-12-13 00:00:00', 9, 48, 74);
  156. INSERT INTO `job_log_report` VALUES (24, '2019-12-12 00:00:00', 10, 8, 30);
  157. INSERT INTO `job_log_report` VALUES (25, '2019-12-14 00:00:00', 78, 45, 66);
  158. INSERT INTO `job_log_report` VALUES (26, '2019-12-15 00:00:00', 24, 76, 9);
  159. INSERT INTO `job_log_report` VALUES (27, '2019-12-16 00:00:00', 23, 85, 10);
  160.  
  161. -- ----------------------------
  162. -- Table structure for job_logglue
  163. -- ----------------------------
  164. DROP TABLE IF EXISTS `job_logglue`;
  165. CREATE TABLE `job_logglue`  (
  166.   `id` int(11) NOT NULL AUTO_INCREMENT,
  167.   `job_id` int(11) NOT NULL COMMENT '任务，主键ID',
  168.   `glue_type` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT 'GLUE类型',
  169.   `glue_source` mediumtext CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL COMMENT 'GLUE源代码',
  170.   `glue_remark` varchar(128) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT 'GLUE备注',
  171.   `add_time` datetime(0) NULL DEFAULT NULL,
  172.   `update_time` datetime(0) NULL DEFAULT NULL,
  173.   PRIMARY KEY (`id`) USING BTREE
  174. ) ENGINE = InnoDB AUTO_INCREMENT = 1 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  175.  
  176. -- ----------------------------
  177. -- Table structure for job_registry
  178. -- ----------------------------
  179. DROP TABLE IF EXISTS `job_registry`;
  180. CREATE TABLE `job_registry`  (
  181.   `id` int(11) NOT NULL AUTO_INCREMENT,
  182.   `registry_group` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL,
  183.   `registry_key` varchar(191) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL,
  184.   `registry_value` varchar(191) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL,
  185.   `update_time` datetime(0) NULL DEFAULT NULL,
  186.   PRIMARY KEY (`id`) USING BTREE,
  187.   INDEX `i_g_k_v`(`registry_group`, `registry_key`, `registry_value`) USING BTREE
  188. ) ENGINE = InnoDB AUTO_INCREMENT = 26 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  189.  
  190.  
  191.  
  192. -- ----------------------------
  193. -- Table structure for job_user
  194. -- ----------------------------
  195. DROP TABLE IF EXISTS `job_user`;
  196. CREATE TABLE `job_user`  (
  197.   `id` int(11) NOT NULL AUTO_INCREMENT,
  198.   `username` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '账号',
  199.   `password` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '密码',
  200.   `role` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '角色：0-普通用户、1-管理员',
  201.   `permission` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '权限：执行器ID列表，多个逗号分割',
  202.   PRIMARY KEY (`id`) USING BTREE,
  203.   UNIQUE INDEX `i_username`(`username`) USING BTREE
  204. ) ENGINE = InnoDB AUTO_INCREMENT = 10 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  205.  
  206. -- ----------------------------
  207. -- Records of job_user
  208. -- ----------------------------
  209. INSERT INTO `job_user` VALUES (1, 'admin', '$2a$10$2KCqRbra0Yn2TwvkZxtfLuWuUP5KyCWsljO/ci5pLD27pqR3TV1vy', 'ROLE_ADMIN', NULL);
  210.  
  211.  
  212.  
  213. /**
  214. v2.1.1脚本更新
  215. */
  216. ALTER TABLE `job_info`
  217. ADD COLUMN `replace_param` VARCHAR(100) NULL DEFAULT NULL COMMENT '动态参数' AFTER `job_json`,
  218. ADD COLUMN `jvm_param` VARCHAR(200) NULL DEFAULT NULL COMMENT 'jvm参数' AFTER `replace_param`,
  219. ADD COLUMN `time_offset` INT(11) NULL DEFAULT '0'COMMENT '时间偏移量'  AFTER `jvm_param`;
  220. /**
  221. 增量改版脚本更新
  222.  */
  223. ALTER TABLE `job_info` DROP COLUMN `time_offset`;
  224. ALTER TABLE `job_info`
  225. ADD COLUMN `inc_start_time` DATETIME NULL DEFAULT NULL COMMENT '增量初始时间' AFTER `jvm_param`;
  226.  
  227. -- ----------------------------
  228. -- Table structure for job_template
  229. -- ----------------------------
  230. DROP TABLE IF EXISTS `job_template`;
  231. CREATE TABLE `job_template`  (
  232.   `id` int(11) NOT NULL AUTO_INCREMENT,
  233.   `job_group` int(11) NOT NULL COMMENT '执行器主键ID',
  234.   `job_cron` varchar(128) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '任务执行CRON',
  235.   `job_desc` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL,
  236.   `add_time` datetime(0) NULL DEFAULT NULL,
  237.   `update_time` datetime(0) NULL DEFAULT NULL,
  238.   `user_id` int(11) NOT NULL COMMENT '修改用户',
  239.   `alarm_email` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '报警邮件',
  240.   `executor_route_strategy` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器路由策略',
  241.   `executor_handler` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器任务handler',
  242.   `executor_param` varchar(512) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '执行器参数',
  243.   `executor_block_strategy` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '阻塞处理策略',
  244.   `executor_timeout` int(11) NOT NULL DEFAULT 0 COMMENT '任务执行超时时间，单位秒',
  245.   `executor_fail_retry_count` int(11) NOT NULL DEFAULT 0 COMMENT '失败重试次数',
  246.   `glue_type` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT 'GLUE类型',
  247.   `glue_source` mediumtext CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL COMMENT 'GLUE源代码',
  248.   `glue_remark` varchar(128) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT 'GLUE备注',
  249.   `glue_updatetime` datetime(0) NULL DEFAULT NULL COMMENT 'GLUE更新时间',
  250.   `child_jobid` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '子任务ID，多个逗号分隔',
  251.   `trigger_last_time` bigint(13) NOT NULL DEFAULT 0 COMMENT '上次调度时间',
  252.   `trigger_next_time` bigint(13) NOT NULL DEFAULT 0 COMMENT '下次调度时间',
  253.   `job_json` text CHARACTER SET utf8 COLLATE utf8_general_ci NULL COMMENT 'datax运行脚本',
  254.   `jvm_param` varchar(200) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT 'jvm参数',
  255.   `project_id` int(11) NULL DEFAULT NULL COMMENT '所属项目Id',
  256.   PRIMARY KEY (`id`) USING BTREE
  257. ) ENGINE = InnoDB AUTO_INCREMENT = 22 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  258.  
  259. /**
  260. 添加数据源字段
  261.  */
  262. ALTER TABLE `job_jdbc_datasource`
  263. ADD COLUMN `datasource` VARCHAR(45) NOT NULL COMMENT '数据源' AFTER `datasource_name`;
  264.  
  265. /**
  266. 添加分区字段
  267.  */
  268. ALTER TABLE `job_info`
  269. ADD COLUMN `partition_info` VARCHAR(100) NULL DEFAULT NULL COMMENT '分区信息' AFTER `inc_start_time`;
  270.  
  271. /**
  272. 2.1.1版本新增----------------------------------------------------------------------------------------------
  273.  */
  275. /**
  276. 最近一次执行状态
  277.  */
  278. ALTER TABLE `job_info`
  279. ADD COLUMN `last_handle_code` INT(11) NULL DEFAULT '0' COMMENT '最近一次执行状态' AFTER `partition_info`;
  280.  
  281. /**
  282. zookeeper地址
  283.  */
  284. ALTER TABLE `job_jdbc_datasource`
  285. ADD COLUMN `zk_adress` VARCHAR(200) NULL DEFAULT NULL AFTER `jdbc_driver_class`;
  286.  
  287. ALTER TABLE `job_info`
  288. CHANGE COLUMN `executor_timeout` `executor_timeout` INT(11) NOT NULL DEFAULT '0' COMMENT '任务执行超时时间，单位分钟' ;
  289.  
  290. /**
  291. 用户名密码改为非必填
  292.  */
  293. ALTER TABLE `job_jdbc_datasource`
  294. CHANGE COLUMN `jdbc_username` `jdbc_username` VARCHAR(100) CHARACTER SET 'utf8mb4' NULL DEFAULT NULL COMMENT '用户名' ,
  295. CHANGE COLUMN `jdbc_password` `jdbc_password` VARCHAR(200) CHARACTER SET 'utf8mb4' NULL DEFAULT NULL COMMENT '密码' ;
  296. /**
  297. 添加mongodb数据库名字段
  298.  */
  299. ALTER TABLE `job_jdbc_datasource`
  300. ADD COLUMN `database_name` VARCHAR(45) NULL DEFAULT NULL COMMENT '数据库名' AFTER `datasource_group`;
  301. /**
  302. 添加执行器资源字段
  303.  */
  304. ALTER TABLE `job_registry`
  305. ADD COLUMN `cpu_usage` DOUBLE NULL AFTER `registry_value`,
  306. ADD COLUMN `memory_usage` DOUBLE NULL AFTER `cpu_usage`,
  307. ADD COLUMN `load_average` DOUBLE NULL AFTER `memory_usage`;
  308.  
  309. -- ----------------------------
  310. -- Table structure for job_permission
  311. -- ----------------------------
  312. DROP TABLE IF EXISTS `job_permission`;
  313. CREATE TABLE `job_permission`  (
  314.   `id` int(11) NOT NULL AUTO_INCREMENT COMMENT '主键',
  315.   `name` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL COMMENT '权限名',
  316.   `description` varchar(11) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT '权限描述',
  317.   `url` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL,
  318.   `pid` int(11) NULL DEFAULT NULL,
  319.   PRIMARY KEY (`id`) USING BTREE
  320. ) ENGINE = InnoDB AUTO_INCREMENT = 3 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  321.  
  322.  
  323.  
  324. ALTER TABLE `job_info`
  325. ADD COLUMN `replace_param_type` varchar(255) NULL COMMENT '增量时间格式' AFTER `last_handle_code`;
  326.  
  327.  
  328. ALTER TABLE `job_info`
  329. ADD COLUMN `project_id` int(11) NULL COMMENT '所属项目id' AFTER `job_desc`;
  330.  
  331. ALTER TABLE `job_info`
  332. ADD COLUMN `reader_table` VARCHAR(255) NULL COMMENT 'reader表名称' AFTER `replace_param_type`,
  333. ADD COLUMN `primary_key` VARCHAR(50) NULL COMMENT '增量表主键' AFTER `reader_table`,
  334. ADD COLUMN `inc_start_id` VARCHAR(20) NULL COMMENT '增量初始id' AFTER `primary_key`,
  335. ADD COLUMN `increment_type` TINYINT(4) NULL COMMENT '增量类型' AFTER `inc_start_id`,
  336. ADD COLUMN `datasource_id` BIGINT(11) NULL COMMENT '数据源id' AFTER `increment_type`;
  337.  
  338. CREATE TABLE `job_project`  (
  339.   `id` int(11) NOT NULL AUTO_INCREMENT COMMENT 'key',
  340.   `name` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL COMMENT 'project name',
  341.   `description` varchar(200) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL DEFAULT NULL,
  342.   `user_id` int(11) NULL DEFAULT NULL COMMENT 'creator id',
  343.   `flag` tinyint(4) NULL DEFAULT 1 COMMENT '0 not available, 1 available',
  344.   `create_time` datetime(0) NULL DEFAULT CURRENT_TIMESTAMP(0) COMMENT 'create time',
  345.   `update_time` datetime(0) NULL DEFAULT CURRENT_TIMESTAMP(0) COMMENT 'update time',
  346.   PRIMARY KEY (`id`) USING BTREE
  347. ) ENGINE = InnoDB AUTO_INCREMENT = 1 CHARACTER SET = utf8mb4 COLLATE = utf8mb4_general_ci ROW_FORMAT = Dynamic;
  348.  
  349.  
  350. ALTER TABLE `job_info`
  351. CHANGE COLUMN `author` `user_id` INT(11) NOT NULL COMMENT '修改用户' ;
  352.  
  353. ALTER TABLE `job_info`
  354. CHANGE COLUMN `increment_type` `increment_type` TINYINT(4) NULL DEFAULT 0 COMMENT '增量类型' ;

5、在宿主机创建/home/datax/datax-admin/conf目录，并将bootstrap.properties拷贝到/home/datax/datax-admin/conf目录下，该文件用来配置datax-web连接数据库的信息，ip地址和xxxxxx需要按实际情况填写。xxxxxx的值要与第3步骤中设置的密码保持一致。

bootstrap.properties内容参考如下：

  1. #Database
  2. DB_HOST=192.168.1.xx
  3. DB_PORT=3306
  4. DB_USERNAME=datax_web
  5. DB_PASSWORD=xxxxxx
  6. DB_DATABASE=datax_web_db

6、启动容器
docker run -d --name datax_web -p 9527:9527 -v /home/datax/datax-admin/conf/bootstrap.properties:/home/datax/datax-web-2.1.2/modules/datax-admin/conf/bootstrap.properties linshellfeng/datax_web:3.0.1

7、进入容器内部（非必要步骤，用来测试datax_web容器是否正常启动）
docker exec -it datax_web /bin/bash

8、测试是否datax-web服务是否正常启动
在容器内：curl http://127.0.0.1:9527/index.html
使用浏览器访问宿主机服务：http://宿主机ip:9527/index.html

使用admin/123456登录后及时修改密码

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/很楠不爱3/article/detail/139765
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号