当前位置:   article > 正文

Anaconda虚拟环境中安装airflow_cffi-1.15.0-cp37-cp37m-manylinux_2_12_x86_64.manyl

cffi-1.15.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl is not

环境:
虚拟机IP:192.168.43.61
宿主机IP:192.168.43.192
操作系统:centos-release-7-2.1511.el7.centos.2.10.x86_64
虚拟机:VirtualBox 6.1.24
Anaconda版本:Anaconda3-5.2.0-Linux-x86_64

1.设置Pip镜像源
   

 新建/home/.pip/pip.conf
 内容:    

  1. [global]
  2. index-url=https://pypi.tuna.tsinghua.edu.cn/simple
  3. [install]
  4. trusted-host=https://pypi.tuna.tsinghua.edu.cn

2.进入到python36环境

这里的python36环境是在Anaconda------环境管理这个章节里创建的,是一个包含python36的虚拟环境

  1. [root@bogon pip]# pwd
  2. /home/conda_udf_data/pip
  3. [root@bogon pip]# conda activate python36
  4. (python36) [root@bogon pip]#

3.安装apacha-airflow

  1. (python36) [root@bogon pip]# pip install apache-airflow
  2. Collecting apache-airflow
  3. Downloading apache_airflow-2.2.0-py3-none-any.whl (5.3 MB)
  4. |████████████████████████████████| 5.3 MB 2.0 MB/s
  5. Collecting flask-caching<2.0.0,>=1.5.0
  6. Downloading Flask_Caching-1.10.1-py3-none-any.whl (34 kB)
  7. Collecting python3-openid~=3.2
  8. Downloading python3_openid-3.2.0-py3-none-any.whl (133 kB)
  9. |████████████████████████████████| 133 kB 4.5 MB/s
  10. Collecting python-nvd3~=0.15.0
  11. Downloading python-nvd3-0.15.0.tar.gz (31 kB)
  12. Collecting psutil<6.0.0,>=4.2.0
  13. Downloading psutil-5.8.0-cp36-cp36m-manylinux2010_x86_64.whl (291 kB)
  14. |████████████████████████████████| 291 kB 2.6 MB/s
  15. Collecting python-slugify<5.0,>=3.0.0
  16. Downloading python-slugify-4.0.1.tar.gz (11 kB)
  17. Collecting cattrs<1.1.0,>=1.0
  18. Downloading cattrs-1.0.0-py2.py3-none-any.whl (14 kB)
  19. Collecting jsonschema~=3.0
  20. Downloading jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
  21. |████████████████████████████████| 56 kB 2.6 MB/s
  22. Collecting packaging~=21.0
  23. Downloading packaging-21.0-py3-none-any.whl (40 kB)
  24. |████████████████████████████████| 40 kB 1.8 MB/s
  25. Collecting apache-airflow-providers-http
  26. Downloading apache_airflow_providers_http-2.0.1-py3-none-any.whl (21 kB)
  27. Collecting typing-extensions>=3.7.4
  28. Downloading typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
  29. Collecting marshmallow-oneofschema>=2.0.1
  30. Downloading marshmallow_oneofschema-3.0.1-py2.py3-none-any.whl (5.8 kB)
  31. Collecting termcolor>=1.1.0
  32. Downloading termcolor-1.1.0.tar.gz (3.9 kB)
  33. Collecting importlib-metadata>=1.7
  34. Downloading importlib_metadata-4.8.1-py3-none-any.whl (17 kB)
  35. Collecting dill<0.4,>=0.2.2
  36. Downloading dill-0.3.4-py2.py3-none-any.whl (86 kB)
  37. |████████████████████████████████| 86 kB 2.3 MB/s
  38. Collecting pep562~=1.0
  39. Downloading pep562-1.1-py2.py3-none-any.whl (7.3 kB)
  40. Collecting pyjwt<2
  41. Downloading PyJWT-1.7.1-py2.py3-none-any.whl (18 kB)
  42. Collecting werkzeug>=1.0.1,~=1.0
  43. Downloading Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
  44. |████████████████████████████████| 298 kB 4.3 MB/s
  45. Collecting markupsafe<2.0,>=1.1.1
  46. Downloading MarkupSafe-1.1.1-cp36-cp36m-manylinux2010_x86_64.whl (32 kB)
  47. Collecting argcomplete~=1.10
  48. Downloading argcomplete-1.12.3-py2.py3-none-any.whl (38 kB)
  49. Collecting alembic<2.0,>=1.2
  50. Downloading alembic-1.7.4-py3-none-any.whl (209 kB)
  51. |████████████████████████████████| 209 kB 2.3 MB/s
  52. Collecting python-daemon>=2.2.4
  53. Downloading python_daemon-2.3.0-py2.py3-none-any.whl (35 kB)
  54. Collecting sqlalchemy-jsonfield~=1.0
  55. Downloading SQLAlchemy_JSONField-1.0.0-py3-none-any.whl (10 kB)
  56. Collecting iso8601>=0.1.12
  57. Downloading iso8601-0.1.16-py2.py3-none-any.whl (10 kB)
  58. Collecting croniter<1.1,>=0.3.17
  59. Downloading croniter-1.0.15-py2.py3-none-any.whl (16 kB)
  60. Collecting tabulate<0.9,>=0.7.5
  61. Downloading tabulate-0.8.9-py3-none-any.whl (25 kB)
  62. Collecting markdown<4.0,>=2.5.2
  63. Downloading Markdown-3.3.4-py3-none-any.whl (97 kB)
  64. |████████████████████████████████| 97 kB 2.0 MB/s
  65. Collecting flask<2.0,>=1.1.0
  66. Downloading Flask-1.1.4-py2.py3-none-any.whl (94 kB)
  67. |████████████████████████████████| 94 kB 902 kB/s
  68. Collecting dataclasses
  69. Downloading dataclasses-0.8-py3-none-any.whl (19 kB)
  70. Collecting lazy-object-proxy
  71. Downloading lazy_object_proxy-1.6.0-cp36-cp36m-manylinux1_x86_64.whl (55 kB)
  72. |████████████████████████████████| 55 kB 2.3 MB/s
  73. Collecting apache-airflow-providers-ftp
  74. Downloading apache_airflow_providers_ftp-2.0.1-py3-none-any.whl (15 kB)
  75. Collecting pendulum~=2.0
  76. Downloading pendulum-2.1.2-cp36-cp36m-manylinux1_x86_64.whl (154 kB)
  77. |████████████████████████████████| 154 kB 3.2 MB/s
  78. Collecting sqlalchemy>=1.3.18
  79. Downloading SQLAlchemy-1.4.25-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
  80. |████████████████████████████████| 1.6 MB 3.2 MB/s
  81. Collecting flask-appbuilder<4.0.0,>=3.3.2
  82. Downloading Flask_AppBuilder-3.3.4-py3-none-any.whl (1.9 MB)
  83. |████████████████████████████████| 1.9 MB 2.8 MB/s
  84. Collecting apache-airflow-providers-imap
  85. Downloading apache_airflow_providers_imap-2.0.1-py3-none-any.whl (16 kB)
  86. Collecting setproctitle<2,>=1.1.8
  87. Downloading setproctitle-1.2.2-cp36-cp36m-manylinux1_x86_64.whl (35 kB)
  88. Collecting swagger-ui-bundle>=0.0.2
  89. Downloading swagger_ui_bundle-0.0.9-py3-none-any.whl (6.2 MB)
  90. |████████████████████████████████| 6.2 MB 1.7 MB/s
  91. Collecting flask-login<0.5,>=0.3
  92. Downloading Flask-Login-0.4.1.tar.gz (14 kB)
  93. Collecting gunicorn>=20.1.0
  94. Downloading gunicorn-20.1.0-py3-none-any.whl (79 kB)
  95. |████████████████████████████████| 79 kB 1.9 MB/s
  96. Collecting python-dateutil<3,>=2.3
  97. Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
  98. |████████████████████████████████| 247 kB 1.8 MB/s
  99. Collecting rich>=9.2.0
  100. Downloading rich-10.12.0-py3-none-any.whl (212 kB)
  101. |████████████████████████████████| 212 kB 2.1 MB/s
  102. Collecting flask-wtf<0.15,>=0.14.3
  103. Downloading Flask_WTF-0.14.3-py2.py3-none-any.whl (13 kB)
  104. Collecting graphviz>=0.12
  105. Downloading graphviz-0.17-py3-none-any.whl (18 kB)
  106. Collecting unicodecsv>=0.14.1
  107. Downloading unicodecsv-0.14.1.tar.gz (10 kB)
  108. Collecting itsdangerous<2.0,>=1.1.0
  109. Downloading itsdangerous-1.1.0-py2.py3-none-any.whl (16 kB)
  110. Collecting apache-airflow-providers-sqlite
  111. Downloading apache_airflow_providers_sqlite-2.0.1-py3-none-any.whl (15 kB)
  112. Collecting openapi-spec-validator>=0.2.4
  113. Downloading openapi_spec_validator-0.3.1-py3-none-any.whl (32 kB)
  114. Collecting cryptography>=0.9.3
  115. Downloading cryptography-35.0.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.7 MB)
  116. |████████████████████████████████| 3.7 MB 1.2 MB/s
  117. Collecting colorlog<6.0,>=4.0.2
  118. Downloading colorlog-5.0.1-py2.py3-none-any.whl (10 kB)
  119. Collecting blinker
  120. Downloading blinker-1.4.tar.gz (111 kB)
  121. |████████████████████████████████| 111 kB 2.1 MB/s
  122. Collecting docutils<0.17
  123. Downloading docutils-0.16-py2.py3-none-any.whl (548 kB)
  124. |████████████████████████████████| 548 kB 285 kB/s
  125. Collecting clickclick>=1.2
  126. Downloading clickclick-20.10.2-py2.py3-none-any.whl (7.4 kB)
  127. Collecting jinja2<4,>=2.10.1
  128. Downloading Jinja2-3.0.2-py3-none-any.whl (133 kB)
  129. |████████████████████████████████| 133 kB 1.4 MB/s
  130. Collecting pygments<3.0,>=2.0.1
  131. Downloading Pygments-2.10.0-py3-none-any.whl (1.0 MB)
  132. |████████████████████████████████| 1.0 MB 1.4 MB/s
  133. Collecting httpx
  134. Downloading httpx-0.20.0-py3-none-any.whl (82 kB)
  135. |████████████████████████████████| 82 kB 759 kB/s
  136. Collecting attrs<21.0,>=20.0
  137. Downloading attrs-20.3.0-py2.py3-none-any.whl (49 kB)
  138. |████████████████████████████████| 49 kB 1.2 MB/s
  139. Collecting tenacity>=6.2.0
  140. Downloading tenacity-8.0.1-py3-none-any.whl (24 kB)
  141. Collecting inflection>=0.3.1
  142. Downloading inflection-0.5.1-py2.py3-none-any.whl (9.5 kB)
  143. Collecting pyyaml>=5.1
  144. Downloading PyYAML-6.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (603 kB)
  145. |████████████████████████████████| 603 kB 1.7 MB/s
  146. Collecting cached-property~=1.5
  147. Downloading cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
  148. Collecting lockfile>=0.12.2
  149. Downloading lockfile-0.12.2-py2.py3-none-any.whl (13 kB)
  150. Collecting importlib-resources~=5.2
  151. Downloading importlib_resources-5.2.2-py3-none-any.whl (27 kB)
  152. Collecting Mako
  153. Downloading Mako-1.1.5-py2.py3-none-any.whl (75 kB)
  154. |████████████████████████████████| 75 kB 1.5 MB/s
  155. Collecting click>=4.0
  156. Downloading click-8.0.3-py3-none-any.whl (97 kB)
  157. |████████████████████████████████| 97 kB 1.7 MB/s
  158. Collecting cffi>=1.12
  159. Downloading cffi-1.15.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (405 kB)
  160. |████████████████████████████████| 405 kB 1.5 MB/s
  161. Collecting pycparser
  162. Downloading pycparser-2.20-py2.py3-none-any.whl (112 kB)
  163. |████████████████████████████████| 112 kB 1.9 MB/s
  164. Collecting jinja2<4,>=2.10.1
  165. Downloading Jinja2-2.11.3-py2.py3-none-any.whl (125 kB)
  166. |████████████████████████████████| 125 kB 1.6 MB/s
  167. Collecting click>=4.0
  168. Downloading click-7.1.2-py2.py3-none-any.whl (82 kB)
  169. |████████████████████████████████| 82 kB 647 kB/s
  170. Collecting sqlalchemy>=1.3.18
  171. Downloading SQLAlchemy-1.3.24-cp36-cp36m-manylinux2010_x86_64.whl (1.3 MB)
  172. |████████████████████████████████| 1.3 MB 1.5 MB/s
  173. Collecting Flask-OpenID<2,>=1.2.5
  174. Downloading Flask_OpenID-1.3.0-py3-none-any.whl (9.3 kB)
  175. Collecting marshmallow-sqlalchemy<0.27.0,>=0.22.0
  176. Downloading marshmallow_sqlalchemy-0.26.1-py2.py3-none-any.whl (15 kB)
  177. Collecting prison<1.0.0,>=0.2.1
  178. Downloading prison-0.2.1-py2.py3-none-any.whl (5.8 kB)
  179. Collecting marshmallow<4,>=3
  180. Downloading marshmallow-3.13.0-py2.py3-none-any.whl (47 kB)
  181. |████████████████████████████████| 47 kB 1.7 MB/s
  182. Collecting Flask-Babel<3,>=1
  183. Downloading Flask_Babel-2.0.0-py3-none-any.whl (9.3 kB)
  184. Collecting Flask-SQLAlchemy<3,>=2.4
  185. Downloading Flask_SQLAlchemy-2.5.1-py2.py3-none-any.whl (17 kB)
  186. Collecting email-validator<2,>=1.0.5
  187. Downloading email_validator-1.1.3-py2.py3-none-any.whl (18 kB)
  188. Collecting Flask-JWT-Extended<4,>=3.18
  189. Downloading Flask-JWT-Extended-3.25.1.tar.gz (32 kB)
  190. Collecting marshmallow-enum<2,>=1.5.1
  191. Downloading marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
  192. Collecting sqlalchemy-utils<1,>=0.32.21
  193. Downloading SQLAlchemy_Utils-0.37.8-py3-none-any.whl (100 kB)
  194. |████████████████████████████████| 100 kB 1.6 MB/s
  195. Collecting apispec[yaml]<4,>=3.3
  196. Downloading apispec-3.3.2-py2.py3-none-any.whl (27 kB)
  197. Collecting colorama<1,>=0.3.9
  198. Downloading colorama-0.4.4-py2.py3-none-any.whl (16 kB)
  199. Collecting idna>=2.0.0
  200. Downloading idna-3.3-py3-none-any.whl (61 kB)
  201. |████████████████████████████████| 61 kB 1.3 MB/s
  202. Collecting dnspython>=1.15.0
  203. Downloading dnspython-2.1.0-py3-none-any.whl (241 kB)
  204. |████████████████████████████████| 241 kB 2.1 MB/s
  205. Collecting pytz
  206. Downloading pytz-2021.3-py2.py3-none-any.whl (503 kB)
  207. |████████████████████████████████| 503 kB 1.8 MB/s
  208. Collecting Babel>=2.3
  209. Downloading Babel-2.9.1-py2.py3-none-any.whl (8.8 MB)
  210. |████████████████████████████████| 8.8 MB 1.3 MB/s
  211. Collecting six
  212. Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
  213. Collecting WTForms
  214. Downloading WTForms-2.3.3-py2.py3-none-any.whl (169 kB)
  215. |████████████████████████████████| 169 kB 956 kB/s
  216. Requirement already satisfied: setuptools>=3.0 in /usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages (from gunicorn>=20.1.0->apache-airflow) (58.0.4)
  217. Collecting zipp>=0.5
  218. Downloading zipp-3.6.0-py3-none-any.whl (5.3 kB)
  219. Collecting pyrsistent>=0.14.0
  220. Downloading pyrsistent-0.18.0-cp36-cp36m-manylinux1_x86_64.whl (117 kB)
  221. |████████████████████████████████| 117 kB 1.2 MB/s
  222. Collecting openapi-schema-validator
  223. Downloading openapi_schema_validator-0.1.5-py3-none-any.whl (7.9 kB)
  224. Collecting pyparsing>=2.0.2
  225. Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
  226. |████████████████████████████████| 67 kB 1.6 MB/s
  227. Collecting pytzdata>=2020.1
  228. Downloading pytzdata-2020.1-py2.py3-none-any.whl (489 kB)
  229. |████████████████████████████████| 489 kB 1.0 MB/s
  230. Collecting text-unidecode>=1.3
  231. Downloading text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
  232. |████████████████████████████████| 78 kB 1.2 MB/s
  233. Collecting defusedxml
  234. Downloading defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
  235. Collecting commonmark<0.10.0,>=0.9.0
  236. Downloading commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
  237. |████████████████████████████████| 51 kB 1.3 MB/s
  238. Collecting typing>=3.6
  239. Downloading typing-3.7.4.3.tar.gz (78 kB)
  240. |████████████████████████████████| 78 kB 1.6 MB/s
  241. Collecting requests>=2.26.0
  242. Downloading requests-2.26.0-py2.py3-none-any.whl (62 kB)
  243. |████████████████████████████████| 62 kB 760 kB/s
  244. Collecting charset-normalizer~=2.0.0
  245. Downloading charset_normalizer-2.0.7-py3-none-any.whl (38 kB)
  246. Requirement already satisfied: certifi>=2017.4.17 in /usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages (from requests>=2.26.0->apache-airflow-providers-http->apache-airflow) (2021.5.30)
  247. Collecting urllib3<1.27,>=1.21.1
  248. Downloading urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
  249. |████████████████████████████████| 138 kB 1.7 MB/s
  250. Collecting sniffio
  251. Downloading sniffio-1.2.0-py3-none-any.whl (10 kB)
  252. Collecting async-generator
  253. Downloading async_generator-1.10-py3-none-any.whl (18 kB)
  254. Collecting httpcore<0.14.0,>=0.13.3
  255. Downloading httpcore-0.13.7-py3-none-any.whl (58 kB)
  256. |████████████████████████████████| 58 kB 1.6 MB/s
  257. Collecting rfc3986[idna2008]<2,>=1.3
  258. Downloading rfc3986-1.5.0-py2.py3-none-any.whl (31 kB)
  259. Collecting h11<0.13,>=0.11
  260. Downloading h11-0.12.0-py3-none-any.whl (54 kB)
  261. |████████████████████████████████| 54 kB 1.4 MB/s
  262. Collecting anyio==3.*
  263. Downloading anyio-3.3.3-py3-none-any.whl (78 kB)
  264. |████████████████████████████████| 78 kB 1.6 MB/s
  265. Collecting contextvars>=2.1
  266. Downloading contextvars-2.4.tar.gz (9.6 kB)
  267. Collecting immutables>=0.9
  268. Downloading immutables-0.16-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (103 kB)
  269. |████████████████████████████████| 103 kB 2.2 MB/s
  270. Collecting isodate
  271. Downloading isodate-0.6.0-py2.py3-none-any.whl (45 kB)
  272. |████████████████████████████████| 45 kB 1.3 MB/s
  273. Building wheels for collected packages: Flask-JWT-Extended, flask-login, python-nvd3, python-slugify, termcolor, typing, unicodecsv, blinker, contextvars
  274. Building wheel for Flask-JWT-Extended (setup.py) ... done
  275. Created wheel for Flask-JWT-Extended: filename=Flask_JWT_Extended-3.25.1-py2.py3-none-any.whl size=21614 sha256=77a445de215a0059f513513776082ef1e07da1b3432ef19e6158dae331aa6df0
  276. Stored in directory: /root/.cache/pip/wheels/43/7b/a9/f519fbffeeab0fd1b531b966f324e949d9dcf79ce3b3042950
  277. Building wheel for flask-login (setup.py) ... done
  278. Created wheel for flask-login: filename=Flask_Login-0.4.1-py2.py3-none-any.whl size=15949 sha256=fb9fcd7e54f19d5be45c4599ccef1d371ec04dfe4816680c96ed823b9e144371
  279. Stored in directory: /root/.cache/pip/wheels/db/40/67/41f90cc1fbb5ae5a444f380825ffa4fdc2fe9f56a8c694f913
  280. Building wheel for python-nvd3 (setup.py) ... done
  281. Created wheel for python-nvd3: filename=python_nvd3-0.15.0-py3-none-any.whl size=38164 sha256=f14bcb3d9d3b20d96dd5e99063a1d1c515f22e41fcac256c86d6a6d2395fcd55
  282. Stored in directory: /root/.cache/pip/wheels/81/df/d0/baaadc60b17b08d30b8448f0fd5ec71a2b4bfd19cb4b772a60
  283. Building wheel for python-slugify (setup.py) ... done
  284. Created wheel for python-slugify: filename=python_slugify-4.0.1-py2.py3-none-any.whl size=6781 sha256=25b31b28088f8ace6cde05f49bda2018f3647ffb812aac34e897312a1cb7b7ef
  285. Stored in directory: /root/.cache/pip/wheels/72/e6/db/122611605e60148f54ee2abaca98b2bbeafc6e22486a867bad
  286. Building wheel for termcolor (setup.py) ... done
  287. Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=4847 sha256=e3ba94de96b102c8024cb753466aaf08e33b3af403c4067a24f64757a13e902e
  288. Stored in directory: /root/.cache/pip/wheels/93/2a/eb/e58dbcbc963549ee4f065ff80a59f274cc7210b6eab962acdc
  289. Building wheel for typing (setup.py) ... done
  290. Created wheel for typing: filename=typing-3.7.4.3-py3-none-any.whl size=26324 sha256=91e8d63034a608ce6c169f56fd28f7baf4ba85132b0b4d47e7337ef25fc4a539
  291. Stored in directory: /root/.cache/pip/wheels/5f/63/c2/b85489bbea28cb5d36cfe197244f898428004fa3caa7a23116
  292. Building wheel for unicodecsv (setup.py) ... done
  293. Created wheel for unicodecsv: filename=unicodecsv-0.14.1-py3-none-any.whl size=10765 sha256=644a7029f406b839f7cb71e6393984190b62595c5c94eae69feae722b96c3312
  294. Stored in directory: /root/.cache/pip/wheels/8d/0b/ff/bbba4ab3cf81844c3f8d130f8c53d392e1224b9750a71f0485
  295. Building wheel for blinker (setup.py) ... done
  296. Created wheel for blinker: filename=blinker-1.4-py3-none-any.whl size=13478 sha256=9ce82067bfdf37d6c28092f2ac6c05b661461e388461551b71d4243309d762ed
  297. Stored in directory: /root/.cache/pip/wheels/4f/4a/93/c5ed8c11fedbe97fb8b8032b301eaa736248684b44087a7259
  298. Building wheel for contextvars (setup.py) ... done
  299. Created wheel for contextvars: filename=contextvars-2.4-py3-none-any.whl size=7680 sha256=e8778009f67b31b9e4288da2d836b071b35515ce7f4ed7f3b4544fd513d8367f
  300. Stored in directory: /root/.cache/pip/wheels/41/11/53/911724983aa48deb94792432e14e518447212dd6c5477d49d3
  301. Successfully built Flask-JWT-Extended flask-login python-nvd3 python-slugify termcolor typing unicodecsv blinker contextvars
  302. Installing collected packages: typing-extensions, immutables, zipp, markupsafe, contextvars, werkzeug, sniffio, six, pytz, pyrsistent, jinja2, itsdangerous, importlib-metadata, idna, defusedxml, dataclasses, click, attrs, WTForms, urllib3, text-unidecode, sqlalchemy, rfc3986, pyyaml, python3-openid, pyjwt, pycparser, marshmallow, jsonschema, isodate, h11, flask, dnspython, charset-normalizer, Babel, apispec, anyio, typing, sqlalchemy-utils, requests, pytzdata, python-slugify, python-dateutil, pyparsing, pygments, prison, openapi-schema-validator, marshmallow-sqlalchemy, marshmallow-enum, Mako, lockfile, importlib-resources, httpcore, flask-wtf, Flask-SQLAlchemy, Flask-OpenID, flask-login, Flask-JWT-Extended, Flask-Babel, email-validator, docutils, commonmark, colorama, cffi, async-generator, unicodecsv, termcolor, tenacity, tabulate, swagger-ui-bundle, sqlalchemy-jsonfield, setproctitle, rich, python-nvd3, python-daemon, psutil, pep562, pendulum, packaging, openapi-spec-validator, marshmallow-oneofschema, markdown, lazy-object-proxy, iso8601, inflection, httpx, gunicorn, graphviz, flask-caching, flask-appbuilder, dill, cryptography, croniter, colorlog, clickclick, cattrs, cached-property, blinker, argcomplete, apache-airflow-providers-sqlite, apache-airflow-providers-imap, apache-airflow-providers-http, apache-airflow-providers-ftp, alembic, apache-airflow
  303. Successfully installed Babel-2.9.1 Flask-Babel-2.0.0 Flask-JWT-Extended-3.25.1 Flask-OpenID-1.3.0 Flask-SQLAlchemy-2.5.1 Mako-1.1.5 WTForms-2.3.3 alembic-1.7.4 anyio-3.3.3 apache-airflow-2.2.0 apache-airflow-providers-ftp-2.0.1 apache-airflow-providers-http-2.0.1 apache-airflow-providers-imap-2.0.1 apache-airflow-providers-sqlite-2.0.1 apispec-3.3.2 argcomplete-1.12.3 async-generator-1.10 attrs-20.3.0 blinker-1.4 cached-property-1.5.2 cattrs-1.0.0 cffi-1.15.0 charset-normalizer-2.0.7 click-7.1.2 clickclick-20.10.2 colorama-0.4.4 colorlog-5.0.1 commonmark-0.9.1 contextvars-2.4 croniter-1.0.15 cryptography-35.0.0 dataclasses-0.8 defusedxml-0.7.1 dill-0.3.4 dnspython-2.1.0 docutils-0.16 email-validator-1.1.3 flask-1.1.4 flask-appbuilder-3.3.4 flask-caching-1.10.1 flask-login-0.4.1 flask-wtf-0.14.3 graphviz-0.17 gunicorn-20.1.0 h11-0.12.0 httpcore-0.13.7 httpx-0.20.0 idna-3.3 immutables-0.16 importlib-metadata-4.8.1 importlib-resources-5.2.2 inflection-0.5.1 iso8601-0.1.16 isodate-0.6.0 itsdangerous-1.1.0 jinja2-2.11.3 jsonschema-3.2.0 lazy-object-proxy-1.6.0 lockfile-0.12.2 markdown-3.3.4 markupsafe-1.1.1 marshmallow-3.13.0 marshmallow-enum-1.5.1 marshmallow-oneofschema-3.0.1 marshmallow-sqlalchemy-0.26.1 openapi-schema-validator-0.1.5 openapi-spec-validator-0.3.1 packaging-21.0 pendulum-2.1.2 pep562-1.1 prison-0.2.1 psutil-5.8.0 pycparser-2.20 pygments-2.10.0 pyjwt-1.7.1 pyparsing-2.4.7 pyrsistent-0.18.0 python-daemon-2.3.0 python-dateutil-2.8.2 python-nvd3-0.15.0 python-slugify-4.0.1 python3-openid-3.2.0 pytz-2021.3 pytzdata-2020.1 pyyaml-6.0 requests-2.26.0 rfc3986-1.5.0 rich-10.12.0 setproctitle-1.2.2 six-1.16.0 sniffio-1.2.0 sqlalchemy-1.3.24 sqlalchemy-jsonfield-1.0.0 sqlalchemy-utils-0.37.8 swagger-ui-bundle-0.0.9 tabulate-0.8.9 tenacity-8.0.1 termcolor-1.1.0 text-unidecode-1.3 typing-3.7.4.3 typing-extensions-3.10.0.2 unicodecsv-0.14.1 urllib3-1.26.7 werkzeug-1.0.1 zipp-3.6.0
  304. WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

4.初始化数据库

airflow db init

  1. (python36) [root@bogon pip]# airflow db init
  2. DB: sqlite:root/airflow/airflow.db
  3. [2021-10-14 04:01:47,145] {db.py:823} INFO - Creating tables
  4. INFO [alembic.runtime.migration] Context impl SQLiteImpl.
  5. INFO [alembic.runtime.migration] Will assume non-transactional DDL.
  6. INFO [alembic.runtime.migration] Running upgrade -> e3a246e0dc1, current schema
  7. INFO [alembic.runtime.migration] Running upgrade e3a246e0dc1 -> 1507a7289a2f, create is_encrypted
  8. /usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/alembic/ddl/sqlite.py:75 UserWarning: Skipping unsupported ALTER for creation of implicit constraintPlease refer to the batch mode feature which allows for SQLite migrations using a copy-and-move strategy.
  9. INFO [alembic.runtime.migration] Running upgrade 1507a7289a2f -> 13eb55f81627, maintain history for compatibility with earlier migrations
  10. INFO [alembic.runtime.migration] Running upgrade 13eb55f81627 -> 338e90f54d61, More logging into task_instance
  11. INFO [alembic.runtime.migration] Running upgrade 338e90f54d61 -> 52d714495f0, job_id indices
  12. INFO [alembic.runtime.migration] Running upgrade 52d714495f0 -> 502898887f84, Adding extra to Log
  13. INFO [alembic.runtime.migration] Running upgrade 502898887f84 -> 1b38cef5b76e, add dagrun
  14. INFO [alembic.runtime.migration] Running upgrade 1b38cef5b76e -> 2e541a1dcfed, task_duration
  15. INFO [alembic.runtime.migration] Running upgrade 2e541a1dcfed -> 40e67319e3a9, dagrun_config
  16. INFO [alembic.runtime.migration] Running upgrade 40e67319e3a9 -> 561833c1c74b, add password column to user
  17. INFO [alembic.runtime.migration] Running upgrade 561833c1c74b -> 4446e08588, dagrun start end
  18. INFO [alembic.runtime.migration] Running upgrade 4446e08588 -> bbc73705a13e, Add notification_sent column to sla_miss
  19. INFO [alembic.runtime.migration] Running upgrade bbc73705a13e -> bba5a7cfc896, Add a column to track the encryption state of the 'Extra' field in connection
  20. INFO [alembic.runtime.migration] Running upgrade bba5a7cfc896 -> 1968acfc09e3, add is_encrypted column to variable table
  21. INFO [alembic.runtime.migration] Running upgrade 1968acfc09e3 -> 2e82aab8ef20, rename user table
  22. INFO [alembic.runtime.migration] Running upgrade 2e82aab8ef20 -> 211e584da130, add TI state index
  23. INFO [alembic.runtime.migration] Running upgrade 211e584da130 -> 64de9cddf6c9, add task fails journal table
  24. INFO [alembic.runtime.migration] Running upgrade 64de9cddf6c9 -> f2ca10b85618, add dag_stats table
  25. INFO [alembic.runtime.migration] Running upgrade f2ca10b85618 -> 4addfa1236f1, Add fractional seconds to mysql tables
  26. INFO [alembic.runtime.migration] Running upgrade 4addfa1236f1 -> 8504051e801b, xcom dag task indices
  27. INFO [alembic.runtime.migration] Running upgrade 8504051e801b -> 5e7d17757c7a, add pid field to TaskInstance
  28. INFO [alembic.runtime.migration] Running upgrade 5e7d17757c7a -> 127d2bf2dfa7, Add dag_id/state index on dag_run table
  29. INFO [alembic.runtime.migration] Running upgrade 127d2bf2dfa7 -> cc1e65623dc7, add max tries column to task instance
  30. INFO [alembic.runtime.migration] Running upgrade cc1e65623dc7 -> bdaa763e6c56, Make xcom value column a large binary
  31. INFO [alembic.runtime.migration] Running upgrade bdaa763e6c56 -> 947454bf1dff, add ti job_id index
  32. INFO [alembic.runtime.migration] Running upgrade 947454bf1dff -> d2ae31099d61, Increase text size for MySQL (not relevant for other DBs' text types)
  33. INFO [alembic.runtime.migration] Running upgrade d2ae31099d61 -> 0e2a74e0fc9f, Add time zone awareness
  34. INFO [alembic.runtime.migration] Running upgrade d2ae31099d61 -> 33ae817a1ff4, kubernetes_resource_checkpointing
  35. INFO [alembic.runtime.migration] Running upgrade 33ae817a1ff4 -> 27c6a30d7c24, kubernetes_resource_checkpointing
  36. INFO [alembic.runtime.migration] Running upgrade 27c6a30d7c24 -> 86770d1215c0, add kubernetes scheduler uniqueness
  37. INFO [alembic.runtime.migration] Running upgrade 86770d1215c0, 0e2a74e0fc9f -> 05f30312d566, merge heads
  38. INFO [alembic.runtime.migration] Running upgrade 05f30312d566 -> f23433877c24, fix mysql not null constraint
  39. INFO [alembic.runtime.migration] Running upgrade f23433877c24 -> 856955da8476, fix sqlite foreign key
  40. INFO [alembic.runtime.migration] Running upgrade 856955da8476 -> 9635ae0956e7, index-taskfail
  41. INFO [alembic.runtime.migration] Running upgrade 9635ae0956e7 -> dd25f486b8ea, add idx_log_dag
  42. INFO [alembic.runtime.migration] Running upgrade dd25f486b8ea -> bf00311e1990, add index to taskinstance
  43. INFO [alembic.runtime.migration] Running upgrade 9635ae0956e7 -> 0a2a5b66e19d, add task_reschedule table
  44. INFO [alembic.runtime.migration] Running upgrade 0a2a5b66e19d, bf00311e1990 -> 03bc53e68815, merge_heads_2
  45. INFO [alembic.runtime.migration] Running upgrade 03bc53e68815 -> 41f5f12752f8, add superuser field
  46. INFO [alembic.runtime.migration] Running upgrade 41f5f12752f8 -> c8ffec048a3b, add fields to dag
  47. INFO [alembic.runtime.migration] Running upgrade c8ffec048a3b -> dd4ecb8fbee3, Add schedule interval to dag
  48. INFO [alembic.runtime.migration] Running upgrade dd4ecb8fbee3 -> 939bb1e647c8, task reschedule fk on cascade delete
  49. INFO [alembic.runtime.migration] Running upgrade 939bb1e647c8 -> 6e96a59344a4, Make TaskInstance.pool not nullable
  50. INFO [alembic.runtime.migration] Running upgrade 6e96a59344a4 -> d38e04c12aa2, add serialized_dag table
  51. INFO [alembic.runtime.migration] Running upgrade d38e04c12aa2 -> b3b105409875, add root_dag_id to DAG
  52. INFO [alembic.runtime.migration] Running upgrade 6e96a59344a4 -> 74effc47d867, change datetime to datetime2(6) on MSSQL tables
  53. INFO [alembic.runtime.migration] Running upgrade 939bb1e647c8 -> 004c1210f153, increase queue name size limit
  54. INFO [alembic.runtime.migration] Running upgrade c8ffec048a3b -> a56c9515abdc, Remove dag_stat table
  55. INFO [alembic.runtime.migration] Running upgrade a56c9515abdc, 004c1210f153, 74effc47d867, b3b105409875 -> 08364691d074, Merge the four heads back together
  56. INFO [alembic.runtime.migration] Running upgrade 08364691d074 -> fe461863935f, increase_length_for_connection_password
  57. INFO [alembic.runtime.migration] Running upgrade fe461863935f -> 7939bcff74ba, Add DagTags table
  58. INFO [alembic.runtime.migration] Running upgrade 7939bcff74ba -> a4c2fd67d16b, add pool_slots field to task_instance
  59. INFO [alembic.runtime.migration] Running upgrade a4c2fd67d16b -> 852ae6c715af, Add RenderedTaskInstanceFields table
  60. INFO [alembic.runtime.migration] Running upgrade 852ae6c715af -> 952da73b5eff, add dag_code table
  61. INFO [alembic.runtime.migration] Running upgrade 952da73b5eff -> a66efa278eea, Add Precision to execution_date in RenderedTaskInstanceFields table
  62. INFO [alembic.runtime.migration] Running upgrade a66efa278eea -> da3f683c3a5a, Add dag_hash Column to serialized_dag table
  63. INFO [alembic.runtime.migration] Running upgrade da3f683c3a5a -> 92c57b58940d, Create FAB Tables
  64. INFO [alembic.runtime.migration] Running upgrade 92c57b58940d -> 03afc6b6f902, Increase length of FAB ab_view_menu.name column
  65. INFO [alembic.runtime.migration] Running upgrade 03afc6b6f902 -> cf5dc11e79ad, drop_user_and_chart
  66. INFO [alembic.runtime.migration] Running upgrade cf5dc11e79ad -> bbf4a7ad0465, Remove id column from xcom
  67. INFO [alembic.runtime.migration] Running upgrade bbf4a7ad0465 -> b25a55525161, Increase length of pool name
  68. INFO [alembic.runtime.migration] Running upgrade b25a55525161 -> 3c20cacc0044, Add DagRun run_type
  69. INFO [alembic.runtime.migration] Running upgrade 3c20cacc0044 -> 8f966b9c467a, Set conn_type as non-nullable
  70. INFO [alembic.runtime.migration] Running upgrade 8f966b9c467a -> 8d48763f6d53, add unique constraint to conn_id
  71. INFO [alembic.runtime.migration] Running upgrade 8d48763f6d53 -> e38be357a868, Add sensor_instance table
  72. INFO [alembic.runtime.migration] Running upgrade e38be357a868 -> b247b1e3d1ed, Add queued by Job ID to TI
  73. INFO [alembic.runtime.migration] Running upgrade b247b1e3d1ed -> e1a11ece99cc, Add external executor ID to TI
  74. INFO [alembic.runtime.migration] Running upgrade e1a11ece99cc -> bef4f3d11e8b, Drop KubeResourceVersion and KubeWorkerId
  75. INFO [alembic.runtime.migration] Running upgrade bef4f3d11e8b -> 98271e7606e2, Add scheduling_decision to DagRun and DAG
  76. INFO [alembic.runtime.migration] Running upgrade 98271e7606e2 -> 52d53670a240, fix_mssql_exec_date_rendered_task_instance_fields_for_MSSQL
  77. INFO [alembic.runtime.migration] Running upgrade 52d53670a240 -> 364159666cbd, Add creating_job_id to DagRun table
  78. INFO [alembic.runtime.migration] Running upgrade 364159666cbd -> 45ba3f1493b9, add-k8s-yaml-to-rendered-templates
  79. INFO [alembic.runtime.migration] Running upgrade 45ba3f1493b9 -> 849da589634d, Prefix DAG permissions.
  80. INFO [alembic.runtime.migration] Running upgrade 849da589634d -> 2c6edca13270, Resource based permissions.
  81. [2021-10-14 04:01:49,924] {manager.py:245} INFO - Inserted Role: Admin
  82. [2021-10-14 04:01:49,933] {manager.py:245} INFO - Inserted Role: Public
  83. [2021-10-14 04:01:49,936] {manager.py:763} WARNING - No user yet created, use flask fab command to do it.
  84. [2021-10-14 04:01:51,657] {manager.py:496} INFO - Created Permission View: can delete on Connections
  85. [2021-10-14 04:01:51,671] {manager.py:496} INFO - Created Permission View: can read on Connections
  86. [2021-10-14 04:01:51,715] {manager.py:496} INFO - Created Permission View: can edit on Connections
  87. [2021-10-14 04:01:51,735] {manager.py:496} INFO - Created Permission View: can create on Connections
  88. [2021-10-14 04:01:51,805] {manager.py:496} INFO - Created Permission View: can read on DAGs
  89. [2021-10-14 04:01:51,829] {manager.py:496} INFO - Created Permission View: can edit on DAGs
  90. [2021-10-14 04:01:51,849] {manager.py:496} INFO - Created Permission View: can delete on DAGs
  91. [2021-10-14 04:01:51,917] {manager.py:496} INFO - Created Permission View: can read on DAG Runs
  92. [2021-10-14 04:01:51,950] {manager.py:496} INFO - Created Permission View: can read on Task Instances
  93. [2021-10-14 04:01:52,005] {manager.py:496} INFO - Created Permission View: can edit on Task Instances
  94. [2021-10-14 04:01:52,043] {manager.py:496} INFO - Created Permission View: can delete on DAG Runs
  95. [2021-10-14 04:01:52,093] {manager.py:496} INFO - Created Permission View: can create on DAG Runs
  96. [2021-10-14 04:01:52,112] {manager.py:496} INFO - Created Permission View: can edit on DAG Runs
  97. [2021-10-14 04:01:52,160] {manager.py:496} INFO - Created Permission View: can read on Audit Logs
  98. [2021-10-14 04:01:52,194] {manager.py:496} INFO - Created Permission View: can read on ImportError
  99. [2021-10-14 04:01:52,230] {manager.py:496} INFO - Created Permission View: can delete on Pools
  100. [2021-10-14 04:01:52,242] {manager.py:496} INFO - Created Permission View: can read on Pools
  101. [2021-10-14 04:01:52,315] {manager.py:496} INFO - Created Permission View: can edit on Pools
  102. [2021-10-14 04:01:52,360] {manager.py:496} INFO - Created Permission View: can create on Pools
  103. [2021-10-14 04:01:52,391] {manager.py:496} INFO - Created Permission View: can read on Providers
  104. [2021-10-14 04:01:52,438] {manager.py:496} INFO - Created Permission View: can delete on Variables
  105. [2021-10-14 04:01:52,458] {manager.py:496} INFO - Created Permission View: can read on Variables
  106. [2021-10-14 04:01:52,490] {manager.py:496} INFO - Created Permission View: can edit on Variables
  107. [2021-10-14 04:01:52,505] {manager.py:496} INFO - Created Permission View: can create on Variables
  108. [2021-10-14 04:01:52,560] {manager.py:496} INFO - Created Permission View: can read on XComs
  109. [2021-10-14 04:01:52,637] {manager.py:496} INFO - Created Permission View: can read on DAG Code
  110. [2021-10-14 04:01:52,680] {manager.py:496} INFO - Created Permission View: can read on Configurations
  111. [2021-10-14 04:01:52,722] {manager.py:496} INFO - Created Permission View: can read on Plugins
  112. [2021-10-14 04:01:52,757] {manager.py:496} INFO - Created Permission View: can read on Roles
  113. [2021-10-14 04:01:52,791] {manager.py:496} INFO - Created Permission View: can read on Permissions
  114. [2021-10-14 04:01:52,803] {manager.py:496} INFO - Created Permission View: can delete on Roles
  115. [2021-10-14 04:01:52,833] {manager.py:496} INFO - Created Permission View: can edit on Roles
  116. [2021-10-14 04:01:52,849] {manager.py:496} INFO - Created Permission View: can create on Roles
  117. [2021-10-14 04:01:52,903] {manager.py:496} INFO - Created Permission View: can read on Users
  118. [2021-10-14 04:01:52,933] {manager.py:496} INFO - Created Permission View: can create on Users
  119. [2021-10-14 04:01:52,945] {manager.py:496} INFO - Created Permission View: can edit on Users
  120. [2021-10-14 04:01:52,966] {manager.py:496} INFO - Created Permission View: can delete on Users
  121. [2021-10-14 04:01:53,066] {manager.py:245} INFO - Inserted Role: Viewer
  122. [2021-10-14 04:01:53,081] {manager.py:558} INFO - Added Permission can read on Audit Logs to role Viewer
  123. [2021-10-14 04:01:53,101] {manager.py:558} INFO - Added Permission can read on DAGs to role Viewer
  124. [2021-10-14 04:01:53,118] {manager.py:496} INFO - Created Permission View: can read on DAG Dependencies
  125. [2021-10-14 04:01:53,135] {manager.py:558} INFO - Added Permission can read on DAG Dependencies to role Viewer
  126. [2021-10-14 04:01:53,147] {manager.py:558} INFO - Added Permission can read on DAG Code to role Viewer
  127. [2021-10-14 04:01:53,166] {manager.py:558} INFO - Added Permission can read on DAG Runs to role Viewer
  128. [2021-10-14 04:01:53,176] {manager.py:558} INFO - Added Permission can read on ImportError to role Viewer
  129. [2021-10-14 04:01:53,199] {manager.py:496} INFO - Created Permission View: can read on Jobs
  130. [2021-10-14 04:01:53,212] {manager.py:558} INFO - Added Permission can read on Jobs to role Viewer
  131. [2021-10-14 04:01:53,241] {manager.py:496} INFO - Created Permission View: can read on My Password
  132. [2021-10-14 04:01:53,255] {manager.py:558} INFO - Added Permission can read on My Password to role Viewer
  133. [2021-10-14 04:01:53,277] {manager.py:496} INFO - Created Permission View: can edit on My Password
  134. [2021-10-14 04:01:53,288] {manager.py:558} INFO - Added Permission can edit on My Password to role Viewer
  135. [2021-10-14 04:01:53,323] {manager.py:496} INFO - Created Permission View: can read on My Profile
  136. [2021-10-14 04:01:53,331] {manager.py:558} INFO - Added Permission can read on My Profile to role Viewer
  137. [2021-10-14 04:01:53,355] {manager.py:496} INFO - Created Permission View: can edit on My Profile
  138. [2021-10-14 04:01:53,377] {manager.py:558} INFO - Added Permission can edit on My Profile to role Viewer
  139. [2021-10-14 04:01:53,386] {manager.py:558} INFO - Added Permission can read on Plugins to role Viewer
  140. [2021-10-14 04:01:53,431] {manager.py:496} INFO - Created Permission View: can read on SLA Misses
  141. [2021-10-14 04:01:53,439] {manager.py:558} INFO - Added Permission can read on SLA Misses to role Viewer
  142. [2021-10-14 04:01:53,455] {manager.py:558} INFO - Added Permission can read on Task Instances to role Viewer
  143. [2021-10-14 04:01:53,474] {manager.py:496} INFO - Created Permission View: can read on Task Logs
  144. [2021-10-14 04:01:53,482] {manager.py:558} INFO - Added Permission can read on Task Logs to role Viewer
  145. [2021-10-14 04:01:53,494] {manager.py:558} INFO - Added Permission can read on XComs to role Viewer
  146. [2021-10-14 04:01:53,541] {manager.py:496} INFO - Created Permission View: can read on Website
  147. [2021-10-14 04:01:53,550] {manager.py:558} INFO - Added Permission can read on Website to role Viewer
  148. [2021-10-14 04:01:53,583] {manager.py:496} INFO - Created Permission View: menu access on Browse
  149. [2021-10-14 04:01:53,618] {manager.py:558} INFO - Added Permission menu access on Browse to role Viewer
  150. [2021-10-14 04:01:53,633] {manager.py:496} INFO - Created Permission View: menu access on DAG Dependencies
  151. [2021-10-14 04:01:53,653] {manager.py:558} INFO - Added Permission menu access on DAG Dependencies to role Viewer
  152. [2021-10-14 04:01:53,674] {manager.py:496} INFO - Created Permission View: menu access on DAG Runs
  153. [2021-10-14 04:01:53,688] {manager.py:558} INFO - Added Permission menu access on DAG Runs to role Viewer
  154. [2021-10-14 04:01:53,728] {manager.py:496} INFO - Created Permission View: menu access on Documentation
  155. [2021-10-14 04:01:53,736] {manager.py:558} INFO - Added Permission menu access on Documentation to role Viewer
  156. [2021-10-14 04:01:53,766] {manager.py:496} INFO - Created Permission View: menu access on Docs
  157. [2021-10-14 04:01:53,786] {manager.py:558} INFO - Added Permission menu access on Docs to role Viewer
  158. [2021-10-14 04:01:53,809] {manager.py:496} INFO - Created Permission View: menu access on Jobs
  159. [2021-10-14 04:01:53,821] {manager.py:558} INFO - Added Permission menu access on Jobs to role Viewer
  160. [2021-10-14 04:01:53,842] {manager.py:496} INFO - Created Permission View: menu access on Audit Logs
  161. [2021-10-14 04:01:53,853] {manager.py:558} INFO - Added Permission menu access on Audit Logs to role Viewer
  162. [2021-10-14 04:01:53,874] {manager.py:496} INFO - Created Permission View: menu access on Plugins
  163. [2021-10-14 04:01:53,886] {manager.py:558} INFO - Added Permission menu access on Plugins to role Viewer
  164. [2021-10-14 04:01:53,908] {manager.py:496} INFO - Created Permission View: menu access on SLA Misses
  165. [2021-10-14 04:01:53,918] {manager.py:558} INFO - Added Permission menu access on SLA Misses to role Viewer
  166. [2021-10-14 04:01:53,951] {manager.py:496} INFO - Created Permission View: menu access on Task Instances
  167. [2021-10-14 04:01:53,960] {manager.py:558} INFO - Added Permission menu access on Task Instances to role Viewer
  168. [2021-10-14 04:01:53,974] {manager.py:245} INFO - Inserted Role: User
  169. [2021-10-14 04:01:53,984] {manager.py:558} INFO - Added Permission can read on Audit Logs to role User
  170. [2021-10-14 04:01:53,996] {manager.py:558} INFO - Added Permission can read on DAGs to role User
  171. [2021-10-14 04:01:54,020] {manager.py:558} INFO - Added Permission can read on DAG Dependencies to role User
  172. [2021-10-14 04:01:54,039] {manager.py:558} INFO - Added Permission can read on DAG Code to role User
  173. [2021-10-14 04:01:54,048] {manager.py:558} INFO - Added Permission can read on DAG Runs to role User
  174. [2021-10-14 04:01:54,061] {manager.py:558} INFO - Added Permission can read on ImportError to role User
  175. [2021-10-14 04:01:54,077] {manager.py:558} INFO - Added Permission can read on Jobs to role User
  176. [2021-10-14 04:01:54,096] {manager.py:558} INFO - Added Permission can read on My Password to role User
  177. [2021-10-14 04:01:54,109] {manager.py:558} INFO - Added Permission can edit on My Password to role User
  178. [2021-10-14 04:01:54,123] {manager.py:558} INFO - Added Permission can read on My Profile to role User
  179. [2021-10-14 04:01:54,137] {manager.py:558} INFO - Added Permission can edit on My Profile to role User
  180. [2021-10-14 04:01:54,160] {manager.py:558} INFO - Added Permission can read on Plugins to role User
  181. [2021-10-14 04:01:54,173] {manager.py:558} INFO - Added Permission can read on SLA Misses to role User
  182. [2021-10-14 04:01:54,184] {manager.py:558} INFO - Added Permission can read on Task Instances to role User
  183. [2021-10-14 04:01:54,197] {manager.py:558} INFO - Added Permission can read on Task Logs to role User
  184. [2021-10-14 04:01:54,217] {manager.py:558} INFO - Added Permission can read on XComs to role User
  185. [2021-10-14 04:01:54,232] {manager.py:558} INFO - Added Permission can read on Website to role User
  186. [2021-10-14 04:01:54,246] {manager.py:558} INFO - Added Permission menu access on Browse to role User
  187. [2021-10-14 04:01:54,263] {manager.py:558} INFO - Added Permission menu access on DAG Dependencies to role User
  188. [2021-10-14 04:01:54,274] {manager.py:558} INFO - Added Permission menu access on DAG Runs to role User
  189. [2021-10-14 04:01:54,290] {manager.py:558} INFO - Added Permission menu access on Documentation to role User
  190. [2021-10-14 04:01:54,308] {manager.py:558} INFO - Added Permission menu access on Docs to role User
  191. [2021-10-14 04:01:54,320] {manager.py:558} INFO - Added Permission menu access on Jobs to role User
  192. [2021-10-14 04:01:54,332] {manager.py:558} INFO - Added Permission menu access on Audit Logs to role User
  193. [2021-10-14 04:01:54,350] {manager.py:558} INFO - Added Permission menu access on Plugins to role User
  194. [2021-10-14 04:01:54,371] {manager.py:558} INFO - Added Permission menu access on SLA Misses to role User
  195. [2021-10-14 04:01:54,385] {manager.py:558} INFO - Added Permission menu access on Task Instances to role User
  196. [2021-10-14 04:01:54,393] {manager.py:558} INFO - Added Permission can edit on DAGs to role User
  197. [2021-10-14 04:01:54,406] {manager.py:558} INFO - Added Permission can delete on DAGs to role User
  198. [2021-10-14 04:01:54,418] {manager.py:496} INFO - Created Permission View: can create on Task Instances
  199. [2021-10-14 04:01:54,427] {manager.py:558} INFO - Added Permission can create on Task Instances to role User
  200. [2021-10-14 04:01:54,439] {manager.py:558} INFO - Added Permission can edit on Task Instances to role User
  201. [2021-10-14 04:01:54,461] {manager.py:496} INFO - Created Permission View: can delete on Task Instances
  202. [2021-10-14 04:01:54,474] {manager.py:558} INFO - Added Permission can delete on Task Instances to role User
  203. [2021-10-14 04:01:54,482] {manager.py:558} INFO - Added Permission can create on DAG Runs to role User
  204. [2021-10-14 04:01:54,517] {manager.py:558} INFO - Added Permission can edit on DAG Runs to role User
  205. [2021-10-14 04:01:54,526] {manager.py:558} INFO - Added Permission can delete on DAG Runs to role User
  206. [2021-10-14 04:01:54,538] {manager.py:245} INFO - Inserted Role: Op
  207. [2021-10-14 04:01:54,551] {manager.py:558} INFO - Added Permission can read on Audit Logs to role Op
  208. [2021-10-14 04:01:54,562] {manager.py:558} INFO - Added Permission can read on DAGs to role Op
  209. [2021-10-14 04:01:54,585] {manager.py:558} INFO - Added Permission can read on DAG Dependencies to role Op
  210. [2021-10-14 04:01:54,605] {manager.py:558} INFO - Added Permission can read on DAG Code to role Op
  211. [2021-10-14 04:01:54,616] {manager.py:558} INFO - Added Permission can read on DAG Runs to role Op
  212. [2021-10-14 04:01:54,627] {manager.py:558} INFO - Added Permission can read on ImportError to role Op
  213. [2021-10-14 04:01:54,650] {manager.py:558} INFO - Added Permission can read on Jobs to role Op
  214. [2021-10-14 04:01:54,664] {manager.py:558} INFO - Added Permission can read on My Password to role Op
  215. [2021-10-14 04:01:54,674] {manager.py:558} INFO - Added Permission can edit on My Password to role Op
  216. [2021-10-14 04:01:54,690] {manager.py:558} INFO - Added Permission can read on My Profile to role Op
  217. [2021-10-14 04:01:54,705] {manager.py:558} INFO - Added Permission can edit on My Profile to role Op
  218. [2021-10-14 04:01:54,717] {manager.py:558} INFO - Added Permission can read on Plugins to role Op
  219. [2021-10-14 04:01:54,740] {manager.py:558} INFO - Added Permission can read on SLA Misses to role Op
  220. [2021-10-14 04:01:54,759] {manager.py:558} INFO - Added Permission can read on Task Instances to role Op
  221. [2021-10-14 04:01:54,775] {manager.py:558} INFO - Added Permission can read on Task Logs to role Op
  222. [2021-10-14 04:01:54,783] {manager.py:558} INFO - Added Permission can read on XComs to role Op
  223. [2021-10-14 04:01:54,798] {manager.py:558} INFO - Added Permission can read on Website to role Op
  224. [2021-10-14 04:01:54,818] {manager.py:558} INFO - Added Permission menu access on Browse to role Op
  225. [2021-10-14 04:01:54,830] {manager.py:558} INFO - Added Permission menu access on DAG Dependencies to role Op
  226. [2021-10-14 04:01:54,843] {manager.py:558} INFO - Added Permission menu access on DAG Runs to role Op
  227. [2021-10-14 04:01:54,862] {manager.py:558} INFO - Added Permission menu access on Documentation to role Op
  228. [2021-10-14 04:01:54,876] {manager.py:558} INFO - Added Permission menu access on Docs to role Op
  229. [2021-10-14 04:01:54,894] {manager.py:558} INFO - Added Permission menu access on Jobs to role Op
  230. [2021-10-14 04:01:54,907] {manager.py:558} INFO - Added Permission menu access on Audit Logs to role Op
  231. [2021-10-14 04:01:54,926] {manager.py:558} INFO - Added Permission menu access on Plugins to role Op
  232. [2021-10-14 04:01:54,938] {manager.py:558} INFO - Added Permission menu access on SLA Misses to role Op
  233. [2021-10-14 04:01:54,960] {manager.py:558} INFO - Added Permission menu access on Task Instances to role Op
  234. [2021-10-14 04:01:54,970] {manager.py:558} INFO - Added Permission can edit on DAGs to role Op
  235. [2021-10-14 04:01:54,991] {manager.py:558} INFO - Added Permission can delete on DAGs to role Op
  236. [2021-10-14 04:01:55,005] {manager.py:558} INFO - Added Permission can create on Task Instances to role Op
  237. [2021-10-14 04:01:55,014] {manager.py:558} INFO - Added Permission can edit on Task Instances to role Op
  238. [2021-10-14 04:01:55,037] {manager.py:558} INFO - Added Permission can delete on Task Instances to role Op
  239. [2021-10-14 04:01:55,048] {manager.py:558} INFO - Added Permission can create on DAG Runs to role Op
  240. [2021-10-14 04:01:55,069] {manager.py:558} INFO - Added Permission can edit on DAG Runs to role Op
  241. [2021-10-14 04:01:55,078] {manager.py:558} INFO - Added Permission can delete on DAG Runs to role Op
  242. [2021-10-14 04:01:55,093] {manager.py:558} INFO - Added Permission can read on Configurations to role Op
  243. [2021-10-14 04:01:55,115] {manager.py:496} INFO - Created Permission View: menu access on Admin
  244. [2021-10-14 04:01:55,124] {manager.py:558} INFO - Added Permission menu access on Admin to role Op
  245. [2021-10-14 04:01:55,138] {manager.py:496} INFO - Created Permission View: menu access on Configurations
  246. [2021-10-14 04:01:55,168] {manager.py:558} INFO - Added Permission menu access on Configurations to role Op
  247. [2021-10-14 04:01:55,182] {manager.py:496} INFO - Created Permission View: menu access on Connections
  248. [2021-10-14 04:01:55,192] {manager.py:558} INFO - Added Permission menu access on Connections to role Op
  249. [2021-10-14 04:01:55,205] {manager.py:496} INFO - Created Permission View: menu access on Pools
  250. [2021-10-14 04:01:55,235] {manager.py:558} INFO - Added Permission menu access on Pools to role Op
  251. [2021-10-14 04:01:55,247] {manager.py:496} INFO - Created Permission View: menu access on Variables
  252. [2021-10-14 04:01:55,280] {manager.py:558} INFO - Added Permission menu access on Variables to role Op
  253. [2021-10-14 04:01:55,293] {manager.py:496} INFO - Created Permission View: menu access on XComs
  254. [2021-10-14 04:01:55,303] {manager.py:558} INFO - Added Permission menu access on XComs to role Op
  255. [2021-10-14 04:01:55,335] {manager.py:558} INFO - Added Permission can create on Connections to role Op
  256. [2021-10-14 04:01:55,347] {manager.py:558} INFO - Added Permission can read on Connections to role Op
  257. [2021-10-14 04:01:55,368] {manager.py:558} INFO - Added Permission can edit on Connections to role Op
  258. [2021-10-14 04:01:55,375] {manager.py:558} INFO - Added Permission can delete on Connections to role Op
  259. [2021-10-14 04:01:55,389] {manager.py:558} INFO - Added Permission can create on Pools to role Op
  260. [2021-10-14 04:01:55,400] {manager.py:558} INFO - Added Permission can read on Pools to role Op
  261. [2021-10-14 04:01:55,411] {manager.py:558} INFO - Added Permission can edit on Pools to role Op
  262. [2021-10-14 04:01:55,423] {manager.py:558} INFO - Added Permission can delete on Pools to role Op
  263. [2021-10-14 04:01:55,434] {manager.py:558} INFO - Added Permission can read on Providers to role Op
  264. [2021-10-14 04:01:55,445] {manager.py:558} INFO - Added Permission can create on Variables to role Op
  265. [2021-10-14 04:01:55,456] {manager.py:558} INFO - Added Permission can read on Variables to role Op
  266. [2021-10-14 04:01:55,467] {manager.py:558} INFO - Added Permission can edit on Variables to role Op
  267. [2021-10-14 04:01:55,478] {manager.py:558} INFO - Added Permission can delete on Variables to role Op
  268. [2021-10-14 04:01:55,490] {manager.py:496} INFO - Created Permission View: can delete on XComs
  269. [2021-10-14 04:01:55,502] {manager.py:558} INFO - Added Permission can delete on XComs to role Op
  270. [2021-10-14 04:01:55,524] {manager.py:558} INFO - Added Permission can read on Audit Logs to role Admin
  271. [2021-10-14 04:01:55,533] {manager.py:558} INFO - Added Permission can read on DAGs to role Admin
  272. [2021-10-14 04:01:55,549] {manager.py:558} INFO - Added Permission can read on DAG Dependencies to role Admin
  273. [2021-10-14 04:01:55,578] {manager.py:558} INFO - Added Permission can read on DAG Code to role Admin
  274. [2021-10-14 04:01:55,586] {manager.py:558} INFO - Added Permission can read on DAG Runs to role Admin
  275. [2021-10-14 04:01:55,600] {manager.py:558} INFO - Added Permission can read on ImportError to role Admin
  276. [2021-10-14 04:01:55,615] {manager.py:558} INFO - Added Permission can read on Jobs to role Admin
  277. [2021-10-14 04:01:55,628] {manager.py:558} INFO - Added Permission can read on My Password to role Admin
  278. [2021-10-14 04:01:55,638] {manager.py:558} INFO - Added Permission can edit on My Password to role Admin
  279. [2021-10-14 04:01:55,652] {manager.py:558} INFO - Added Permission can read on My Profile to role Admin
  280. [2021-10-14 04:01:55,668] {manager.py:558} INFO - Added Permission can edit on My Profile to role Admin
  281. [2021-10-14 04:01:55,679] {manager.py:558} INFO - Added Permission can read on Plugins to role Admin
  282. [2021-10-14 04:01:55,701] {manager.py:558} INFO - Added Permission can read on SLA Misses to role Admin
  283. [2021-10-14 04:01:55,709] {manager.py:558} INFO - Added Permission can read on Task Instances to role Admin
  284. [2021-10-14 04:01:55,724] {manager.py:558} INFO - Added Permission can read on Task Logs to role Admin
  285. [2021-10-14 04:01:55,734] {manager.py:558} INFO - Added Permission can read on XComs to role Admin
  286. [2021-10-14 04:01:55,757] {manager.py:558} INFO - Added Permission can read on Website to role Admin
  287. [2021-10-14 04:01:55,771] {manager.py:558} INFO - Added Permission menu access on Browse to role Admin
  288. [2021-10-14 04:01:55,783] {manager.py:558} INFO - Added Permission menu access on DAG Dependencies to role Admin
  289. [2021-10-14 04:01:55,801] {manager.py:558} INFO - Added Permission menu access on DAG Runs to role Admin
  290. [2021-10-14 04:01:55,816] {manager.py:558} INFO - Added Permission menu access on Documentation to role Admin
  291. [2021-10-14 04:01:55,830] {manager.py:558} INFO - Added Permission menu access on Docs to role Admin
  292. [2021-10-14 04:01:55,846] {manager.py:558} INFO - Added Permission menu access on Jobs to role Admin
  293. [2021-10-14 04:01:55,858] {manager.py:558} INFO - Added Permission menu access on Audit Logs to role Admin
  294. [2021-10-14 04:01:55,872] {manager.py:558} INFO - Added Permission menu access on Plugins to role Admin
  295. [2021-10-14 04:01:55,890] {manager.py:558} INFO - Added Permission menu access on SLA Misses to role Admin
  296. [2021-10-14 04:01:55,902] {manager.py:558} INFO - Added Permission menu access on Task Instances to role Admin
  297. [2021-10-14 04:01:55,913] {manager.py:558} INFO - Added Permission can edit on DAGs to role Admin
  298. [2021-10-14 04:01:55,934] {manager.py:558} INFO - Added Permission can delete on DAGs to role Admin
  299. [2021-10-14 04:01:55,944] {manager.py:558} INFO - Added Permission can create on Task Instances to role Admin
  300. [2021-10-14 04:01:55,956] {manager.py:558} INFO - Added Permission can edit on Task Instances to role Admin
  301. [2021-10-14 04:01:55,978] {manager.py:558} INFO - Added Permission can delete on Task Instances to role Admin
  302. [2021-10-14 04:01:55,987] {manager.py:558} INFO - Added Permission can create on DAG Runs to role Admin
  303. [2021-10-14 04:01:56,000] {manager.py:558} INFO - Added Permission can edit on DAG Runs to role Admin
  304. [2021-10-14 04:01:56,033] {manager.py:558} INFO - Added Permission can delete on DAG Runs to role Admin
  305. [2021-10-14 04:01:56,045] {manager.py:558} INFO - Added Permission can read on Configurations to role Admin
  306. [2021-10-14 04:01:56,081] {manager.py:558} INFO - Added Permission menu access on Admin to role Admin
  307. [2021-10-14 04:01:56,100] {manager.py:558} INFO - Added Permission menu access on Configurations to role Admin
  308. [2021-10-14 04:01:56,120] {manager.py:558} INFO - Added Permission menu access on Connections to role Admin
  309. [2021-10-14 04:01:56,134] {manager.py:558} INFO - Added Permission menu access on Pools to role Admin
  310. [2021-10-14 04:01:56,145] {manager.py:558} INFO - Added Permission menu access on Variables to role Admin
  311. [2021-10-14 04:01:56,157] {manager.py:558} INFO - Added Permission menu access on XComs to role Admin
  312. [2021-10-14 04:01:56,167] {manager.py:558} INFO - Added Permission can create on Connections to role Admin
  313. [2021-10-14 04:01:56,177] {manager.py:558} INFO - Added Permission can read on Connections to role Admin
  314. [2021-10-14 04:01:56,188] {manager.py:558} INFO - Added Permission can edit on Connections to role Admin
  315. [2021-10-14 04:01:56,198] {manager.py:558} INFO - Added Permission can delete on Connections to role Admin
  316. [2021-10-14 04:01:56,209] {manager.py:558} INFO - Added Permission can create on Pools to role Admin
  317. [2021-10-14 04:01:56,220] {manager.py:558} INFO - Added Permission can read on Pools to role Admin
  318. [2021-10-14 04:01:56,229] {manager.py:558} INFO - Added Permission can edit on Pools to role Admin
  319. [2021-10-14 04:01:56,242] {manager.py:558} INFO - Added Permission can delete on Pools to role Admin
  320. [2021-10-14 04:01:56,251] {manager.py:558} INFO - Added Permission can read on Providers to role Admin
  321. [2021-10-14 04:01:56,264] {manager.py:558} INFO - Added Permission can create on Variables to role Admin
  322. [2021-10-14 04:01:56,273] {manager.py:558} INFO - Added Permission can read on Variables to role Admin
  323. [2021-10-14 04:01:56,287] {manager.py:558} INFO - Added Permission can edit on Variables to role Admin
  324. [2021-10-14 04:01:56,299] {manager.py:558} INFO - Added Permission can delete on Variables to role Admin
  325. [2021-10-14 04:01:56,310] {manager.py:558} INFO - Added Permission can delete on XComs to role Admin
  326. [2021-10-14 04:01:56,343] {manager.py:496} INFO - Created Permission View: can read on Task Reschedules
  327. [2021-10-14 04:01:56,355] {manager.py:558} INFO - Added Permission can read on Task Reschedules to role Admin
  328. [2021-10-14 04:01:56,376] {manager.py:496} INFO - Created Permission View: menu access on Task Reschedules
  329. [2021-10-14 04:01:56,390] {manager.py:558} INFO - Added Permission menu access on Task Reschedules to role Admin
  330. [2021-10-14 04:01:56,421] {manager.py:496} INFO - Created Permission View: can read on Triggers
  331. [2021-10-14 04:01:56,429] {manager.py:558} INFO - Added Permission can read on Triggers to role Admin
  332. [2021-10-14 04:01:56,445] {manager.py:496} INFO - Created Permission View: menu access on Triggers
  333. [2021-10-14 04:01:56,476] {manager.py:558} INFO - Added Permission menu access on Triggers to role Admin
  334. [2021-10-14 04:01:56,496] {manager.py:496} INFO - Created Permission View: can read on Passwords
  335. [2021-10-14 04:01:56,530] {manager.py:558} INFO - Added Permission can read on Passwords to role Admin
  336. [2021-10-14 04:01:56,543] {manager.py:496} INFO - Created Permission View: can edit on Passwords
  337. [2021-10-14 04:01:56,566] {manager.py:558} INFO - Added Permission can edit on Passwords to role Admin
  338. [2021-10-14 04:01:56,577] {manager.py:558} INFO - Added Permission can read on Roles to role Admin
  339. [2021-10-14 04:01:56,589] {manager.py:558} INFO - Added Permission can edit on Roles to role Admin
  340. INFO [alembic.runtime.migration] Running upgrade 2c6edca13270 -> 61ec73d9401f, Add description field to connection
  341. INFO [alembic.runtime.migration] Running upgrade 61ec73d9401f -> 64a7d6477aae, fix description field in connection to be text
  342. INFO [alembic.runtime.migration] Running upgrade 64a7d6477aae -> e959f08ac86c, Change field in DagCode to MEDIUMTEXT for MySql
  343. INFO [alembic.runtime.migration] Running upgrade e959f08ac86c -> 82b7c48c147f, Remove can_read permission on config resource for User and Viewer role
  344. [2021-10-14 04:02:01,980] {manager.py:763} WARNING - No user yet created, use flask fab command to do it.
  345. INFO [alembic.runtime.migration] Running upgrade 82b7c48c147f -> 449b4072c2da, Increase size of connection.extra field to handle multiple RSA keys
  346. INFO [alembic.runtime.migration] Running upgrade 449b4072c2da -> 8646922c8a04, Change default pool_slots to 1
  347. INFO [alembic.runtime.migration] Running upgrade 8646922c8a04 -> 2e42bb497a22, rename last_scheduler_run column
  348. INFO [alembic.runtime.migration] Running upgrade 2e42bb497a22 -> 90d1635d7b86, Increase pool name size in TaskInstance
  349. INFO [alembic.runtime.migration] Running upgrade 90d1635d7b86 -> e165e7455d70, add description field to variable
  350. INFO [alembic.runtime.migration] Running upgrade e165e7455d70 -> a13f7613ad25, Resource based permissions for default FAB views.
  351. [2021-10-14 04:02:03,879] {manager.py:763} WARNING - No user yet created, use flask fab command to do it.
  352. INFO [alembic.runtime.migration] Running upgrade a13f7613ad25 -> 97cdd93827b8, Add queued_at column to dagrun table
  353. INFO [alembic.runtime.migration] Running upgrade 97cdd93827b8 -> 092435bf5d12, Add max_active_runs column to dagmodel table
  354. INFO [alembic.runtime.migration] Running upgrade 092435bf5d12 -> ccde3e26fe78, Add index on state, dag_id for queued dagrun
  355. INFO [alembic.runtime.migration] Running upgrade ccde3e26fe78 -> 83f031fd9f1c, improve mssql compatibility
  356. INFO [alembic.runtime.migration] Running upgrade 83f031fd9f1c -> e9304a3141f0, make xcom pkey columns non-nullable
  357. INFO [alembic.runtime.migration] Running upgrade e9304a3141f0 -> 30867afad44a, Rename concurrency column in dag table to max_active_tasks
  358. INFO [alembic.runtime.migration] Running upgrade 30867afad44a -> 54bebd308c5f, Add trigger table and task info
  359. INFO [alembic.runtime.migration] Running upgrade 54bebd308c5f -> 142555e44c17, Add data_interval_[start|end] to DagModel and DagRun.
  360. INFO [alembic.runtime.migration] Running upgrade 142555e44c17 -> 7b2661a43ba3, TaskInstance keyed to DagRun
  361. /usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/sqlalchemy/sql/schema.py:3722 SAWarning: Table '_alembic_tmp_task_instance' specifies columns 'task_id', 'dag_id' as primary_key=True, not matching locally specified columns 'dag_id', 'task_id', 'run_id'; setting the current primary key columns to 'dag_id', 'task_id', 'run_id'. This warning may become an exception in a future release
  362. WARNI [airflow.models.crypto] empty cryptography key - values will not be stored encrypted.
  363. INFO [airflow.models.dagbag.DagBag] Filling up the DagBag from /root/airflow/dags
  364. WARNI [unusual_prefix_1aad8b84145d4312cab1fa78d0874af875c88772_example_kubernetes_executor_config] Could not import DAGs in example_kubernetes_executor_config.py: No module named 'kubernetes'
  365. WARNI [unusual_prefix_1aad8b84145d4312cab1fa78d0874af875c88772_example_kubernetes_executor_config] Install kubernetes dependencies with: pip install apache-airflow['cncf.kubernetes']
  366. ERROR [airflow.models.dagbag.DagBag] Failed to import: /usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/example_dags/example_python_operator.py
  367. Traceback (most recent call last):
  368. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/models/dagbag.py", line 331, in _load_modules_from_file
  369. loader.exec_module(new_module)
  370. File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  371. File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  372. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/example_dags/example_python_operator.py", line 88, in <module>
  373. system_site_packages=False,
  374. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/models/baseoperator.py", line 188, in apply_defaults
  375. result = func(self, *args, **kwargs)
  376. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/operators/python.py", line 342, in __init__
  377. raise AirflowException('PythonVirtualenvOperator requires virtualenv, please install it.')
  378. airflow.exceptions.AirflowException: PythonVirtualenvOperator requires virtualenv, please install it.
  379. ERROR [airflow.models.dagbag.DagBag] Failed to import: /usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/example_dags/tutorial_taskflow_api_etl_virtualenv.py
  380. Traceback (most recent call last):
  381. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/models/dagbag.py", line 331, in _load_modules_from_file
  382. loader.exec_module(new_module)
  383. File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  384. File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  385. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/example_dags/tutorial_taskflow_api_etl_virtualenv.py", line 81, in <module>
  386. tutorial_etl_dag = tutorial_taskflow_api_etl_virtualenv()
  387. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/models/dag.py", line 2963, in factory
  388. f(**f_kwargs)
  389. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/example_dags/tutorial_taskflow_api_etl_virtualenv.py", line 76, in tutorial_taskflow_api_etl_virtualenv
  390. order_data = extract()
  391. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/decorators/base.py", line 224, in factory
  392. **kwargs,
  393. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/models/baseoperator.py", line 188, in apply_defaults
  394. result = func(self, *args, **kwargs)
  395. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/decorators/python_virtualenv.py", line 61, in __init__
  396. super().__init__(kwargs_to_upstream=kwargs_to_upstream, **kwargs)
  397. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/models/baseoperator.py", line 188, in apply_defaults
  398. result = func(self, *args, **kwargs)
  399. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/decorators/base.py", line 131, in __init__
  400. super().__init__(**kwargs_to_upstream, **kwargs)
  401. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/models/baseoperator.py", line 188, in apply_defaults
  402. result = func(self, *args, **kwargs)
  403. File "/usr/lib64/anaconda3/envs/python36/lib/python3.6/site-packages/airflow/operators/python.py", line 342, in __init__
  404. raise AirflowException('PythonVirtualenvOperator requires virtualenv, please install it.')
  405. airflow.exceptions.AirflowException: PythonVirtualenvOperator requires virtualenv, please install it.
  406. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_bash_operator
  407. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_bash_operator
  408. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_branch_datetime_operator_2
  409. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_branch_datetime_operator_2
  410. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_weekday_branch_operator
  411. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_weekday_branch_operator
  412. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_branch_labels
  413. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_branch_labels
  414. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_branch_operator
  415. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_branch_operator
  416. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_branch_dop_operator_v3
  417. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_branch_dop_operator_v3
  418. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_complex
  419. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_complex
  420. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_dag_decorator
  421. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_dag_decorator
  422. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_external_task_marker_parent
  423. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_external_task_marker_parent
  424. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_external_task_marker_child
  425. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_external_task_marker_child
  426. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_kubernetes_executor
  427. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_kubernetes_executor
  428. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:latest_only
  429. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:latest_only
  430. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:latest_only_with_trigger
  431. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:latest_only_with_trigger
  432. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_nested_branch_dag
  433. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_nested_branch_dag
  434. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_passing_params_via_test_command
  435. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_passing_params_via_test_command
  436. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_short_circuit_operator
  437. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_short_circuit_operator
  438. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_skip_dag
  439. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_skip_dag
  440. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_subdag_operator
  441. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_subdag_operator
  442. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_task_group
  443. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_task_group
  444. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_task_group_decorator
  445. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_task_group_decorator
  446. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_time_delta_sensor_async
  447. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_time_delta_sensor_async
  448. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_trigger_controller_dag
  449. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_trigger_controller_dag
  450. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_trigger_target_dag
  451. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_trigger_target_dag
  452. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_xcom
  453. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_xcom
  454. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_xcom_args
  455. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_xcom_args
  456. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:example_xcom_args_with_operators
  457. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:example_xcom_args_with_operators
  458. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:test_utils
  459. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:test_utils
  460. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:tutorial
  461. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:tutorial
  462. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:tutorial_etl_dag
  463. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:tutorial_etl_dag
  464. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can read on DAG:tutorial_taskflow_api_etl
  465. INFO [airflow.www.fab_security.sqla.manager] Created Permission View: can edit on DAG:tutorial_taskflow_api_etl
  466. INFO [airflow.models.dag] Sync 32 DAGs
  467. INFO [airflow.models.dag] Creating ORM DAG for example_branch_dop_operator_v3
  468. INFO [airflow.models.dag] Creating ORM DAG for example_subdag_operator.section-1
  469. INFO [airflow.models.dag] Creating ORM DAG for latest_only
  470. INFO [airflow.models.dag] Creating ORM DAG for example_trigger_target_dag
  471. INFO [airflow.models.dag] Creating ORM DAG for example_subdag_operator
  472. INFO [airflow.models.dag] Creating ORM DAG for tutorial_taskflow_api_etl
  473. INFO [airflow.models.dag] Creating ORM DAG for example_xcom_args_with_operators
  474. INFO [airflow.models.dag] Creating ORM DAG for latest_only_with_trigger
  475. INFO [airflow.models.dag] Creating ORM DAG for example_xcom
  476. INFO [airflow.models.dag] Creating ORM DAG for tutorial
  477. INFO [airflow.models.dag] Creating ORM DAG for example_short_circuit_operator
  478. INFO [airflow.models.dag] Creating ORM DAG for example_task_group_decorator
  479. INFO [airflow.models.dag] Creating ORM DAG for tutorial_etl_dag
  480. INFO [airflow.models.dag] Creating ORM DAG for example_nested_branch_dag
  481. INFO [airflow.models.dag] Creating ORM DAG for example_branch_datetime_operator_2
  482. INFO [airflow.models.dag] Creating ORM DAG for example_bash_operator
  483. INFO [airflow.models.dag] Creating ORM DAG for example_time_delta_sensor_async
  484. INFO [airflow.models.dag] Creating ORM DAG for example_branch_labels
  485. INFO [airflow.models.dag] Creating ORM DAG for example_trigger_controller_dag
  486. INFO [airflow.models.dag] Creating ORM DAG for test_utils
  487. INFO [airflow.models.dag] Creating ORM DAG for example_dag_decorator
  488. INFO [airflow.models.dag] Creating ORM DAG for example_kubernetes_executor
  489. INFO [airflow.models.dag] Creating ORM DAG for example_passing_params_via_test_command
  490. INFO [airflow.models.dag] Creating ORM DAG for example_complex
  491. INFO [airflow.models.dag] Creating ORM DAG for example_xcom_args
  492. INFO [airflow.models.dag] Creating ORM DAG for example_branch_operator
  493. INFO [airflow.models.dag] Creating ORM DAG for example_weekday_branch_operator
  494. INFO [airflow.models.dag] Creating ORM DAG for example_external_task_marker_child
  495. INFO [airflow.models.dag] Creating ORM DAG for example_skip_dag
  496. INFO [airflow.models.dag] Creating ORM DAG for example_subdag_operator.section-2
  497. INFO [airflow.models.dag] Creating ORM DAG for example_task_group
  498. INFO [airflow.models.dag] Creating ORM DAG for example_external_task_marker_parent
  499. INFO [airflow.models.dag] Setting next_dagrun for example_bash_operator to 2021-10-13 00:00:00+00:00
  500. INFO [airflow.models.dag] Setting next_dagrun for example_branch_datetime_operator_2 to 2021-10-13 00:00:00+00:00
  501. INFO [airflow.models.dag] Setting next_dagrun for example_branch_dop_operator_v3 to 2021-10-14T08:01:00+00:00
  502. INFO [airflow.models.dag] Setting next_dagrun for example_branch_labels to 2021-10-13 00:00:00+00:00
  503. INFO [airflow.models.dag] Setting next_dagrun for example_branch_operator to 2021-10-13 00:00:00+00:00
  504. INFO [airflow.models.dag] Setting next_dagrun for example_complex to None
  505. INFO [airflow.models.dag] Setting next_dagrun for example_dag_decorator to None
  506. INFO [airflow.models.dag] Setting next_dagrun for example_external_task_marker_child to None
  507. INFO [airflow.models.dag] Setting next_dagrun for example_external_task_marker_parent to None
  508. INFO [airflow.models.dag] Setting next_dagrun for example_kubernetes_executor to None
  509. INFO [airflow.models.dag] Setting next_dagrun for example_nested_branch_dag to 2021-10-13 00:00:00+00:00
  510. INFO [airflow.models.dag] Setting next_dagrun for example_passing_params_via_test_command to 2021-10-14T08:01:00+00:00
  511. INFO [airflow.models.dag] Setting next_dagrun for example_short_circuit_operator to 2021-10-13T08:02:08.681118+00:00
  512. INFO [airflow.models.dag] Setting next_dagrun for example_skip_dag to 2021-10-13T08:02:08.681608+00:00
  513. INFO [airflow.models.dag] Setting next_dagrun for example_subdag_operator to 2021-10-12T00:00:00+00:00
  514. INFO [airflow.models.dag] Setting next_dagrun for example_subdag_operator.section-1 to None
  515. INFO [airflow.models.dag] Setting next_dagrun for example_subdag_operator.section-2 to None
  516. INFO [airflow.models.dag] Setting next_dagrun for example_task_group to 2021-10-13T08:02:08.682640+00:00
  517. INFO [airflow.models.dag] Setting next_dagrun for example_task_group_decorator to 2021-10-13T08:02:08.683165+00:00
  518. INFO [airflow.models.dag] Setting next_dagrun for example_time_delta_sensor_async to None
  519. INFO [airflow.models.dag] Setting next_dagrun for example_trigger_controller_dag to 2021-01-01T00:00:00+00:00
  520. INFO [airflow.models.dag] Setting next_dagrun for example_trigger_target_dag to None
  521. INFO [airflow.models.dag] Setting next_dagrun for example_weekday_branch_operator to 2021-10-13 00:00:00+00:00
  522. INFO [airflow.models.dag] Setting next_dagrun for example_xcom to 2021-01-01T00:00:00+00:00
  523. INFO [airflow.models.dag] Setting next_dagrun for example_xcom_args to None
  524. INFO [airflow.models.dag] Setting next_dagrun for example_xcom_args_with_operators to None
  525. INFO [airflow.models.dag] Setting next_dagrun for latest_only to 2021-10-14T04:02:08.689309+00:00
  526. INFO [airflow.models.dag] Setting next_dagrun for latest_only_with_trigger to 2021-10-14T04:02:08.690262+00:00
  527. INFO [airflow.models.dag] Setting next_dagrun for test_utils to None
  528. INFO [airflow.models.dag] Setting next_dagrun for tutorial to 2021-10-13T08:02:08.691102+00:00
  529. INFO [airflow.models.dag] Setting next_dagrun for tutorial_etl_dag to None
  530. INFO [airflow.models.dag] Setting next_dagrun for tutorial_taskflow_api_etl to None
  531. INFO [airflow.models.dag] Sync 2 DAGs
  532. INFO [airflow.models.dag] Setting next_dagrun for example_subdag_operator.section-1 to None
  533. INFO [airflow.models.dag] Setting next_dagrun for example_subdag_operator.section-2 to None
  534. Initialization done
  535. (python36) [root@bogon pip]#

 出现了Initialization done表示安装成功,某些情况下会保这样的错误:
Airflow db init ERROR - Failed to add operation for GET /api/v1/connections
解决方法:回退到SQLAlchemy版本


5.新建用户

airflow users create --username airflow --firstname abc --lastname abc --role Admin --email abc

  1. (python36) [root@bogon pip]# airflow users create --username airflow --firstname abc --lastname abc --role Admin --email abc
  2. [2021-10-14 04:16:47,596] {manager.py:763} WARNING - No user yet created, use flask fab command to do it.
  3. [2021-10-14 04:16:47,816] {manager.py:496} INFO - Created Permission View: menu access on List Users
  4. [2021-10-14 04:16:47,834] {manager.py:558} INFO - Added Permission menu access on List Users to role Admin
  5. [2021-10-14 04:16:47,874] {manager.py:496} INFO - Created Permission View: menu access on Security
  6. [2021-10-14 04:16:47,890] {manager.py:558} INFO - Added Permission menu access on Security to role Admin
  7. [2021-10-14 04:16:48,003] {manager.py:496} INFO - Created Permission View: menu access on List Roles
  8. [2021-10-14 04:16:48,031] {manager.py:558} INFO - Added Permission menu access on List Roles to role Admin
  9. [2021-10-14 04:16:48,067] {manager.py:496} INFO - Created Permission View: can read on User Stats Chart
  10. [2021-10-14 04:16:48,079] {manager.py:558} INFO - Added Permission can read on User Stats Chart to role Admin
  11. [2021-10-14 04:16:48,114] {manager.py:496} INFO - Created Permission View: menu access on User's Statistics
  12. [2021-10-14 04:16:48,147] {manager.py:558} INFO - Added Permission menu access on User's Statistics to role Admin
  13. [2021-10-14 04:16:48,216] {manager.py:496} INFO - Created Permission View: menu access on Base Permissions
  14. [2021-10-14 04:16:48,242] {manager.py:558} INFO - Added Permission menu access on Base Permissions to role Admin
  15. [2021-10-14 04:16:48,303] {manager.py:496} INFO - Created Permission View: can read on View Menus
  16. [2021-10-14 04:16:48,319] {manager.py:558} INFO - Added Permission can read on View Menus to role Admin
  17. [2021-10-14 04:16:48,345] {manager.py:496} INFO - Created Permission View: menu access on Views/Menus
  18. [2021-10-14 04:16:48,362] {manager.py:558} INFO - Added Permission menu access on Views/Menus to role Admin
  19. [2021-10-14 04:16:48,418] {manager.py:496} INFO - Created Permission View: can read on Permission Views
  20. [2021-10-14 04:16:48,442] {manager.py:558} INFO - Added Permission can read on Permission Views to role Admin
  21. [2021-10-14 04:16:48,486] {manager.py:496} INFO - Created Permission View: menu access on Permission on Views/Menus
  22. [2021-10-14 04:16:48,518] {manager.py:558} INFO - Added Permission menu access on Permission on Views/Menus to role Admin
  23. [2021-10-14 04:16:48,565] {manager.py:496} INFO - Created Permission View: can get on MenuApi
  24. [2021-10-14 04:16:48,585] {manager.py:558} INFO - Added Permission can get on MenuApi to role Admin
  25. [2021-10-14 04:16:48,720] {manager.py:512} WARNING - Refused to delete permission view, assoc with role exists DAG Runs.can_create Admin
  26. [2021-10-14 04:16:49,079] {manager.py:496} INFO - Created Permission View: menu access on Providers
  27. [2021-10-14 04:16:49,092] {manager.py:558} INFO - Added Permission menu access on Providers to role Admin
  28. [2021-10-14 04:16:49,182] {manager.py:496} INFO - Created Permission View: can create on XComs
  29. [2021-10-14 04:16:49,193] {manager.py:558} INFO - Added Permission can create on XComs to role Admin
  30. Password:
  31. Repeat for confirmation:
  32. [2021-10-14 04:16:59,488] {manager.py:214} INFO - Added user airflow
  33. User "airflow" created with role "Admin"
  34. (python36) [root@bogon pip]#

执行这个命令后会 提示输入密码,我使用的密码是airflow,千万记好这个密码,密码需要输入两次且一致,后面在登陆airflow web UI时会使用到。

6.启动调度器

这里只是测试,正常情况下应该用后台运行的方式启动服务,加 -D参数,即:
airflow scheduler -D
 

7.启动web服务 

airflow webserver -p 10000 
-p 10000表示使用10000端口 

 可以看到已经启动了4个worker,端口分别是3237、3238、3229、3240
这里只是测试,正常情况下应该用后台运行的方式启动服务,加 -D参数,即:
airflow webserver -D


8. 验证

在宿主机上用浏览器打开http://192.168.43.61:10000/home 

 OK,到这里已经成功安装好了airflow,这里默认使用的是SQLite数据库,其实还可以使用MYSQL。

声明:本文内容由网友自发贡献,不代表【wpsshop博客】立场,版权归原作者所有,本站不承担相应法律责任。如您发现有侵权的内容,请联系我们。转载请注明出处:https://www.wpsshop.cn/w/凡人多烦事01/article/detail/265259
推荐阅读
相关标签
  

闽ICP备14008679号