devbox
我家小花儿
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

k8s kubeadm在安装 基于arm架构

作者：我家小花儿 | 2024-06-16 19:45:05

赞

踩

k8s kubeadm在安装 基于arm架构
目录

k8s kubeadm在安装 基于arm架构

第一章 k8s及中间件安装

1.主机名解析
  1. 10.129.148.4 hangkong-k8s-node01
  2. 10.129.148.5 hangkong-k8s-node02
  3. 10.129.148.6 hangkong-k8s-node03
  4. 10.129.148.4 hangkong-k8s.vip.com
2.主机名设置
  1. echo 'hangkong-k8s-node01' > /etc/hostname
  2. echo 'hangkong-k8s-node02' > /etc/hostname
  3. echo 'hangkong-k8s-node03' > /etc/hostname
  4.  
  5. hostname hangkong-k8s-node01
  6. hostname hangkong-k8s-node02
  7. hostname hangkong-k8s-node03
3.禁用iptables和firewalld
  1. systemctl stop firewalld
  2. systemctl disable firewalld 
  3. systemctl stop iptables
  4. systemctl disable iptables
4. 禁用selinux(linux下的一个安全服务，必须禁用)
  1. vim /etc/selinux/config
  2. SELINUX=disabled  
  3. setenforce 0
5.禁用swap分区(主要是注释最后一行)
  1. vim /etc/fstab
  2. UUID=455cc753-7a60-4c17-a424-7741728c44a1 /boot    xfs     defaults        0 0
  3. /dev/mapper/centos-home /home                      xfs     defaults        0 0
  4. # /dev/mapper/centos-swap swap                      swap    defaults        0 0 //注释这条
6.修改系统的内核参数
  1. vim /etc/sysctl.conf
  2.  
  3. 添加以下内容：
  4. net.bridge.bridge-nf-call-ip6tables = 1
  5. net.bridge.bridge-nf-call-iptables = 1
  6. 修改net.ipv4.ip_forward = 1
  7.  
  8.  
  9. 重新加载配置：
  10. sysctl -p
  11.  
  12. 加载网桥过滤模块：
  13. modprobe br_netfilter
  14.  
  15. 查看网桥过滤模块是否加载成功：
  16. lsmod | grep br_netfilter
7.配置ipvs功能
  1. dnf install ipvsadm
  2.  
  3. 添加需要加载的模块写入脚本文件：
  4.  
  5.  
  6. cat <<EOF >  /etc/sysconfig/modules/ipvs.modules
  7.  
  8. #!/bin/bash
  9. modprobe -- ip_vs
  10. modprobe -- ip_vs_rr
  11. modprobe -- ip_vs_wrr
  12. modprobe -- ip_vs_sh
  13. modprobe -- nf_conntrack
  14.  
  15. EOF
  16.  
  17.  
  18.  
  19. 为脚本文件添加执行权限：
  20. chmod +x /etc/sysconfig/modules/ipvs.modules
  21.  
  22. 执行脚本文件：
  23. /bin/bash /etc/sysconfig/modules/ipvs.modules
  24.  
  25. 查看对应的模块是否加载成功：
  26. lsmod | grep -e ip_vs -e nf_conntrack
8.安装docker
  1. 下载安装包
  2.  
  3. wget https://download.docker.com/linux/static/stable/aarch64/docker-20.10.19.tgz
  4. 安装
  5.  
  6. tar -xzf docker-20.10.19.tgz
  7. 移动解压后的全部内容到/usr/bin/下
  8.  
  9. mv docker/* /usr/bin/
  10.  
  11. 编辑docker.service文件
  12. vi /usr/lib/systemd/system/docker.service
  13. [Unit]
  14.   
  15. Description=Docker Application Container Engine
  16. Documentation=https://docs.docker.com
  17. After=network-online.target firewalld.service
  18. Wants=network-online.target
  19.   
  20. [Service]
  21. Type=notify
  22. ExecStart=/usr/bin/dockerd
  23. ExecReload=/bin/kill -s HUP $MAINPID
  24. LimitNOFILE=infinity
  25. LimitNPROC=infinity
  26. TimeoutStartSec=0
  27. Delegate=yes
  28. KillMode=process
  29. Restart=on-failure
  30. StartLimitBurst=3
  31. StartLimitInterval=60s
  32.   
  33. [Install]
  34. WantedBy=multi-user.target
  35.  
  36.  
  37. 添加docker.service文件的权限
  38.  
  39. chmod +x /usr/lib/systemd/system/docker.service
  40. systemctl daemon-reload
  41.  
  42. 创建daemon.json文件
  43. mkdir /etc/docker
  44. vim daemon.json
  45.  
  46. {
  47.     "live-restore": true,
  48.     "exec-opts": ["native.cgroupdriver=systemd"],
  49.     "log-driver": "json-file",
  50.     "graph":"/data/docker/graph",
  51.     "registry-mirrors": ["https://v16stybc.mirror.aliyuncs.com"],
  52.     "insecure-registries": ["192.168.8.73:18888","uat-harbor.bigfintax.com"],
  53.     "log-opts": {
  54.        "max-size": "100m"
  55.     },
  56.     "storage-driver": "overlay2",
  57.     "storage-opts": [
  58.     "overlay2.override_kernel_check=true"
  59.     ]
  60. }
  61.  
  62.  
  63.  
  64.  
  65.  
  66. reload内容、启动docker、设置开机启动
  67. systemctl daemon-reload
  68. systemctl start docker
  69. systemctl enable docker
  70.  
  71.  
  72. 验证docker安装是否成功
  73. docker -v  &&.  docker info
9.安装kubernetes1.23.9
  1. [root@hangkong-k8s-node02 kubernetes]# pwd
  2. /root/package/kubernetes
  3. [root@hangkong-k8s-node02 kubernetes]#
  4. [root@hangkong-k8s-node02 kubernetes]# ls -l
  5. total 68408
  6. -rw-r--r-- 1 root root  9014454 May 10 13:54 3f5ba2b53701ac9102ea7c7ab2ca6616a8cd5966591a77577585fde1c434ef74-cri-tools-1.26.0-0.x86_64.rpm
  7. -rw-r--r-- 1 root root  9921370 May 10 13:54 49658d033fddfa48e1345c21498197642b376412bfa4ba72ce36eb3f360f81d7-kubectl-1.23.9-0.x86_64.rpm
  8. -rw-r--r-- 1 root root  9476670 May 10 13:54 4f2cd27ecd6913e34408df70f465a104feb1fbe1f73c8d828ce5bd0ab9c37c3c-kubeadm-1.23.9-0.x86_64.rpm
  9. -rw-r--r-- 1 root root   208824 May 10 13:53 conntrack-tools-1.4.4-10.el8.x86_64.rpm
  10. -rw-r--r-- 1 root root 21510866 May 10 13:56 d3abccc1e93912e877085abf9e1daa3e2b3b2bb360df93eb6411510e81c9399c-kubelet-1.23.9-0.x86_64.rpm
  11. -rw-r--r-- 1 root root 19487362 May 10 13:57 db7cb5cb0b3f6875f54d10f02e625573988e3e91fd4fc5eef0b1876bb18604ad-kubernetes-cni-0.8.7-0.x86_64.rpm
  12. -rw-r--r-- 1 root root    24660 May 10 13:53 libnetfilter_cthelper-1.0.0-15.el8.x86_64.rpm
  13. -rw-r--r-- 1 root root    24700 May 10 13:53 libnetfilter_cttimeout-1.0.0-11.el8.x86_64.rpm
  14. -rw-r--r-- 1 root root    31976 May 10 13:53 libnetfilter_queue-1.0.4-3.el8.x86_64.rpm
  15. -rw-r--r-- 1 root root   330692 May 10 13:53 socat-1.7.4.1-1.el8.x86_64.rpm
  16. [root@hangkong-k8s-node02 kubernetes]#
  17. [root@hangkong-k8s-node02 kubernetes]# yum localinstall *^C
  18. [root@hangkong-k8s-node02 kubernetes]#
  19. [root@hangkong-k8s-node02 kubernetes]# rpm -qa|grep kube
  20. kubectl-1.23.9-0.x86_64
  21. kubelet-1.23.9-0.x86_64
  22. kubernetes-cni-0.8.7-0.x86_64
  23. kubeadm-1.23.9-0.x86_64
10. 集群初始化
  1. kubeadm init --control-plane-endpoint  hangkong-k8s.vip.com:6443  --image-repository registry.aliyuncs.com/google_containers --service-cidr=10.96.0.0/16 --pod-network-cidr=10.244.0.0/16 --kubernetes-version=1.23.9 --upload-certs
  2.  
  3.  
  4.  
  5. master可以调度
  6.  
  7. kubectl taint node hangkong-k8s-node01 node-role.kubernetes.io/master-
11. 安装ingress

编辑ingress的 yaml

  1. apiVersion: v1
  2. kind: Namespace
  3. metadata:
  4.   name: ingress-nginx
  5.   labels:
  6.     app.kubernetes.io/name: ingress-nginx
  7.     app.kubernetes.io/instance: ingress-nginx
  8.  
  9. ---
  10. # Source: ingress-nginx/templates/controller-serviceaccount.yaml
  11. apiVersion: v1
  12. kind: ServiceAccount
  13. metadata:
  14.   labels:
  15.     helm.sh/chart: ingress-nginx-4.0.15
  16.     app.kubernetes.io/name: ingress-nginx
  17.     app.kubernetes.io/instance: ingress-nginx
  18.     app.kubernetes.io/version: 1.1.1
  19.     app.kubernetes.io/managed-by: Helm
  20.     app.kubernetes.io/component: controller
  21.   name: ingress-nginx
  22.   namespace: ingress-nginx
  23. automountServiceAccountToken: true
  24. ---
  25. # Source: ingress-nginx/templates/controller-configmap.yaml
  26. apiVersion: v1
  27. kind: ConfigMap
  28. metadata:
  29.   labels:
  30.     helm.sh/chart: ingress-nginx-4.0.15
  31.     app.kubernetes.io/name: ingress-nginx
  32.     app.kubernetes.io/instance: ingress-nginx
  33.     app.kubernetes.io/version: 1.1.1
  34.     app.kubernetes.io/managed-by: Helm
  35.     app.kubernetes.io/component: controller
  36.   name: ingress-nginx-controller
  37.   namespace: ingress-nginx
  38. data:
  39.   allow-snippet-annotations: 'true'
  40. ---
  41. # Source: ingress-nginx/templates/clusterrole.yaml
  42. apiVersion: rbac.authorization.k8s.io/v1
  43. kind: ClusterRole
  44. metadata:
  45.   labels:
  46.     helm.sh/chart: ingress-nginx-4.0.15
  47.     app.kubernetes.io/name: ingress-nginx
  48.     app.kubernetes.io/instance: ingress-nginx
  49.     app.kubernetes.io/version: 1.1.1
  50.     app.kubernetes.io/managed-by: Helm
  51.   name: ingress-nginx
  52. rules:
  53.   - apiGroups:
  54.       - ''
  55.     resources:
  56.       - configmaps
  57.       - endpoints
  58.       - nodes
  59.       - pods
  60.       - secrets
  61.       - namespaces
  62.     verbs:
  63.       - list
  64.       - watch
  65.   - apiGroups:
  66.       - ''
  67.     resources:
  68.       - nodes
  69.     verbs:
  70.       - get
  71.   - apiGroups:
  72.       - ''
  73.     resources:
  74.       - services
  75.     verbs:
  76.       - get
  77.       - list
  78.       - watch
  79.   - apiGroups:
  80.       - networking.k8s.io
  81.     resources:
  82.       - ingresses
  83.     verbs:
  84.       - get
  85.       - list
  86.       - watch
  87.   - apiGroups:
  88.       - ''
  89.     resources:
  90.       - events
  91.     verbs:
  92.       - create
  93.       - patch
  94.   - apiGroups:
  95.       - networking.k8s.io
  96.     resources:
  97.       - ingresses/status
  98.     verbs:
  99.       - update
  100.   - apiGroups:
  101.       - networking.k8s.io
  102.     resources:
  103.       - ingressclasses
  104.     verbs:
  105.       - get
  106.       - list
  107.       - watch
  108. ---
  109. # Source: ingress-nginx/templates/clusterrolebinding.yaml
  110. apiVersion: rbac.authorization.k8s.io/v1
  111. kind: ClusterRoleBinding
  112. metadata:
  113.   labels:
  114.     helm.sh/chart: ingress-nginx-4.0.15
  115.     app.kubernetes.io/name: ingress-nginx
  116.     app.kubernetes.io/instance: ingress-nginx
  117.     app.kubernetes.io/version: 1.1.1
  118.     app.kubernetes.io/managed-by: Helm
  119.   name: ingress-nginx
  120. roleRef:
  121.   apiGroup: rbac.authorization.k8s.io
  122.   kind: ClusterRole
  123.   name: ingress-nginx
  124. subjects:
  125.   - kind: ServiceAccount
  126.     name: ingress-nginx
  127.     namespace: ingress-nginx
  128. ---
  129. # Source: ingress-nginx/templates/controller-role.yaml
  130. apiVersion: rbac.authorization.k8s.io/v1
  131. kind: Role
  132. metadata:
  133.   labels:
  134.     helm.sh/chart: ingress-nginx-4.0.15
  135.     app.kubernetes.io/name: ingress-nginx
  136.     app.kubernetes.io/instance: ingress-nginx
  137.     app.kubernetes.io/version: 1.1.1
  138.     app.kubernetes.io/managed-by: Helm
  139.     app.kubernetes.io/component: controller
  140.   name: ingress-nginx
  141.   namespace: ingress-nginx
  142. rules:
  143.   - apiGroups:
  144.       - ''
  145.     resources:
  146.       - namespaces
  147.     verbs:
  148.       - get
  149.   - apiGroups:
  150.       - ''
  151.     resources:
  152.       - configmaps
  153.       - pods
  154.       - secrets
  155.       - endpoints
  156.     verbs:
  157.       - get
  158.       - list
  159.       - watch
  160.   - apiGroups:
  161.       - ''
  162.     resources:
  163.       - services
  164.     verbs:
  165.       - get
  166.       - list
  167.       - watch
  168.   - apiGroups:
  169.       - networking.k8s.io
  170.     resources:
  171.       - ingresses
  172.     verbs:
  173.       - get
  174.       - list
  175.       - watch
  176.   - apiGroups:
  177.       - networking.k8s.io
  178.     resources:
  179.       - ingresses/status
  180.     verbs:
  181.       - update
  182.   - apiGroups:
  183.       - networking.k8s.io
  184.     resources:
  185.       - ingressclasses
  186.     verbs:
  187.       - get
  188.       - list
  189.       - watch
  190.   - apiGroups:
  191.       - ''
  192.     resources:
  193.       - configmaps
  194.     resourceNames:
  195.       - ingress-controller-leader
  196.     verbs:
  197.       - get
  198.       - update
  199.   - apiGroups:
  200.       - ''
  201.     resources:
  202.       - configmaps
  203.     verbs:
  204.       - create
  205.   - apiGroups:
  206.       - ''
  207.     resources:
  208.       - events
  209.     verbs:
  210.       - create
  211.       - patch
  212. ---
  213. # Source: ingress-nginx/templates/controller-rolebinding.yaml
  214. apiVersion: rbac.authorization.k8s.io/v1
  215. kind: RoleBinding
  216. metadata:
  217.   labels:
  218.     helm.sh/chart: ingress-nginx-4.0.15
  219.     app.kubernetes.io/name: ingress-nginx
  220.     app.kubernetes.io/instance: ingress-nginx
  221.     app.kubernetes.io/version: 1.1.1
  222.     app.kubernetes.io/managed-by: Helm
  223.     app.kubernetes.io/component: controller
  224.   name: ingress-nginx
  225.   namespace: ingress-nginx
  226. roleRef:
  227.   apiGroup: rbac.authorization.k8s.io
  228.   kind: Role
  229.   name: ingress-nginx
  230. subjects:
  231.   - kind: ServiceAccount
  232.     name: ingress-nginx
  233.     namespace: ingress-nginx
  234. ---
  235. # Source: ingress-nginx/templates/controller-service-webhook.yaml
  236. apiVersion: v1
  237. kind: Service
  238. metadata:
  239.   labels:
  240.     helm.sh/chart: ingress-nginx-4.0.15
  241.     app.kubernetes.io/name: ingress-nginx
  242.     app.kubernetes.io/instance: ingress-nginx
  243.     app.kubernetes.io/version: 1.1.1
  244.     app.kubernetes.io/managed-by: Helm
  245.     app.kubernetes.io/component: controller
  246.   name: ingress-nginx-controller-admission
  247.   namespace: ingress-nginx
  248. spec:
  249.   type: ClusterIP
  250.   ports:
  251.     - name: https-webhook
  252.       port: 443
  253.       targetPort: webhook
  254.       appProtocol: https
  255.   selector:
  256.     app.kubernetes.io/name: ingress-nginx
  257.     app.kubernetes.io/instance: ingress-nginx
  258.     app.kubernetes.io/component: controller
  259. ---
  260. # Source: ingress-nginx/templates/controller-service.yaml
  261. apiVersion: v1
  262. kind: Service
  263. metadata:
  264.   annotations:
  265.   labels:
  266.     helm.sh/chart: ingress-nginx-4.0.15
  267.     app.kubernetes.io/name: ingress-nginx
  268.     app.kubernetes.io/instance: ingress-nginx
  269.     app.kubernetes.io/version: 1.1.1
  270.     app.kubernetes.io/managed-by: Helm
  271.     app.kubernetes.io/component: controller
  272.   name: ingress-nginx-controller
  273.   namespace: ingress-nginx
  274. spec:
  275.   type: LoadBalancer
  276.   externalTrafficPolicy: Local
  277.   ipFamilyPolicy: SingleStack
  278.   ipFamilies:
  279.     - IPv4
  280.   ports:
  281.     - name: http
  282.       port: 80
  283.       protocol: TCP
  284.       targetPort: http
  285.       appProtocol: http
  286.     - name: https
  287.       port: 443
  288.       protocol: TCP
  289.       targetPort: https
  290.       appProtocol: https
  291.   selector:
  292.     app.kubernetes.io/name: ingress-nginx
  293.     app.kubernetes.io/instance: ingress-nginx
  294.     app.kubernetes.io/component: controller
  295. ---
  296. # Source: ingress-nginx/templates/controller-deployment.yaml
  297. apiVersion: apps/v1
  298. kind: Deployment
  299. metadata:
  300.   labels:
  301.     helm.sh/chart: ingress-nginx-4.0.15
  302.     app.kubernetes.io/name: ingress-nginx
  303.     app.kubernetes.io/instance: ingress-nginx
  304.     app.kubernetes.io/version: 1.1.1
  305.     app.kubernetes.io/managed-by: Helm
  306.     app.kubernetes.io/component: controller
  307.   name: ingress-nginx-controller
  308.   namespace: ingress-nginx
  309. spec:
  310.   replicas: 3
  311.   selector:
  312.     matchLabels:
  313.       app.kubernetes.io/name: ingress-nginx
  314.       app.kubernetes.io/instance: ingress-nginx
  315.       app.kubernetes.io/component: controller
  316.   revisionHistoryLimit: 10
  317.   minReadySeconds: 0
  318.   template:
  319.     metadata:
  320.       labels:
  321.         app.kubernetes.io/name: ingress-nginx
  322.         app.kubernetes.io/instance: ingress-nginx
  323.         app.kubernetes.io/component: controller
  324.     spec:
  325.       dnsPolicy: ClusterFirst
  326.       containers:
  327.         - name: controller
  328.           #image: registry.baidubce.com/k8s.gcr.io/ingress-nginx/controller:v1.1.0
  329.           image: aaa.big.com/ingress-nginx-arm/ingress-nginx-controller:v1.1.1
  330.           imagePullPolicy: IfNotPresent
  331.           lifecycle:
  332.             preStop:
  333.               exec:
  334.                 command:
  335.                   - /wait-shutdown
  336.           args:
  337.             - /nginx-ingress-controller
  338.             - --publish-service=$(POD_NAMESPACE)/ingress-nginx-controller
  339.             - --election-id=ingress-controller-leader
  340.             - --controller-class=k8s.io/ingress-nginx
  341.             - --configmap=$(POD_NAMESPACE)/ingress-nginx-controller
  342.             - --validating-webhook=:8443
  343.             - --validating-webhook-certificate=/usr/local/certificates/cert
  344.             - --validating-webhook-key=/usr/local/certificates/key
  345.           securityContext:
  346.             capabilities:
  347.               drop:
  348.                 - ALL
  349.               add:
  350.                 - NET_BIND_SERVICE
  351.             runAsUser: 101
  352.             allowPrivilegeEscalation: true
  353.           env:
  354.             - name: POD_NAME
  355.               valueFrom:
  356.                 fieldRef:
  357.                   fieldPath: metadata.name
  358.             - name: POD_NAMESPACE
  359.               valueFrom:
  360.                 fieldRef:
  361.                   fieldPath: metadata.namespace
  362.             - name: LD_PRELOAD
  363.               value: /usr/local/lib/libmimalloc.so
  364.           livenessProbe:
  365.             failureThreshold: 5
  366.             httpGet:
  367.               path: /healthz
  368.               port: 10254
  369.               scheme: HTTP
  370.             initialDelaySeconds: 10
  371.             periodSeconds: 10
  372.             successThreshold: 1
  373.             timeoutSeconds: 1
  374.           readinessProbe:
  375.             failureThreshold: 3
  376.             httpGet:
  377.               path: /healthz
  378.               port: 10254
  379.               scheme: HTTP
  380.             initialDelaySeconds: 10
  381.             periodSeconds: 10
  382.             successThreshold: 1
  383.             timeoutSeconds: 1
  384.           ports:
  385.             - name: http
  386.               containerPort: 80
  387.               hostPort: 80
  388.               protocol: TCP
  389.             - name: https
  390.               containerPort: 443
  391.               hostPort: 443
  392.               protocol: TCP
  393.             - name: webhook
  394.               containerPort: 8443
  395.               protocol: TCP
  396.           volumeMounts:
  397.             - name: webhook-cert
  398.               mountPath: /usr/local/certificates/
  399.               readOnly: true
  400.           resources:
  401.             requests:
  402.               cpu: 100m
  403.               memory: 90Mi
  404.       nodeSelector:
  405.         kubernetes.io/os: linux
  406.       serviceAccountName: ingress-nginx
  407.       terminationGracePeriodSeconds: 300
  408.       volumes:
  409.         - name: webhook-cert
  410.           secret:
  411.             secretName: ingress-nginx-admission
  412. ---
  413. # Source: ingress-nginx/templates/controller-ingressclass.yaml
  414. # We don't support namespaced ingressClass yet
  415. # So a ClusterRole and a ClusterRoleBinding is required
  416. apiVersion: networking.k8s.io/v1
  417. kind: IngressClass
  418. metadata:
  419.   labels:
  420.     helm.sh/chart: ingress-nginx-4.0.15
  421.     app.kubernetes.io/name: ingress-nginx
  422.     app.kubernetes.io/instance: ingress-nginx
  423.     app.kubernetes.io/version: 1.1.1
  424.     app.kubernetes.io/managed-by: Helm
  425.     app.kubernetes.io/component: controller
  426.   name: nginx
  427.   namespace: ingress-nginx
  428. spec:
  429.   controller: k8s.io/ingress-nginx
  430. ---
  431. # Source: ingress-nginx/templates/admission-webhooks/validating-webhook.yaml
  432. # before changing this value, check the required kubernetes version
  433. # https://kubernetes.io/docs/reference/access-authn-authz/extensible-admission-controllers/#prerequisites
  434. apiVersion: admissionregistration.k8s.io/v1
  435. kind: ValidatingWebhookConfiguration
  436. metadata:
  437.   labels:
  438.     helm.sh/chart: ingress-nginx-4.0.15
  439.     app.kubernetes.io/name: ingress-nginx
  440.     app.kubernetes.io/instance: ingress-nginx
  441.     app.kubernetes.io/version: 1.1.1
  442.     app.kubernetes.io/managed-by: Helm
  443.     app.kubernetes.io/component: admission-webhook
  444.   name: ingress-nginx-admission
  445. webhooks:
  446.   - name: validate.nginx.ingress.kubernetes.io
  447.     matchPolicy: Equivalent
  448.     rules:
  449.       - apiGroups:
  450.           - networking.k8s.io
  451.         apiVersions:
  452.           - v1
  453.         operations:
  454.           - CREATE
  455.           - UPDATE
  456.         resources:
  457.           - ingresses
  458.     failurePolicy: Fail
  459.     sideEffects: None
  460.     admissionReviewVersions:
  461.       - v1
  462.     clientConfig:
  463.       service:
  464.         namespace: ingress-nginx
  465.         name: ingress-nginx-controller-admission
  466.         path: /networking/v1/ingresses
  467. ---
  468. # Source: ingress-nginx/templates/admission-webhooks/job-patch/serviceaccount.yaml
  469. apiVersion: v1
  470. kind: ServiceAccount
  471. metadata:
  472.   name: ingress-nginx-admission
  473.   namespace: ingress-nginx
  474.   annotations:
  475.     helm.sh/hook: pre-install,pre-upgrade,post-install,post-upgrade
  476.     helm.sh/hook-delete-policy: before-hook-creation,hook-succeeded
  477.   labels:
  478.     helm.sh/chart: ingress-nginx-4.0.15
  479.     app.kubernetes.io/name: ingress-nginx
  480.     app.kubernetes.io/instance: ingress-nginx
  481.     app.kubernetes.io/version: 1.1.1
  482.     app.kubernetes.io/managed-by: Helm
  483.     app.kubernetes.io/component: admission-webhook
  484. ---
  485. # Source: ingress-nginx/templates/admission-webhooks/job-patch/clusterrole.yaml
  486. apiVersion: rbac.authorization.k8s.io/v1
  487. kind: ClusterRole
  488. metadata:
  489.   name: ingress-nginx-admission
  490.   annotations:
  491.     helm.sh/hook: pre-install,pre-upgrade,post-install,post-upgrade
  492.     helm.sh/hook-delete-policy: before-hook-creation,hook-succeeded
  493.   labels:
  494.     helm.sh/chart: ingress-nginx-4.0.15
  495.     app.kubernetes.io/name: ingress-nginx
  496.     app.kubernetes.io/instance: ingress-nginx
  497.     app.kubernetes.io/version: 1.1.1
  498.     app.kubernetes.io/managed-by: Helm
  499.     app.kubernetes.io/component: admission-webhook
  500. rules:
  501.   - apiGroups:
  502.       - admissionregistration.k8s.io
  503.     resources:
  504.       - validatingwebhookconfigurations
  505.     verbs:
  506.       - get
  507.       - update
  508. ---
  509. # Source: ingress-nginx/templates/admission-webhooks/job-patch/clusterrolebinding.yaml
  510. apiVersion: rbac.authorization.k8s.io/v1
  511. kind: ClusterRoleBinding
  512. metadata:
  513.   name: ingress-nginx-admission
  514.   annotations:
  515.     helm.sh/hook: pre-install,pre-upgrade,post-install,post-upgrade
  516.     helm.sh/hook-delete-policy: before-hook-creation,hook-succeeded
  517.   labels:
  518.     helm.sh/chart: ingress-nginx-4.0.15
  519.     app.kubernetes.io/name: ingress-nginx
  520.     app.kubernetes.io/instance: ingress-nginx
  521.     app.kubernetes.io/version: 1.1.1
  522.     app.kubernetes.io/managed-by: Helm
  523.     app.kubernetes.io/component: admission-webhook
  524. roleRef:
  525.   apiGroup: rbac.authorization.k8s.io
  526.   kind: ClusterRole
  527.   name: ingress-nginx-admission
  528. subjects:
  529.   - kind: ServiceAccount
  530.     name: ingress-nginx-admission
  531.     namespace: ingress-nginx
  532. ---
  533. # Source: ingress-nginx/templates/admission-webhooks/job-patch/role.yaml
  534. apiVersion: rbac.authorization.k8s.io/v1
  535. kind: Role
  536. metadata:
  537.   name: ingress-nginx-admission
  538.   namespace: ingress-nginx
  539.   annotations:
  540.     helm.sh/hook: pre-install,pre-upgrade,post-install,post-upgrade
  541.     helm.sh/hook-delete-policy: before-hook-creation,hook-succeeded
  542.   labels:
  543.     helm.sh/chart: ingress-nginx-4.0.15
  544.     app.kubernetes.io/name: ingress-nginx
  545.     app.kubernetes.io/instance: ingress-nginx
  546.     app.kubernetes.io/version: 1.1.1
  547.     app.kubernetes.io/managed-by: Helm
  548.     app.kubernetes.io/component: admission-webhook
  549. rules:
  550.   - apiGroups:
  551.       - ''
  552.     resources:
  553.       - secrets
  554.     verbs:
  555.       - get
  556.       - create
  557. ---
  558. # Source: ingress-nginx/templates/admission-webhooks/job-patch/rolebinding.yaml
  559. apiVersion: rbac.authorization.k8s.io/v1
  560. kind: RoleBinding
  561. metadata:
  562.   name: ingress-nginx-admission
  563.   namespace: ingress-nginx
  564.   annotations:
  565.     helm.sh/hook: pre-install,pre-upgrade,post-install,post-upgrade
  566.     helm.sh/hook-delete-policy: before-hook-creation,hook-succeeded
  567.   labels:
  568.     helm.sh/chart: ingress-nginx-4.0.15
  569.     app.kubernetes.io/name: ingress-nginx
  570.     app.kubernetes.io/instance: ingress-nginx
  571.     app.kubernetes.io/version: 1.1.1
  572.     app.kubernetes.io/managed-by: Helm
  573.     app.kubernetes.io/component: admission-webhook
  574. roleRef:
  575.   apiGroup: rbac.authorization.k8s.io
  576.   kind: Role
  577.   name: ingress-nginx-admission
  578. subjects:
  579.   - kind: ServiceAccount
  580.     name: ingress-nginx-admission
  581.     namespace: ingress-nginx
  582. ---
  583. # Source: ingress-nginx/templates/admission-webhooks/job-patch/job-createSecret.yaml
  584. apiVersion: batch/v1
  585. kind: Job
  586. metadata:
  587.   name: ingress-nginx-admission-create
  588.   namespace: ingress-nginx
  589.   annotations:
  590.     helm.sh/hook: pre-install,pre-upgrade
  591.     helm.sh/hook-delete-policy: before-hook-creation,hook-succeeded
  592.   labels:
  593.     helm.sh/chart: ingress-nginx-4.0.15
  594.     app.kubernetes.io/name: ingress-nginx
  595.     app.kubernetes.io/instance: ingress-nginx
  596.     app.kubernetes.io/version: 1.1.1
  597.     app.kubernetes.io/managed-by: Helm
  598.     app.kubernetes.io/component: admission-webhook
  599. spec:
  600.   template:
  601.     metadata:
  602.       name: ingress-nginx-admission-create
  603.       labels:
  604.         helm.sh/chart: ingress-nginx-4.0.15
  605.         app.kubernetes.io/name: ingress-nginx
  606.         app.kubernetes.io/instance: ingress-nginx
  607.         app.kubernetes.io/version: 1.1.1
  608.         app.kubernetes.io/managed-by: Helm
  609.         app.kubernetes.io/component: admission-webhook
  610.     spec:
  611.       containers:
  612.         - name: create
  613.           image: aaa.big.com/ingress-nginx-arm/kube-webhook-certgen:v1.1.1
  614.           imagePullPolicy: IfNotPresent
  615.           args:
  616.             - create
  617.             - --host=ingress-nginx-controller-admission,ingress-nginx-controller-admission.$(POD_NAMESPACE).svc
  618.             - --namespace=$(POD_NAMESPACE)
  619.             - --secret-name=ingress-nginx-admission
  620.           env:
  621.             - name: POD_NAMESPACE
  622.               valueFrom:
  623.                 fieldRef:
  624.                   fieldPath: metadata.namespace
  625.           securityContext:
  626.             allowPrivilegeEscalation: false
  627.       restartPolicy: OnFailure
  628.       serviceAccountName: ingress-nginx-admission
  629.       nodeSelector:
  630.         kubernetes.io/os: linux
  631.       securityContext:
  632.         runAsNonRoot: true
  633.         runAsUser: 2000
  634. ---
  635. # Source: ingress-nginx/templates/admission-webhooks/job-patch/job-patchWebhook.yaml
  636. apiVersion: batch/v1
  637. kind: Job
  638. metadata:
  639.   name: ingress-nginx-admission-patch
  640.   namespace: ingress-nginx
  641.   annotations:
  642.     helm.sh/hook: post-install,post-upgrade
  643.     helm.sh/hook-delete-policy: before-hook-creation,hook-succeeded
  644.   labels:
  645.     helm.sh/chart: ingress-nginx-4.0.15
  646.     app.kubernetes.io/name: ingress-nginx
  647.     app.kubernetes.io/instance: ingress-nginx
  648.     app.kubernetes.io/version: 1.1.1
  649.     app.kubernetes.io/managed-by: Helm
  650.     app.kubernetes.io/component: admission-webhook
  651. spec:
  652.   template:
  653.     metadata:
  654.       name: ingress-nginx-admission-patch
  655.       labels:
  656.         helm.sh/chart: ingress-nginx-4.0.15
  657.         app.kubernetes.io/name: ingress-nginx
  658.         app.kubernetes.io/instance: ingress-nginx
  659.         app.kubernetes.io/version: 1.1.1
  660.         app.kubernetes.io/managed-by: Helm
  661.         app.kubernetes.io/component: admission-webhook
  662.     spec:
  663.       containers:
  664.         - name: patch
  665.           image: aaa.big.com/ingress-nginx-arm/kube-webhook-certgen:v1.1.1
  666.           imagePullPolicy: IfNotPresent
  667.           args:
  668.             - patch
  669.             - --webhook-name=ingress-nginx-admission
  670.             - --namespace=$(POD_NAMESPACE)
  671.             - --patch-mutating=false
  672.             - --secret-name=ingress-nginx-admission
  673.             - --patch-failure-policy=Fail
  674.           env:
  675.             - name: POD_NAMESPACE
  676.               valueFrom:
  677.                 fieldRef:
  678.                   fieldPath: metadata.namespace
  679.           securityContext:
  680.             allowPrivilegeEscalation: false
  681.       restartPolicy: OnFailure
  682.       serviceAccountName: ingress-nginx-admission
  683.       nodeSelector:
  684.         kubernetes.io/os: linux
  685.       securityContext:
  686.         runAsNonRoot: true
  687.         runAsUser: 2000
  1. # 镜像地址改为，这里是我们公司的harbor地址，镜像我们自己可以去dockerhub上搜 ingress-nginx-controller:v1.1.1 就可以，我们这个也是从官网拉下来没改直接推到harbor上的
  2.  - image:aaa.com/ingress-nginx-arm/ingress-nginx-controller:v1.1.1
  3.          aaa.bigfintax.com/ingress-nginx-arm/kube-webhook-certgen:v1.1.1 #修改两次
  4. #安装ingress
  5. kubectl apply -f ingress-deploy.yaml

到这里，k8s已经安装完成了，下面是我们其他中间件的安装，请忽略。

11. 文件存储NAS
  1. dnf -y install
  2. nfs-utils-2.5.1-5.ky10.x86_64
  3. nfs-utils-help-2.5.1-5.ky10.x86_6
  4.  
  5. 创建目录：mkdir  /data/nfs/cge/
  6. mkdir  /data/nfs/cbest/
  7. mkdir  /data/nfs/package/
  8.  
  9. vim /etc/exports
  10. /data/nfs/cge/ *(insecure,rw,sync,no_root_squash,no_subtree_check)
  11. /data/nfs/cbest/ *(insecure,rw,sync,no_root_squash,no_subtree_check)
  12. /data/nfs/package *(insecure,rw,sync,no_root_squash,no_subtree_check)
  13.  
  14.  
  15. 如果/etc/exports文件被修改，我们需要运行下面的命令使之生效。exportfs -ra
  16. 启动rpcbind服务
  17. sudo systemctl enable rpcbind
  18. sudo systemctl restart rpcbind
  19.  
  20. 启动nfs服务
  21. sudo systemctl enable nfs-server
  22. sudo systemctl start nfs-server
12. mysql
  1. # 镜像地址改为 
  2.  - image: aaa.big.com/store-arm/mysql:5.7.43        #镜像tag修改
  3.   
  4. # 给node节点添加标签
  5. kubectl label node zhongliang-k8s-node1 mysql=
  6. #创建挂载目录及授权
  7. mkdir /data/mysql
  8. chown -R 1001 /data/mysql/
  9.    #修改 02-mysql-dep.yaml
  10.         volumeMounts:
  11.         - name: mysql-data 
  12.           mountPath: /bitnami/mysql/data        #pod内的数据挂载到该目录
  13.         - name: localtime                       # 新增
  14.           mountPath: /etc/localtime             # 新增 挂载本地时间到pod
  15.           readOnly: true                        # 新增
  16.       volumes:
  17.       - hostPath:
  18.           path: /data/mysql                     # 外挂持久化到本地
  19.           type: "DirectoryOrCreate"    
  20.         name: mysql-data                       
  21.       - name: localtime                         # 新增 挂载本地时间到pod内
  22.         hostPath:
  23.           path: /etc/localtime
  24.  
  25.  
  26. # 挂载到 /data/mysql后，mysql没有权限写入，可以先挂载到一个临时权限较高的目录，查看文件的属主，然后修改外面/data/mysql的属主， chown -R 1001 /data/mysql
  27. kubectl apply -f 01-mysql-svc.yaml
  28. kubectl apply  -f 02-mysql-dep.yaml
13. nacos安装
  1. # 镜像地址改为
  2.  - image:  aaa.big.com/store-arm/nacos:1.4.2
  3. # 获取mysql的pod
  4. kubectl get pods -n store | grep mysql
  5. # 将sql导入mysql
  6. bash 05-nacos-mysql-import.sh  mysql-64846d7d58-f47pg
  7. # 登陆mysql的pod查看数据是否导入成功
  8. kubectl exec -it MYSQLPOD -n store bash
  9.     mysql  -uroot -pMhxzKhl@123 -e "show databases;"
  10.  
  11. # 给node节点添加标签
  12. kubectl label node zhongliang-k8s-node3 nacos=
  13.  
  14. # 创建无头服务和nodeport
  15. kubectl apply  -f 01-nacos-cluster.yml
  16. # 创建confimap 配置文件
  17. kubectl apply  -f 02-nacos-configmap.yaml
  18. # 创建pod
  19. kubectl apply  -f  03-nacos-deployment.yml
  20. # 修改ingress
  21. - host: "nacos.cofco.com" #修改域名
  22. # 创建ingress
  23. kubectl apply  -f  04-nacos-ingress.yaml
  24.  
  25. # 查看日志是否正常
  26. kubectl logs -f nacos-0 -n store
14. redis安装
  1. #  03-redis-master-sts.yaml 镜像地址改为
  2.   - image:  aaa.big.com/store-arm/redis:4.0.14
  3. # 07-create-redis-cluster.yaml 镜像地址改为
  4.  - image: aaa.big.com/store-arm/redis:6.0
  5.  
  6. # 给node节点添加标签
  7. kubectl label node zhongliang-k8s-node1 redis-cluster=
  8. kubectl label node zhongliang-k8s-node2 redis-cluster=
  9. kubectl label node zhongliang-k8s-node3 redis-cluster=
  10.  
  11. # 部署完成后，登陆redis6的pod，通过redis6自带的cli，将另外启动的6个pod做成cluster集群 (下面地址需要替换成实际的ip地址)
  12. # 查看6个端口IP
  13. kubectl get pods -A -o wide | grep redis
  14. redis-cli --cluster create 192.168.210.108:6379 192.168.210.250:6379 192.168.210.170:6379 192.168.210.108:7379 192.168.210.250:7379 192.168.210.170:7379 --cluster-replicas 1
  15.  
  16. # 登陆redis6的pod验证
  17. kubectl exec -it redis-6b4bbf7bd8-dv5zf -n store bash
  18.     redis-cli -h 192.168.210.250 -c # 登陆redis cluster集群
  19.         cluster info    # 执行命令查看集群信息
  20.         cluster nodes   # 执行命令查看主从节点
  21.  
  22. #验证没问题后删除这个单点的redis6 
  23. kubectl delete -f 07-create-redis-cluster.yaml
15. rabbitmq安装
  1. # 03-ss.yaml  镜像地址改为
  2. - image:  aaa.big.com/store-arm/rabbitmq:3.8
  3.  
  4. # 给node节点添加标签
  5. kubectl label node zhongliang-k8s-node1 rabbitmq=
  6. kubectl label node zhongliang-k8s-node2 rabbitmq=
  7. kubectl label node zhongliang-k8s-node3 rabbitmq=
  8.  
  9. # 创建rbac
  10. kubectl  apply -f 00-rabc.yaml
  11. # 创建配置文件
  12. kubectl  apply -f 01-cm.yaml
  13. # 创建svc
  14. kubectl  apply -f  02-svc.yaml
  15. # 创建deployment
  16. kubectl apply -f 03-ss.yaml
  17. # 修改ingress
  18. - host: "rabbitmq.cofco.com" #修改域名
  19. # 创建ingress
  20. kubectl apply -f 04-ingress.yaml
  21.  
  22. # 查看日志
  23. kubectl logs -f rabbitmq-0 -n store
  24. kubectl logs -f rabbitmq-1 -n store
16. rocketmq安装
  1. # 02-rocketmq-namesrv-prod.yaml  镜像地址改为
  2. - image: aaa.big.com/store-arm/rocketmq-namesrv:4.5.1_centos8
  3. # 04-rocketmq-broker-master-prod.yaml 镜像地址改为
  4. - image: aaa.big.com/store-arm/rocketmq-broker:4.5.1_centos8
  5.  
  6. # 给node节点添加标签
  7. kubectl label node zhongliang-k8s-node1 node-role.kubernetes.io/rocketmq="true"
  8. kubectl label node zhongliang-k8s-node2 node-role.kubernetes.io/rocketmq-master: "true"
  9.  
  10. # 创建namesrv的pod
  11. kubectl apply -f 02-rocketmq-namesrv-prod.yaml
  12. # 创建svc服务发现
  13. kubectl apply -f  03-rocketmq-broker-master-svc.yaml
  14. # 创建broker的pod
  15. kubectl apply -f  04-rocketmq-broker-master-prod.yaml
  16. # 创建console控制台
  17. kubectl apply -f  07-rocketmq-console-ng-prod-ingress.yaml
  18. # 修改ingress
  19. - host: "rocketmq.cofco.com"  #修改域名
  20. #创建ingress
  21. kubectl apply -f 07-rocketmq-console-ng-prod-ingress.yaml
  22. # 当broker需要创建slave备份节点的时候才会执行
  23. 05-rocketmq-broker-slave-svc.yaml
  24. 06-rocketmq-broker-slave-prod.yaml
  25.  
  26.  
  27. # 验证
  28. kubectl logs -f rocketmq-broker-master-0 -n store
  29. kubectl logs -f namesrv-0 -n store
17. pgsql 控制台(pgadmin)页面安装
  1. # 02-pgadmin-dep.yaml  镜像地址改为
  2. - image: aaa.big.com/tool-arm/pgadmin4:8.6
  3. #  03-pgadmin-ingress.yaml 修改域名地址
  4. - host: "pgadmin.cofco.com"     # 这里是示例，需要修改双引号内部分
  5. # 通过kubectl创建svc，pod，ingress
  6. kubectl apply ...
  7. # 验证 ，修改本地的host文件，
  8. 123.249.91.174 pgadmin.cofco.com       # 123.249.91.174为公网地址，修改完成后浏览器访问pgadmin.cofco.com测试
18. mysql 控制台(phpmyadmin)页面安装
  1. # 02-phpmyadmin-dep.yaml  镜像地址改为
  2. - image: aaa.big.com/tool-arm/phpmyadmin:latest
  3. # 03-phpmyadmin-ingress.yaml 修改域名地址
  4. - host: "phpadmin.cofco.com"     # 这里是示例，需要修改双引号内部分
  5. # 通过kubectl创建svc，pod，ingress
  6. kubectl apply ...
  7. # 验证 ，修改本地的host文件，
  8. 123.249.91.174  phpadmin.cofco.com       # 123.249.91.174为公网地址，修改完成后浏览器访问 phpadmin.cofco.com 测试
19. redis 控制台(redis-sinsight)页面安装
  1. # 01-redis-sinsight-dep.yaml  镜像地址改为
  2. - image: aaa.big.com/tool-arm/redisinsight:1.13.1
  3. # 03-redis-sinsight-ingress.yaml 修改域名地址
  4. - host: "redisinsight.cofco.com"     # 这里是示例，需要修改双引号内部分
  5. # 通过kubectl创建svc，pod，ingress
  6. kubectl apply ...
  7. # 验证 ，修改本地的host文件，
  8. 123.249.91.174 redisinsight.cofco.com       # 123.249.91.174为公网地址，修改完成后浏览器访问redisinsight.cofco.com测试

第二章：离线软件包下载

使用repotrack下载指定rpm包及其全量依赖

先添加kubernetes.repo

  1. vim /etc/yum.repos.d/kubernetes.repo
  2.  
  3. [kubernetes]
  4. name=Kubernetes
  5. baseurl=https://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-aarch64
  6. enabled=1
  7. gpgcheck=0
  8. repo_gpgcheck=0
  9. gpgkey=https://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpg https://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg
  10.  
  11. kylin sp1验证
  12.  
  13. dnf -y install kubeadm-1.23.9-0 kubernetes-cni-0.8.7 kubelet-1.23.9-0 kubectl-1.23.9-0 kubernetes-cni-0.8.7-0 --downloadonly --destdir=/root/package/kubernetes/
  14.  
  15. 安装软件包
  16.  
  17. cd /root/package/kubernetes/
  18.  
  19. yum localinstall *.rpm -y

第三章：本地仓库配置YUM

  1. 创建一个新的目录来存储你的RPM包：
  2. mkdir /path/to/myrepo
  3.  
  4. 将你的RPM包复制到这个目录中。
  5.  
  6. 安装createrepo工具，如果尚未安装
  7. yum install createrepo
  8.  
  9. 运行createrepo来创建仓库元数据：
  10. createrepo /path/to/myrepo/
  11.  
  12. 创建一个新的repo文件，在/etc/yum.repos.d/目录下：
  13. vi /etc/yum.repos.d/myrepo.repo
  14.  
  15. 在myrepo.repo文件中添加以下内容
  16. [myrepo]
  17. name=My Local Repository
  18. baseurl=file:///path/to/myrepo/
  19. enabled=1
  20. gpgcheck=0
  21.  
  22. yum命令来安装、更新或者搜索仓库中的包
  23. yum install package-name
本文内容由网友自发贡献，转载请注明出处：https://www.wpsshop.cn/w/我家小花儿/article/detail/727969
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号