devbox
很楠不爱3
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

kubesphere搭建k8s集群

作者：很楠不爱3 | 2024-03-16 06:11:16

赞

踩

kubesphere

目录

1准备3台虚拟机（centos7.9）

2 每台虚拟机更新yum的软件包，时间设置等

3 关闭防火墙

4 添加三台服务器的域名设置

5 设置三台服务器之间免密  执行完后务必退出shell然后重连

6 安装kubesphere必要依赖，每个节点都要装，不然报错：socat not found in system path

7 安装nfs-server

配置nfs-client(选做)

配置默认存储  sc.yaml

8 只用在主节点k8s-node1文件夹中下载k8s安装脚本  没有配置镜像加速可能会很慢多试几次

9 集群配置，创建配置文件，config-sample.yaml

 10 编辑config-sample.yaml

 11 启动脚本和配置文件

12 耐心等待安装完成，会把所有工作节点添加到k8s-node1(时间大概5-10分钟)

13 查看日志

14 查看节点状态

15 如果忘记配置阿里镜像加速 

 16 删除集群，重新安装

17多租户实战

1准备3台虚拟机（centos7.9）

  1. cd /etc/sysconfig/network-scripts
  2. vim ifcfg-ens33
  1. BOOTPROTO=static
  2. ONBOOT=yes
  3. IPADDR=192.168.1.211
  4. GATEWAY=192.168.1.1
  5. NETMASK=255.255.255.0
  6. DNS1=114.114.114.114

2 每台虚拟机更新yum的软件包，时间设置等

yum -y update

yum makecache fast

  1. yum install -y ntpdate
  2. ntpdate time.windows.com
  3. ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
  4. date

3 关闭防火墙

  1. systemctl stop firewalld
  2. systemctl disable firewalld
  3.  
  4.  
  5. /etc/selinux/config
  6.  
  7. 将SELINUX的值设置为disabled

4 添加三台服务器的域名设置

vim /etc/hosts

  1. 192.168.1.211 node1
  2. 192.168.1.212 node2
  3. 192.168.1.213 node3

5 设置三台服务器之间免密  执行完后务必退出shell然后重连

  1. 1、先在所有服务器上执行命令：
  2. ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
  3.  
  4. 2、而后在所有服务器上执行命令：这样自身就能免密登陆
  5. cat ~/.ssh/id_dsa.pub >>~/.ssh/authorized_keys
  6.  
  7. 3、之后将每台服务器上的id_dsa.pub公钥发送到其他机器的/tmp文件夹下，如在master上执行
  8. scp ~/.ssh/id_dsa.pub node2:/tmp/
  9. scp ~/.ssh/id_dsa.pub node3:/tmp/
  10.  
  11. 4、之后在其他的机器上将公钥追加到各自的authorized_keys里，执行以下命令：
  12. cat /tmp/id_dsa.pub >>~/.ssh/authorized_keys
  13.  
  14. 5、同样的，在其他的机器上将公钥发送到其他服务器上，然后在其他服务器上将公钥追加到各自的authorized_keys即可
  15.  
  16. 6、最后是测试免密钥连接。
  17. ssh node1

6 安装kubesphere必要依赖，每个节点都要装，不然报错：socat not found in system path

yum install -y socat conntrack ebtables ipset

7 安装nfs-server

  1. #在每个机器。
  2. yum install -y nfs-utils
  3.  
  4.  
  5.  
  6. #在master执行以下命令
  7. echo "/nfs/data/ *(insecure,rw,sync,no_root_squash)" > /etc/exports
  8.  
  9. #执行以下命令， 启动nfs服务；创建共享目录
  10. mkdir -p /nfs/data
  11.  
  12. #在master执行
  13. systemctl enable rpcbind
  14. systemctl enable nfs-server
  15. systemctl start rpcbind
  16. systemctl start nfs-server
  17.  
  18. #使配置生效
  19. exportfs-r
  20.  
  21. #检查配置是否生效
  22. exportfs

配置nfs-client(选做)

  1. #改成自己的master的ip,只在从节点执行
  2. showmount -e 192.168.1.211
  3.  
  4. mkdir -p /nfs/data
  5.  
  6. mount -t nfs 192.168.1.211:/nfs/data /nfs/data

配置默认存储  sc.yaml

  1. ## 创建了一个存储类
  2. apiVersion: storage.k8s.io/v1
  3. kind: StorageClass
  4. metadata:
  5.   name: nfs-storage
  6.   annotations:
  7.     storageclass.kubernetes.io/is-default-class: "true"
  8. provisioner: k8s-sigs.io/nfs-subdir-external-provisioner
  9. parameters:
  10.   archiveOnDelete: "true"  ## 删除pv的时候，pv的内容是否要备份
  11.  
  12. ---
  13. apiVersion: apps/v1
  14. kind: Deployment
  15. metadata:
  16.   name: nfs-client-provisioner
  17.   labels:
  18.     app: nfs-client-provisioner
  19.   # replace with namespace where provisioner is deployed
  20.   namespace: default
  21. spec:
  22.   replicas: 1
  23.   strategy:
  24.     type: Recreate
  25.   selector:
  26.     matchLabels:
  27.       app: nfs-client-provisioner
  28.   template:
  29.     metadata:
  30.       labels:
  31.         app: nfs-client-provisioner
  32.     spec:
  33.       serviceAccountName: nfs-client-provisioner
  34.       containers:
  35.         - name: nfs-client-provisioner
  36.           image: registry.cn-hangzhou.aliyuncs.com/lfy_k8s_images/nfs-subdir-external-provisioner:v4.0.2
  37.           # resources:
  38.           #    limits:
  39.           #      cpu: 10m
  40.           #    requests:
  41.           #      cpu: 10m
  42.           volumeMounts:
  43.             - name: nfs-client-root
  44.               mountPath: /persistentvolumes
  45.           env:
  46.             - name: PROVISIONER_NAME
  47.               value: k8s-sigs.io/nfs-subdir-external-provisioner
  48.             - name: NFS_SERVER
  49.               value: 192.168.1.211 ## 指定自己nfs服务器地址
  50.             - name: NFS_PATH  
  51.               value: /nfs/data  ## nfs服务器共享的目录
  52.       volumes:
  53.         - name: nfs-client-root
  54.           nfs:
  55.             server: 192.168.1.211
  56.             path: /nfs/data
  57. ---
  58. apiVersion: v1
  59. kind: ServiceAccount
  60. metadata:
  61.   name: nfs-client-provisioner
  62.   # replace with namespace where provisioner is deployed
  63.   namespace: default
  64. ---
  65. kind: ClusterRole
  66. apiVersion: rbac.authorization.k8s.io/v1
  67. metadata:
  68.   name: nfs-client-provisioner-runner
  69. rules:
  70.   - apiGroups: [""]
  71.     resources: ["nodes"]
  72.     verbs: ["get", "list", "watch"]
  73.   - apiGroups: [""]
  74.     resources: ["persistentvolumes"]
  75.     verbs: ["get", "list", "watch", "create", "delete"]
  76.   - apiGroups: [""]
  77.     resources: ["persistentvolumeclaims"]
  78.     verbs: ["get", "list", "watch", "update"]
  79.   - apiGroups: ["storage.k8s.io"]
  80.     resources: ["storageclasses"]
  81.     verbs: ["get", "list", "watch"]
  82.   - apiGroups: [""]
  83.     resources: ["events"]
  84.     verbs: ["create", "update", "patch"]
  85. ---
  86. kind: ClusterRoleBinding
  87. apiVersion: rbac.authorization.k8s.io/v1
  88. metadata:
  89.   name: run-nfs-client-provisioner
  90. subjects:
  91.   - kind: ServiceAccount
  92.     name: nfs-client-provisioner
  93.     # replace with namespace where provisioner is deployed
  94.     namespace: default
  95. roleRef:
  96.   kind: ClusterRole
  97.   name: nfs-client-provisioner-runner
  98.   apiGroup: rbac.authorization.k8s.io
  99. ---
  100. kind: Role
  101. apiVersion: rbac.authorization.k8s.io/v1
  102. metadata:
  103.   name: leader-locking-nfs-client-provisioner
  104.   # replace with namespace where provisioner is deployed
  105.   namespace: default
  106. rules:
  107.   - apiGroups: [""]
  108.     resources: ["endpoints"]
  109.     verbs: ["get", "list", "watch", "create", "update", "patch"]
  110. ---
  111. kind: RoleBinding
  112. apiVersion: rbac.authorization.k8s.io/v1
  113. metadata:
  114.   name: leader-locking-nfs-client-provisioner
  115.   # replace with namespace where provisioner is deployed
  116.   namespace: default
  117. subjects:
  118.   - kind: ServiceAccount
  119.     name: nfs-client-provisioner
  120.     # replace with namespace where provisioner is deployed
  121.     namespace: default
  122. roleRef:
  123.   kind: Role
  124.   name: leader-locking-nfs-client-provisioner
  125.   apiGroup: rbac.authorization.k8s.io
  1. #应用
  2. kubectl apply -f  sc.yaml
  3.  
  4. #确认配置是否生效
  5. kubectl get sc

8 只用在主节点k8s-node1文件夹中下载k8s安装脚本  没有配置镜像加速可能会很慢多试几次

  1. export KKZONE=cn
  2. curl -sfL https://get-kk.kubesphere.io | VERSION=v1.1.1 sh -
  3. chmod +x kk

9 集群配置，创建配置文件，config-sample.yaml

./kk create config --with-kubernetes v1.20.4 --with-kubesphere v3.1.1

 10 编辑config-sample.yaml

  1. apiVersion: kubekey.kubesphere.io/v1alpha1
  2. kind: Cluster
  3. metadata:
  4.   name: sample
  5. spec:
  6.   hosts:
  7.   - {name: node1, address: 192.168.1.211, internalAddress: 192.168.1.211, user: root, password: "root"}
  8.   - {name: node2, address: 192.168.1.212, internalAddress: 192.168.1.212, user: root, password: "root"}
  9.   - {name: node3, address: 192.168.1.213, internalAddress: 192.168.1.213, user: root, password: "root"}
  10.   roleGroups:
  11.     etcd:
  12.     - node1
  13.     master: 
  14.     - node1
  15.     worker:
  16.     - node2
  17.     - node3
  18.   controlPlaneEndpoint:
  19.     domain: lb.kubesphere.local
  20.     address: ""
  21.     port: 6443
  22.   kubernetes:
  23.     version: v1.20.4
  24.     imageRepo: kubesphere
  25.     clusterName: cluster.local
  26.   network:
  27.     plugin: calico
  28.     kubePodsCIDR: 10.233.64.0/18
  29.     kubeServiceCIDR: 10.233.0.0/18
  30.   registry:
  31.     registryMirrors: "https://o83laiga.mirror.aliyuncs.com"
  32.     insecureRegistries: []
  33.   addons: []

 11 启动脚本和配置文件

./kk create cluster -f config-sample.yaml

12 耐心等待安装完成，会把所有工作节点添加到k8s-node1(时间大概5-10分钟)

13 查看日志

kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l app=ks-installer -o jsonpath='{.items[0].metadata.name}') -f

14 查看节点状态

kubectl get nodes

15 如果忘记配置阿里镜像加速 

更改daemon文件

  1. {
  2.   "registry-mirrors": ["https://o83laiga.mirror.aliyuncs.com"],
  3.   "exec-opts": ["native.cgroupdriver=systemd"],
  4.   "log-driver": "json-file",
  5.   "log-opts": {
  6.     "max-size": "100m"
  7.   }
  8. }

 16 删除集群，重新安装

./kk delete cluster

高级模式删除

./kk delete cluster [-f config-sample.yaml]

17多租户实战

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/很楠不爱3/article/detail/247598
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号