kubeadm 在virtualbox ubuntu18.04上安装kubernetes 1.18.20_kubeadm 安装 1.18.20

时间同步

把master和所有节点，先做时间同步。

virtualbox操作-------------------------------------

下载virtualbox

https://download.virtualbox.org/virtualbox/6.1.18/VirtualBox-6.1.18-142142-Win.exe

下载增强

https://download.virtualbox.org/virtualbox/6.1.18/Oracle_VM_VirtualBox_Extension_Pack-6.1.18.vbox-extpack

安装virtualbox和增强

安装路径不要有中文名，避免麻烦。
选择NAT 和host-only网络。

安装ubuntu 18.04虚拟机

虚拟机设置------------------------------------------

备份源

sudo cp /etc/apt/sources.list /etc/apt/sources.list.back
1

改为阿里源

sudo cat << EOF >/etc/apt/sources.list
deb http://mirrors.aliyun.com/ubuntu/ bionic main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic main restricted universe multiverse
 
deb http://mirrors.aliyun.com/ubuntu/ bionic-security main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic-security main restricted universe multiverse
 
deb http://mirrors.aliyun.com/ubuntu/ bionic-updates main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic-updates main restricted universe multiverse
 
deb http://mirrors.aliyun.com/ubuntu/ bionic-proposed main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic-proposed main restricted universe multiverse
 
deb http://mirrors.aliyun.com/ubuntu/ bionic-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic-backports main restricted universe multiverse
EOF

sudo apt update
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18

安装增强功能（可选，图形化界面最大化，挂载等）

sudo apt install -y gcc make perl
1

然后“设备” -> “安装增强功能”。

关闭防火墙

sudo ufw disable
sudo ufw status
1
2

关闭交换内存

临时关闭

sudo swapoff -a
free -m
1
2

永久关闭

 sudo vim /etc/fstab 
1

注释掉交换内存

允许 iptables 检查桥接流量

cat <<EOF | sudo tee /etc/modules-load.d/k8s.conf
br_netfilter
EOF

cat <<EOF | sudo tee /etc/sysctl.d/k8s.conf
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
EOF
sudo sysctl --system
1
2
3
4
5
6
7
8
9

设置master可访问NodePort

cat <<EOF | sudo tee /etc/sysctl.d/99-ipv4_forward.conf
net.ipv4.ip_forward=1
EOF
sudo sysctl --load=/etc/sysctl.d/99-ipv4_forward.conf
1
2
3
4

安装docker----------------------------------------------------

安装必要的一些系统工具

sudo apt update
sudo apt install -y apt-transport-https ca-certificates curl software-properties-common
1
2

安装GPG证书

curl -fsSL http://mirrors.aliyun.com/docker-ce/linux/ubuntu/gpg | sudo apt-key add -
1

写入软件源信息

sudo add-apt-repository "deb [arch=amd64] http://mirrors.aliyun.com/docker-ce/linux/ubuntu $(lsb_release -cs) stable"
1

Step 4: 更新

sudo apt update
1

安装指定版本的Docker-CE:

查找Docker-CE的版本:

apt-cache madison docker-ce
1

安装指定版本的Docker-CE:

sudo apt-get -y install docker-ce=5:19.03.15~3-0~ubuntu-bionic
1

锁定版本，以免apt upgrade时自动升级，出现版本不兼容的情况：

sudo echo "docker-ce hold" | sudo dpkg --set-selections
1

更新docker配置文件

sudo mkdir -p /etc/docker

cat <<EOF | sudo tee /etc/docker/daemon.json
{
  "registry-mirrors": ["https://registry.docker-cn.com"],
  "exec-opts": ["native.cgroupdriver=systemd"],
  "log-driver": "json-file",
  "log-opts": {
    "max-size": "100m"
  },
  "storage-driver": "overlay2"
}
EOF

sudo service docker restart
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

安装kubeadm,kubelet,kubectl----------所有节点执行

软件源

sudo apt update &&  sudo apt install -y apt-transport-https

curl https://mirrors.aliyun.com/kubernetes/apt/doc/apt-key.gpg | sudo apt-key add -

cat <<EOF | sudo tee /etc/apt/sources.list.d/kubernetes.list
deb https://mirrors.aliyun.com/kubernetes/apt/ kubernetes-xenial main
EOF

sudo apt update
1
2
3
4
5
6
7
8
9

查找kubeadm的版本

apt-cache madison kubeadm
1

安装Kubernetes：

sudo apt install -y kubeadm=1.18.20-00 kubectl=1.18.20-00 kubelet=1.18.20-00
1

锁定版本

以免apt upgrade时自动升级，出现版本不兼容的情况：

sudo echo "kubeadm hold" | sudo dpkg --set-selections
sudo echo "kubectl hold" | sudo dpkg --set-selections
sudo echo "kubelet hold" | sudo dpkg --set-selections
1
2
3

查看该版本用到的docker镜像

kubeadm config images list
1

拉取镜像

MY_REGISTRY=registry.cn-hangzhou.aliyuncs.com/google_containers
 
sudo docker pull ${MY_REGISTRY}/kube-apiserver:v1.18.20
sudo docker pull ${MY_REGISTRY}/kube-controller-manager:v1.18.20
sudo docker pull ${MY_REGISTRY}/kube-scheduler:v1.18.20
sudo docker pull ${MY_REGISTRY}/kube-proxy:v1.18.20
sudo docker pull ${MY_REGISTRY}/pause:3.2
sudo docker pull ${MY_REGISTRY}/etcd:3.4.3-0
sudo docker pull ${MY_REGISTRY}/coredns:1.6.7
1
2
3
4
5
6
7
8
9

添加Tag

默认使用的是 k8s.gcr.io

sudo docker tag ${MY_REGISTRY}/kube-apiserver:v1.18.20 k8s.gcr.io/kube-apiserver:v1.18.20
sudo docker tag ${MY_REGISTRY}/kube-scheduler:v1.18.20 k8s.gcr.io/kube-scheduler:v1.18.20
sudo docker tag ${MY_REGISTRY}/kube-controller-manager:v1.18.20 k8s.gcr.io/kube-controller-manager:v1.18.20
sudo docker tag ${MY_REGISTRY}/kube-proxy:v1.18.20 k8s.gcr.io/kube-proxy:v1.18.20
sudo docker tag ${MY_REGISTRY}/etcd:3.4.3-0 k8s.gcr.io/etcd:3.4.3-0
sudo docker tag ${MY_REGISTRY}/pause:3.2 k8s.gcr.io/pause:3.2
sudo docker tag ${MY_REGISTRY}/coredns:1.6.7 k8s.gcr.io/coredns:1.6.7

# 删除不需要的
sudo docker rmi ${MY_REGISTRY}/kube-apiserver:v1.18.20
sudo docker rmi ${MY_REGISTRY}/kube-controller-manager:v1.18.20
sudo docker rmi ${MY_REGISTRY}/kube-scheduler:v1.18.20
sudo docker rmi ${MY_REGISTRY}/kube-proxy:v1.18.20
sudo docker rmi ${MY_REGISTRY}/pause:3.2
sudo docker rmi ${MY_REGISTRY}/etcd:3.4.3-0
sudo docker rmi ${MY_REGISTRY}/coredns:1.6.7
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16

创建master节点-----------------------

初始化master节点

192.168.3.156 是master ip地址。

kubeadm init --node-name=192.168.3.156 --kubernetes-version=v1.18.20 --apiserver-advertise-address=192.168.3.156 --pod-network-cidr=10.244.0.0/16
1

输出下面信息，表示初始化成功

kubectl 配置文件

  mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config
1
2
3

安装网络插件flannel

mkdir -p ~/k8s
cd ~/k8s

# 内容https://github.com/flannel-io/flannel/blob/master/Documentation/kube-flannel.yml
# 1.有多个网卡，需添加参数 --iface=xxx, 指定网卡。
# 2.增加了 "VNI": 4096 和 "Port": 4789。以便在使用vxlan时，添加windows节点。

cat > kube-flannel.yml <<EOF
---
apiVersion: policy/v1beta1
kind: PodSecurityPolicy
metadata:
  name: psp.flannel.unprivileged
  annotations:
    seccomp.security.alpha.kubernetes.io/allowedProfileNames: docker/default
    seccomp.security.alpha.kubernetes.io/defaultProfileName: docker/default
    apparmor.security.beta.kubernetes.io/allowedProfileNames: runtime/default
    apparmor.security.beta.kubernetes.io/defaultProfileName: runtime/default
spec:
  privileged: false
  volumes:
  - configMap
  - secret
  - emptyDir
  - hostPath
  allowedHostPaths:
  - pathPrefix: "/etc/cni/net.d"
  - pathPrefix: "/etc/kube-flannel"
  - pathPrefix: "/run/flannel"
  readOnlyRootFilesystem: false
  # Users and groups
  runAsUser:
    rule: RunAsAny
  supplementalGroups:
    rule: RunAsAny
  fsGroup:
    rule: RunAsAny
  # Privilege Escalation
  allowPrivilegeEscalation: false
  defaultAllowPrivilegeEscalation: false
  # Capabilities
  allowedCapabilities: ['NET_ADMIN', 'NET_RAW']
  defaultAddCapabilities: []
  requiredDropCapabilities: []
  # Host namespaces
  hostPID: false
  hostIPC: false
  hostNetwork: true
  hostPorts:
  - min: 0
    max: 65535
  # SELinux
  seLinux:
    # SELinux is unused in CaaSP
    rule: 'RunAsAny'
---
kind: ClusterRole
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: flannel
rules:
- apiGroups: ['extensions']
  resources: ['podsecuritypolicies']
  verbs: ['use']
  resourceNames: ['psp.flannel.unprivileged']
- apiGroups:
  - ""
  resources:
  - pods
  verbs:
  - get
- apiGroups:
  - ""
  resources:
  - nodes
  verbs:
  - list
  - watch
- apiGroups:
  - ""
  resources:
  - nodes/status
  verbs:
  - patch
---
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: flannel
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: ClusterRole
  name: flannel
subjects:
- kind: ServiceAccount
  name: flannel
  namespace: kube-system
---
apiVersion: v1
kind: ServiceAccount
metadata:
  name: flannel
  namespace: kube-system
---
kind: ConfigMap
apiVersion: v1
metadata:
  name: kube-flannel-cfg
  namespace: kube-system
  labels:
    tier: node
    app: flannel
data:
  cni-conf.json: |
    {
      "name": "cbr0",
      "cniVersion": "0.3.1",
      "plugins": [
        {
          "type": "flannel",
          "delegate": {
            "hairpinMode": true,
            "isDefaultGateway": true
          }
        },
        {
          "type": "portmap",
          "capabilities": {
            "portMappings": true
          }
        }
      ]
    }
  net-conf.json: |
    {
      "Network": "10.244.0.0/16",
      "Backend": {
        "Type": "vxlan",
        "VNI": 4096,
        "Port": 4789
      }
    }
---
apiVersion: apps/v1
kind: DaemonSet
metadata:
  name: kube-flannel-ds
  namespace: kube-system
  labels:
    tier: node
    app: flannel
spec:
  selector:
    matchLabels:
      app: flannel
  template:
    metadata:
      labels:
        tier: node
        app: flannel
    spec:
      affinity:
        nodeAffinity:
          requiredDuringSchedulingIgnoredDuringExecution:
            nodeSelectorTerms:
            - matchExpressions:
              - key: kubernetes.io/os
                operator: In
                values:
                - linux
      hostNetwork: true
      priorityClassName: system-node-critical
      tolerations:
      - operator: Exists
        effect: NoSchedule
      serviceAccountName: flannel
      initContainers:
      - name: install-cni
        image: quay.io/coreos/flannel:v0.14.0
        command:
        - cp
        args:
        - -f
        - /etc/kube-flannel/cni-conf.json
        - /etc/cni/net.d/10-flannel.conflist
        volumeMounts:
        - name: cni
          mountPath: /etc/cni/net.d
        - name: flannel-cfg
          mountPath: /etc/kube-flannel/
      containers:
      - name: kube-flannel
        image: quay.io/coreos/flannel:v0.14.0
        command:
        - /opt/bin/flanneld
        args:
        - --ip-masq
        - --kube-subnet-mgr
        - --iface=enp0s3
        resources:
          requests:
            cpu: "100m"
            memory: "50Mi"
          limits:
            cpu: "100m"
            memory: "50Mi"
        securityContext:
          privileged: false
          capabilities:
            add: ["NET_ADMIN", "NET_RAW"]
        env:
        - name: POD_NAME
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: POD_NAMESPACE
          valueFrom:
            fieldRef:
              fieldPath: metadata.namespace
        volumeMounts:
        - name: run
          mountPath: /run/flannel
        - name: flannel-cfg
          mountPath: /etc/kube-flannel/
      volumes:
      - name: run
        hostPath:
          path: /run/flannel
      - name: cni
        hostPath:
          path: /etc/cni/net.d
      - name: flannel-cfg
        configMap:
          name: kube-flannel-cfg
EOF

kubectl apply -f kube-flannel.yml

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238

验证master

#查看节点
kubectl get nodes -o wide

#查看kubernetes 系统组件
kubectl get pods -o wide -n kube-system
1
2
3
4
5

创建slave节点----------------------------------------------------

把slave节点加入到集群

192.168.3.157 是slave ip, 192.168.3.156 是 master ip

  kubeadm --node-name=192.168.3.157 join 192.168.3.156:6443 --token bsi3ya.yfsh4w5pp3buvesg     --discovery-token-ca-cert-hash sha256:aa6dc4112dcbb70b4c1c1aaeefeed1eee0c54886071d00296ab01c7b78b38e68 
1

输出如下信息，表示成功

启用主节点同时作为工作节点（实验环境）--------------

kubectl taint nodes --all node-role.kubernetes.io/master-
1

参考------------------------------------------------

k8s官网:
https://kubernetes.io/zh/docs/setup/production-environment/tools/kubeadm/install-kubeadm/
ubuntu18.04 安装k8s:
https://www.jianshu.com/p/e09df10565fc
master访问NodePort:
https://www.it610.com/article/1282424429049036800.htm