kubeedge 安装_execute keadm command failed: timed out waiting fo

实验环境

• VMware Workstation 16 Pro
• 3 台虚拟机
• CentOS-7-x86_64-Minimal-2009
• 4核8G，100G硬盘
• docker 20.10.2
• k8s v1.21.4

安装说明

• 更新时间：2023.1.19

安装 keadm

下载 keadm

以 keadm-v1.12.1-linux-amd64.tar.gz 为例

wget https://github.com/kubeedge/kubeedge/releases/download/v1.12.1/keadm-v1.12.1-linux-amd64.tar.gz
tar -zxvf keadm-v1.12.1-linux-amd64.tar.gz
cp keadm-v1.12.1-linux-amd64/keadm/keadm /usr/local/bin/keadm
1
2
3

安装 cloudcore

初始化

keadm init --advertise-address=192.168.0.201 --profile version=v1.12.1 --kube-config=/root/.kube/config --set iptablesManager.mode="external"
1

可能报错 execute keadm command failed: timed out waiting for the condition
参见官网说明

修改 kube-proxy 和 kube-flannel 的节点亲和性，不调度到边缘节点

kubectl patch daemonset kube-proxy -n kube-system -p '{"spec": {"template": {"spec": {"affinity": {"nodeAffinity": {"requiredDuringSchedulingIgnoredDuringExecution": {"nodeSelectorTerms": [{"matchExpressions": [{"key": "node-role.kubernetes.io/edge", "operator": "DoesNotExist"}]}]}}}}}}}'

kubectl patch daemonset kube-flannel-ds -n kube-flannel -p '{"spec": {"template": {"spec": {"affinity": {"nodeAffinity": {"requiredDuringSchedulingIgnoredDuringExecution": {"nodeSelectorTerms": [{"matchExpressions": [{"key": "node-role.kubernetes.io/edge", "operator": "DoesNotExist"}]}]}}}}}}}'
1
2
3

启用查看边缘 pod 日志功能
查看 k8s 的 ca.crt ca.key 文件

ls /etc/kubernetes/pki/
1

声明环境变量

export CLOUDCOREIPS="192.168.0.201"
1

生成 CloudStream 证书

mkdir -p /etc/kubeedge/
cd /etc/kubeedge/
wget https://raw.githubusercontent.com/kubeedge/kubeedge/master/build/tools/certgen.sh
chmod +x /etc/kubeedge/certgen.sh
/etc/kubeedge/certgen.sh stream
1
2
3
4
5

安装 Metrics Server
下载配置文件

cd ~
wget https://github.com/kubernetes-sigs/metrics-server/releases/latest/download/components.yaml -O metrics-server.yaml
1
2

修改配置文件，参考 Metrics Server GitHub 和 KubeEdge 文档

vim metrics-server.yaml

kind: Deployment
spec:
  template:
    spec:
      affinity:
        nodeAffinity:
          requiredDuringSchedulingIgnoredDuringExecution:
            nodeSelectorTerms:
            - matchExpressions:
              - key: kubernetes.io/hostname
                operator: In
                values:
                - cloud
      containers:
      - args:
        - --kubelet-insecure-tls
      hostNetwork: true
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19

根据配置文件拉取镜像

docker pull registry.aliyuncs.com/google_containers/metrics-server:v0.6.2
docker tag registry.aliyuncs.com/google_containers/metrics-server:v0.6.2 k8s.gcr.io/metrics-server/metrics-server:v0.6.2
docker rmi registry.aliyuncs.com/google_containers/metrics-server:v0.6.2
1
2
3

应用配置文件

kubectl apply -f metrics-server.yaml
1

加入边缘节点

边缘节点关闭 kubelet

systemctl stop kubelet
systemctl disable kubelet
1
2

获取 token 并加入集群

# 在云节点获取 token
keadm gettoken

# 使用 token 将边缘节点加入集群
keadm join --cloudcore-ipport=192.168.0.201:10000 --token=a867ade568c71cfe6f7bc62c84243f4b0b1243709fd8504081d195b82c97fd87.eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2NzM2MjY3ODR9.qtMaMwJvB9sRvwQvP8LBQ1qL9W6vrotpq8d_wyu4YaA --kubeedge-version=v1.12.1 --cgroupdriver systemd
1
2
3
4
5

修改配置文件

vim /etc/kubeedge/config/edgecore.yaml
modules:
  ···
  edgeStream:
    enable: true
1
2
3
4
5

重启 edgecore

# 在边缘节点运行
systemctl restart edgecore.service
1
2

常用命令

编辑 cloudcore 配置 kubectl edit configmap cloudcore -n kubeedge
重启 cloudcore kubectl delete po cloudcore-7879bd4b5b-5jgt6 -n kubeedge
重启 edgecore systemctl restart edgecore.service