使用--network cilium 安装报错
ruoniao opened this issue · 1 comments
ruoniao commented
安装命令：
bash kainstall-centos.sh init --master 192.168.122.91 --worker 192.168.122.94,192.168.122.95 --user root --port 22 --password 123456 --network cilium --version 1.20.6
报错信息：
timed out waiting for the condition on pods/cilium-bjvlk
timed out waiting for the condition on pods/cilium-mks7d
timed out waiting for the condition on pods/cilium-ppvk2
Retry 1/6 exited 1, retrying in 1 seconds...
系统报错：
Feb 8 11:28:17 localhost containerd: time="2022-02-08T11:28:17.538728720+08:00" level=error msg="copy shim log" error="read /proc/self/fd/57: file already closed"
Feb 8 11:28:20 localhost kubelet: I0208 11:28:20.180676 3736 scope.go:111] [topologymanager] RemoveContainer - Container ID: fd67367ec3db6863f7e25c268f91adc5e00df2b80e124eda51c1de92f20628a7
Feb 8 11:28:22 localhost kubelet: E0208 11:28:22.203685 3736 remote_runtime.go:332] ContainerStatus "cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66" from runtime service failed: rpc error: code = Unknown desc = Error: No such container: cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66
Feb 8 11:28:22 localhost kubelet: E0208 11:28:22.203749 3736 kuberuntime_manager.go:980] getPodContainerStatuses for pod "cilium-mks7d_kube-system(73fe1803-0e75-48d5-a547-5feb7e6f5a11)" failed: rpc error: code = Unknown desc = Error: No such container: cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66
Feb 8 11:28:22 localhost kubelet: I0208 11:28:22.243401 3736 topology_manager.go:187] [topologymanager] Topology Admit Handler
Feb 8 11:28:22 localhost kubelet: I0208 11:28:22.243990 3736 topology_manager.go:187] [topologymanager] Topology Admit Handler
Feb 8 11:28:22 localhost systemd: Created slice libcontainer container kubepods-burstable-pod3e70fe3d_66a2_4177_bb46_f1729f11d16b.slice.
Feb 8 11:28:22 localhost systemd: Created slice libcontainer container kubepods-burstable-pod8313d926_3ede_4d55_997a_848c590768c6.slice.
Feb 8 11:28:22 localhost kubelet: I0208 11:28:22.418662 3736 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "coredns-token-t52t8" (UniqueName: "kubernetes.io/secret/3e70fe3d-66a2-4177-bb46-f1729f11d16b-coredns-token-t52t8") pod "coredns-85bb79f4b4-kwb8z" (UID: "3e70fe3d-66a2-4177-bb46-f1729f11d16b")
Feb 8 11:28:22 localhost kubelet: I0208 11:28:22.418747 3736 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/8313d926-3ede-4d55-997a-848c590768c6-config-volume") pod "coredns-85bb79f4b4-jddhw" (UID: "8313d926-3ede-4d55-997a-848c590768c6")
Feb 8 11:28:22 localhost kubelet: I0208 11:28:22.418826 3736 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "coredns-token-t52t8" (UniqueName: "kubernetes.io/secret/8313d926-3ede-4d55-997a-848c590768c6-coredns-token-t52t8") pod "coredns-85bb79f4b4-jddhw" (UID: "8313d926-3ede-4d55-997a-848c590768c6")
Feb 8 11:28:22 localhost kubelet: I0208 11:28:22.418894 3736 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/3e70fe3d-66a2-4177-bb46-f1729f11d16b-config-volume") pod "coredns-85bb79f4b4-kwb8z" (UID: "3e70fe3d-66a2-4177-bb46-f1729f11d16b")
Feb 8 11:28:24 localhost containerd: time="2022-02-08T11:28:24.825457447+08:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66 pid=7842
Feb 8 11:28:24 localhost systemd: Started libcontainer container cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66.
Feb 8 11:28:26 localhost kubelet: E0208 11:28:26.429653 3736 kuberuntime_manager.go:965] PodSandboxStatus of sandbox "7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071" for pod "coredns-85bb79f4b4-jddhw_kube-system(8313d926-3ede-4d55-997a-848c590768c6)" error: rpc error: code = Unknown desc = Error: No such container: 7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071
Feb 8 11:28:26 localhost kubelet: E0208 11:28:26.458018 3736 kuberuntime_manager.go:965] PodSandboxStatus of sandbox "d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57" for pod "coredns-85bb79f4b4-kwb8z_kube-system(3e70fe3d-66a2-4177-bb46-f1729f11d16b)" error: rpc error: code = Unknown desc = Error: No such container: d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57
Feb 8 11:28:27 localhost kubelet: E0208 11:28:27.467708 3736 kuberuntime_manager.go:965] PodSandboxStatus of sandbox "d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57" for pod "coredns-85bb79f4b4-kwb8z_kube-system(3e70fe3d-66a2-4177-bb46-f1729f11d16b)" error: rpc error: code = Unknown desc = Error: No such container: d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57
Feb 8 11:28:27 localhost kubelet: E0208 11:28:27.469564 3736 kuberuntime_manager.go:965] PodSandboxStatus of sandbox "7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071" for pod "coredns-85bb79f4b4-jddhw_kube-system(8313d926-3ede-4d55-997a-848c590768c6)" error: rpc error: code = Unknown desc = Error: No such container: 7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071
Feb 8 11:28:27 localhost kubelet: E0208 11:28:27.471422 3736 kuberuntime_manager.go:965] PodSandboxStatus of sandbox "d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57" for pod "coredns-85bb79f4b4-kwb8z_kube-system(3e70fe3d-66a2-4177-bb46-f1729f11d16b)" error: rpc error: code = Unknown desc = Error: No such container: d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57
Feb 8 11:28:27 localhost kubelet: E0208 11:28:27.473238 3736 kuberuntime_manager.go:965] PodSandboxStatus of sandbox "7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071" for pod "coredns-85bb79f4b4-jddhw_kube-system(8313d926-3ede-4d55-997a-848c590768c6)" error: rpc error: code = Unknown desc = Error: No such container: 7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071
Feb 8 11:28:29 localhost containerd: time="2022-02-08T11:28:29.743079878+08:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57 pid=8023
Feb 8 11:28:29 localhost systemd: Started libcontainer container d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57.
Feb 8 11:28:29 localhost systemd: Couldn't stat device /dev/char/10:200
Feb 8 11:28:30 localhost containerd: time="2022-02-08T11:28:30.480013207+08:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071 pid=8082
Feb 8 11:28:30 localhost systemd: Started libcontainer container 7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071.
Feb 8 11:28:30 localhost systemd: Couldn't stat device /dev/char/10:200
Feb 8 11:28:30 localhost kubelet: W0208 11:28:30.749269 3736 pod_container_deletor.go:79] Container "d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57" not found in pod's containers
Feb 8 11:28:31 localhost kubelet: W0208 11:28:31.168093 3736 pod_container_deletor.go:79] Container "7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071" not found in pod's containers
Feb 8 11:28:38 localhost systemd-logind: New session 1437 of user root.
Feb 8 11:28:38 localhost systemd: Started Session 1437 of user root.
Feb 8 11:28:48 localhost containerd: time="2022-02-08T11:28:48.346419616+08:00" level=info msg="shim disconnected" id=cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66
Feb 8 11:28:48 localhost containerd: time="2022-02-08T11:28:48.347154529+08:00" level=error msg="copy shim log" error="read /proc/self/fd/57: file already closed"
Feb 8 11:28:48 localhost dockerd: time="2022-02-08T11:28:48.345725065+08:00" level=info msg="ignoring event" container=cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 8 11:28:50 localhost kubelet: I0208 11:28:50.388930 3736 scope.go:111] [topologymanager] RemoveContainer - Container ID: cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66
Feb 8 11:28:50 localhost kubelet: E0208 11:28:50.390600 3736 pod_workers.go:191] Error syncing pod 73fe1803-0e75-48d5-a547-5feb7e6f5a11 ("cilium-mks7d_kube-system(73fe1803-0e75-48d5-a547-5feb7e6f5a11)"), skipping: failed to "StartContainer" for "cilium-agent" with CrashLoopBackOff: "back-off 10s restarting failed container=cilium-agent pod=cilium-mks7d_kube-system(73fe1803-0e75-48d5-a547-5feb7e6f5a11)"
Feb 8 11:28:50 localhost kubelet: I0208 11:28:50.391174 3736 scope.go:111] [topologymanager] RemoveContainer - Container ID: fd67367ec3db6863f7e25c268f91adc5e00df2b80e124eda51c1de92f20628a7
Feb 8 11:29:00 localhost kubelet: E0208 11:29:00.860877 3736 cni.go:366] Error adding kube-system_coredns-85bb79f4b4-kwb8z/d5329aa45c09e5c2d2df343ef3fac34ce367c4b95fa213d491ef372368846a57 to network cilium-cni/cilium: unable to connect to Cilium daemon: failed to create cilium agent client after 30.000000 seconds timeout: Get "http:///var/run/cilium/cilium.sock/v1/config": dial unix /var/run/cilium/cilium.sock: connect: no such file or directory
Feb 8 11:29:00 localhost kubelet: Is the agent running?
Feb 8 11:29:01 localhost kubelet: I0208 11:29:01.030233 3736 scope.go:111] [topologymanager] RemoveContainer - Container ID: cd7099b11ca1ad381c89858d00116a382fc9fe6964843af01fc53d7e751c0c66
Feb 8 11:29:01 localhost kubelet: E0208 11:29:01.287706 3736 cni.go:366] Error adding kube-system_coredns-85bb79f4b4-jddhw/7f39c7f3bff44ec7c1608d75770f4de2868ae9a3c08ff0ea243b7b8af2670071 to network cilium-cni/cilium: unable to connect to Cilium daemon: failed to create cilium agent client after 30.000000 seconds timeout: Get "http:///var/run/cilium/cilium.sock/v1/config": dial unix /var/run/cilium/cilium.sock: connect: no such file or directory
Feb 8 11:29:01 localhost kubelet: Is the agent running?
Feb 8 11:29:01 localhost systemd: Started Session 1438 of user root.
Feb 8 11:29:01 localhost crond: sendmail: fatal: parameter inet_interfaces: no local interface found for ::1
Feb 8 11:29:03 localhost containerd: time="2022-02-08T11:29:03.123942236+08:00" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/096c99288792d04b6cc31705105c70a63bd1d02af740c462c5438a2a9d0f0e4f pid=8912
Feb 8 11:29:03 localhost systemd: Started libcontainer container 096c99288792d04b6cc31705105c70a63bd1d02af740c462c5438a2a9d0f0e4f.
ERROR Summary:
[2022-02-08T11:42:03.367923589+0800]: ERROR: [waiting] cilium-node pods ready failed.
[2022-02-08T11:48:46.124565883+0800]: ERROR: [waiting] hubble-relay pods ready failed.
[2022-02-08T11:48:49.720552849+0800]: ERROR: [command] get node_port value failed.
[2022-02-08T11:50:47.687143866+0800]: ERROR: [download] kubernetes-dashboard.yml failed.
[2022-02-08T11:51:22.444082068+0800]: ERROR: [apply] add /tmp/kainstall-offline-file//manifests/kubernetes-dashboard.yml failed.
[2022-02-08T11:51:58.267282739+0800]: ERROR: [apply] add kubernetes dashboard ingress failed.
ACCESS Summary:
[ingress] curl -H 'Host:hubble-ui.cluster.local' http://192.168.122.95:nodePort
[ingress] curl -H 'Host:app.demo.com' http://192.168.122.95:30385
[ops] etcd backup directory: /var/lib/etcd/backups
lework commented
1.9 版本的cilium 有些问题，我提交了一个issues给官方，cilium/cilium#18734