Kind: Starting kind cluster with Podman fails

Created on 16 Jul 2020 · 9Comments · Source: kubernetes-sigs/kind

What happened
Running kind create cluster on Fedora 32 with podman fails with the following error

[root@meanmachine ~]# kind create cluster -v 1
enabling experimental podman provider
Creating cluster "kind" ...
DEBUG: podman/images.go:58] Image: kindest/node@sha256:d8ff5fc405fc679dd3dd0cccc01543ba4942ed90823817d2e9e2c474a5343c4f present locally
 ✓ Ensuring node image (kindest/node:v1.18.4) 🖼
 ✓ Preparing nodes 📦  
 ✓ Writing configuration 📜 
 ✗ Starting control-plane 🕹️ 
ERROR: failed to create cluster: failed to init node with kubeadm: command "podman exec --privileged kind-control-plane kubeadm init --ignore-preflight-errors=all --config=/kind/kubeadm.conf --skip-token-print --v=6" failed with error: exit status 1
Command Output: I0716 17:55:51.755941     120 initconfiguration.go:200] loading configuration from "/kind/kubeadm.conf"
[config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta2, Kind=JoinConfiguration
W0716 17:55:51.759962     120 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
[init] Using Kubernetes version: v1.18.2
[preflight] Running pre-flight checks
I0716 17:55:51.760107     120 checks.go:577] validating Kubernetes and kubeadm version
I0716 17:55:51.760120     120 checks.go:166] validating if the firewall is enabled and active
I0716 17:55:51.765850     120 checks.go:201] validating availability of port 6443
I0716 17:55:51.766002     120 checks.go:201] validating availability of port 10259
I0716 17:55:51.766027     120 checks.go:201] validating availability of port 10257
I0716 17:55:51.766050     120 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
I0716 17:55:51.766068     120 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
I0716 17:55:51.766077     120 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
I0716 17:55:51.766082     120 checks.go:286] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
I0716 17:55:51.766090     120 checks.go:432] validating if the connectivity type is via proxy or direct
I0716 17:55:51.766113     120 checks.go:471] validating http connectivity to first IP address in the CIDR
I0716 17:55:51.766128     120 checks.go:471] validating http connectivity to first IP address in the CIDR
I0716 17:55:51.766136     120 checks.go:102] validating the container runtime
I0716 17:55:51.772737     120 checks.go:376] validating the presence of executable crictl
I0716 17:55:51.772767     120 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
    [WARNING FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]: /proc/sys/net/bridge/bridge-nf-call-iptables does not exist
I0716 17:55:51.772800     120 checks.go:335] validating the contents of file /proc/sys/net/ipv4/ip_forward
I0716 17:55:51.772859     120 checks.go:649] validating whether swap is enabled or not
    [WARNING Swap]: running with swap on is not supported. Please disable swap
I0716 17:55:51.772898     120 checks.go:376] validating the presence of executable conntrack
I0716 17:55:51.772936     120 checks.go:376] validating the presence of executable ip
I0716 17:55:51.772952     120 checks.go:376] validating the presence of executable iptables
I0716 17:55:51.772970     120 checks.go:376] validating the presence of executable mount
I0716 17:55:51.772986     120 checks.go:376] validating the presence of executable nsenter
I0716 17:55:51.773014     120 checks.go:376] validating the presence of executable ebtables
I0716 17:55:51.773038     120 checks.go:376] validating the presence of executable ethtool
I0716 17:55:51.773053     120 checks.go:376] validating the presence of executable socat
I0716 17:55:51.773076     120 checks.go:376] validating the presence of executable tc
I0716 17:55:51.773094     120 checks.go:376] validating the presence of executable touch
I0716 17:55:51.773114     120 checks.go:520] running all checks
I0716 17:55:51.782018     120 checks.go:406] checking whether the given node name is reachable using net.LookupHost
I0716 17:55:52.055070     120 checks.go:618] validating kubelet version
I0716 17:55:52.115394     120 checks.go:128] validating if the service is enabled and active
I0716 17:55:52.121070     120 checks.go:201] validating availability of port 10250
I0716 17:55:52.121134     120 checks.go:201] validating availability of port 2379
I0716 17:55:52.121152     120 checks.go:201] validating availability of port 2380
I0716 17:55:52.121168     120 checks.go:249] validating the existence and emptiness of directory /var/lib/etcd
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0716 17:55:52.124865     120 checks.go:838] image exists: k8s.gcr.io/kube-apiserver:v1.18.2
I0716 17:55:52.131376     120 checks.go:838] image exists: k8s.gcr.io/kube-controller-manager:v1.18.2
I0716 17:55:52.134568     120 checks.go:838] image exists: k8s.gcr.io/kube-scheduler:v1.18.2
I0716 17:55:52.137931     120 checks.go:838] image exists: k8s.gcr.io/kube-proxy:v1.18.2
I0716 17:55:52.140983     120 checks.go:838] image exists: k8s.gcr.io/pause:3.2
I0716 17:55:52.144337     120 checks.go:838] image exists: k8s.gcr.io/etcd:3.4.3-0
I0716 17:55:52.147783     120 checks.go:838] image exists: k8s.gcr.io/coredns:1.6.7
I0716 17:55:52.147798     120 kubelet.go:64] Stopping the kubelet
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[certs] Using certificateDir folder "/etc/kubernetes/pki"
I0716 17:55:52.185236     120 certs.go:103] creating a new certificate authority for ca
[certs] Generating "ca" certificate and key
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [kind-control-plane kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.88.0.5 10.88.0.5 127.0.0.1]
[certs] Generating "apiserver-kubelet-client" certificate and key
I0716 17:55:52.409188     120 certs.go:103] creating a new certificate authority for front-proxy-ca
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
I0716 17:55:52.578351     120 certs.go:103] creating a new certificate authority for etcd-ca
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [kind-control-plane localhost] and IPs [10.88.0.5 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [kind-control-plane localhost] and IPs [10.88.0.5 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
I0716 17:55:53.351496     120 certs.go:69] creating new public/private key files for signing service account users
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0716 17:55:53.414715     120 kubeconfig.go:79] creating kubeconfig file for admin.conf
[kubeconfig] Writing "admin.conf" kubeconfig file
I0716 17:55:53.624520     120 kubeconfig.go:79] creating kubeconfig file for kubelet.conf
[kubeconfig] Writing "kubelet.conf" kubeconfig file
I0716 17:55:53.748395     120 kubeconfig.go:79] creating kubeconfig file for controller-manager.conf
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0716 17:55:53.846480     120 kubeconfig.go:79] creating kubeconfig file for scheduler.conf
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
I0716 17:55:53.961551     120 manifests.go:91] [control-plane] getting StaticPodSpecs
I0716 17:55:53.961777     120 manifests.go:104] [control-plane] adding volume "ca-certs" for component "kube-apiserver"
I0716 17:55:53.961783     120 manifests.go:104] [control-plane] adding volume "etc-ca-certificates" for component "kube-apiserver"
I0716 17:55:53.961785     120 manifests.go:104] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"
I0716 17:55:53.961788     120 manifests.go:104] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-apiserver"
I0716 17:55:53.961790     120 manifests.go:104] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
I0716 17:55:53.965344     120 manifests.go:121] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
I0716 17:55:53.965353     120 manifests.go:91] [control-plane] getting StaticPodSpecs
W0716 17:55:53.965382     120 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
I0716 17:55:53.965496     120 manifests.go:104] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"
I0716 17:55:53.965501     120 manifests.go:104] [control-plane] adding volume "etc-ca-certificates" for component "kube-controller-manager"
I0716 17:55:53.965503     120 manifests.go:104] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"
I0716 17:55:53.965506     120 manifests.go:104] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"
I0716 17:55:53.965509     120 manifests.go:104] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"
I0716 17:55:53.965512     120 manifests.go:104] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-controller-manager"
I0716 17:55:53.965516     120 manifests.go:104] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
I0716 17:55:53.966681     120 manifests.go:121] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
I0716 17:55:53.966701     120 manifests.go:91] [control-plane] getting StaticPodSpecs
W0716 17:55:53.966774     120 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
I0716 17:55:53.966955     120 manifests.go:104] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"
I0716 17:55:53.967232     120 manifests.go:121] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0716 17:55:53.967629     120 local.go:72] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"
I0716 17:55:53.967636     120 waitcontrolplane.go:87] [wait-control-plane] Waiting for the API server to be healthy
I0716 17:55:53.968102     120 loader.go:375] Config loaded from file:  /etc/kubernetes/admin.conf
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0716 17:55:53.968640     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:54.469512     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:54.969559     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:55.469144     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:55.969316     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:56.469174     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:56.969540     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:57.469437     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:57.969620     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:58.469505     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:58.969558     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:59.469461     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:55:59.969486     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:00.469502     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:00.969618     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:01.469598     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:01.969640     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:02.469584     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:02.969503     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:03.469582     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:03.969588     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:04.469583     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:04.969543     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:05.469584     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:05.969728     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:06.469520     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:06.969267     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:07.469112     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:07.969483     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:08.469258     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:08.969250     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:09.469228     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:09.969150     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:10.469277     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:10.969239     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:11.469563     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:11.969640     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:12.469581     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:12.969564     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:13.469541     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:13.969764     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:14.469786     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:14.969649     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:15.469538     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:15.969555     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:16.469430     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:16.969553     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:17.469539     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:17.969302     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:18.469477     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:18.970154     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 1 milliseconds
I0716 17:56:19.469578     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:19.969766     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:20.469737     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:20.969728     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:21.469775     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:21.969106     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:22.469153     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:22.969252     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:23.469417     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:23.969320     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:24.469352     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:24.969338     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:25.469330     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:25.968982     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:26.469241     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:26.969311     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:27.469515     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:27.969570     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:28.469501     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:28.969578     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:29.469597     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:29.969597     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:30.469588     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:30.969892     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:31.469724     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:31.969731     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:32.469745     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:32.969585     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:33.469581     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
[kubelet-check] Initial timeout of 40s passed.
I0716 17:56:33.969570     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
I0716 17:56:34.469480     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:34.969594     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:35.469290     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:35.969537     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:36.469125     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:36.969466     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:37.469231     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:37.969217     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:38.469062     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:38.969384     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
I0716 17:56:39.469105     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:39.969338     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:40.469182     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:40.969479     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:41.469304     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:41.969529     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:42.469594     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:42.969557     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:43.469499     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:43.969437     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:44.469497     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:44.969668     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:45.469498     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:45.969632     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:46.469459     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:46.969829     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:47.469522     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:47.969504     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:48.469641     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:48.969526     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
I0716 17:56:49.469619     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:49.969509     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:50.469611     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:50.969479     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:51.469517     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:51.969013     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:52.469052     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:52.969104     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:53.469210     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:53.969378     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:54.469238     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:54.969392     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:55.469249     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:55.969287     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:56.469245     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:56.969577     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:57.469624     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:57.969645     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:58.469709     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:58.969736     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:59.469580     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:56:59.969646     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:00.469667     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:00.969593     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:01.469522     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:01.969697     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:02.469663     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:02.969622     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:03.469522     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:03.969570     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:04.469800     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:04.969733     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:05.469518     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:05.969244     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:06.469537     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:06.969294     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:07.469218     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:07.969287     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:08.469277     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:08.969418     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
I0716 17:57:09.469325     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:09.969330     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:10.469139     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:10.969516     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:11.469517     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:11.969523     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:12.469588     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:12.969422     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:13.469426     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:13.969053     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:14.469482     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:14.969518     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:15.469599     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:15.972307     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 2 milliseconds
I0716 17:57:16.469659     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:16.969641     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:17.469603     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:17.969711     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:18.469601     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:18.969339     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:19.469505     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:19.969763     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:20.469559     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:20.969301     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:21.469225     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:21.969159     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:22.469549     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:22.969265     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:23.469349     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:23.969271     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:24.469301     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:24.969210     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:25.469287     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:25.969153     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:26.469529     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:26.969252     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:27.469532     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:27.969535     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:28.469493     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:28.969523     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:29.469491     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:29.969495     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:30.469472     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:30.969542     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:31.469571     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:31.969630     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:32.469641     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:32.969759     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:33.469501     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:33.969633     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:34.469491     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:34.969477     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:35.469070     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:35.969320     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:36.469359     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:36.969567     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:37.469318     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:37.969209     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:38.469490     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:38.969426     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:39.469123     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:39.969337     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:40.469245     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:40.969143     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:41.469375     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:41.969507     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:42.469590     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:42.969659     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:43.469092     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:43.969440     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:44.469720     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:44.969538     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:45.469544     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:45.969773     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:46.469524     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:46.969051     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:47.469170     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:47.969500     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:48.469466     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
I0716 17:57:48.969255     120 round_trippers.go:443] GET https://10.88.0.5:6443/healthz?timeout=10s  in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.

    Unfortunately, an error has occurred:
        timed out waiting for the condition

    This error is likely caused by:
        - The kubelet is not running
        - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

    If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
        - 'systemctl status kubelet'
        - 'journalctl -xeu kubelet'

    Additionally, a control plane component may have crashed or exited when started by the container runtime.
    To troubleshoot, list all containers using your preferred container runtimes CLI.

    Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
        - 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
        Once you have found the failing container, you can inspect its logs with:
        - 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID'

couldn't initialize a Kubernetes cluster
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/init.runWaitControlPlanePhase
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/init/waitcontrolplane.go:114
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:234
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:422
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func1
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:147
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
    _output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
    /usr/local/go/src/runtime/proc.go:203
runtime.goexit
    /usr/local/go/src/runtime/asm_amd64.s:1357
error execution phase wait-control-plane
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:235
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:422
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.NewCmdInit.func1
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:147
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:826
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:914
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:864
k8s.io/kubernetes/cmd/kubeadm/app.Run
    /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
    _output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
    /usr/local/go/src/runtime/proc.go:203
runtime.goexit
    /usr/local/go/src/runtime/asm_amd64.s:1357
Error: exec session exited with non-zero exit code 1: OCI runtime error
Stack Trace: 
sigs.k8s.io/kind/pkg/errors.WithStack
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/errors/errors.go:51
sigs.k8s.io/kind/pkg/exec.(*LocalCmd).Run
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/exec/local.go:124
sigs.k8s.io/kind/pkg/cluster/internal/providers/podman.(*nodeCmd).Run
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/cluster/internal/providers/podman/node.go:146
sigs.k8s.io/kind/pkg/exec.CombinedOutputLines
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/exec/helpers.go:67
sigs.k8s.io/kind/pkg/cluster/internal/create/actions/kubeadminit.(*action).Execute
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/cluster/internal/create/actions/kubeadminit/init.go:72
sigs.k8s.io/kind/pkg/cluster/internal/create.Cluster
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/cluster/internal/create/create.go:145
sigs.k8s.io/kind/pkg/cluster.(*Provider).Create
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/cluster/provider.go:143
sigs.k8s.io/kind/pkg/cmd/kind/create/cluster.runE
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/cmd/kind/create/cluster/createcluster.go:80
sigs.k8s.io/kind/pkg/cmd/kind/create/cluster.NewCommand.func1
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/cmd/kind/create/cluster/createcluster.go:55
github.com/spf13/cobra.(*Command).execute
    /root/go/pkg/mod/github.com/spf13/[email protected]/command.go:842
github.com/spf13/cobra.(*Command).ExecuteC
    /root/go/pkg/mod/github.com/spf13/[email protected]/command.go:950
github.com/spf13/cobra.(*Command).Execute
    /root/go/pkg/mod/github.com/spf13/[email protected]/command.go:887
sigs.k8s.io/kind/cmd/kind/app.Run
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/cmd/kind/app/main.go:53
sigs.k8s.io/kind/cmd/kind/app.Main
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/cmd/kind/app/main.go:35
main.main
    /root/go/pkg/mod/sigs.k8s.io/[email protected]/main.go:25
runtime.main
    /usr/lib/golang/src/runtime/proc.go:203
runtime.goexit
    /usr/lib/golang/src/runtime/asm_amd64.s:1373

What you expected to happen:
The cluster to spin up normally

How to reproduce it (as minimally and precisely as possible):
Download kind from master with go get sigs.k8s.io/kind@master

enter root user space with sudo su -

run kind create cluster

Anything else we need to know?:

Trying to run sudo kind create cluster does not work, I have to enter the root space with sudo su - before running any kind commands

Environment:
Fedora 32

kind version: (use kind version): kind v0.9.0-alpha go1.14.3 linux/amd64
Kubernetes version: (use kubectl version): Using Kubernetes version: v1.18.2
Docker version: (use docker info): Podman version 2.0.2
OS (e.g. from /etc/os-release): Fedora

kinbug

Source

astoycos

Most helpful comment

oh yes, we're not quite there yet, Kubernetes and KIND are getting patches
related to this.
https://github.com/kubernetes-sigs/kind/pull/1727 will support cgroupsv2
_docker_ / rootless once some patches land in kubernetes, but podman still
needs other changes.

On Thu, Jul 16, 2020 at 11:43 AM Andrew Stoycos notifications@github.com
wrote:

Ah the issue is probably because I am using cgroupsV2, I will try to
revert back now

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/kubernetes-sigs/kind/issues/1735#issuecomment-659598628,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAHADK7YR6ZWIS7PRJN7Z2DR35C47ANCNFSM4O4WU5CQ
.

BenTheElder on 16 Jul 2020

👍2

All 9 comments

possibly https://kind.sigs.k8s.io/docs/user/known-issues/#fedora32-firewalld, though that's only known for sure with docker.

BenTheElder on 16 Jul 2020

oh also podman 2 + requires a fix in some cases anyhow due to a podman change https://github.com/kubernetes-sigs/kind/issues/1734, what commit do you have installed? (go get can't build the commit info into kind version, only make install)

BenTheElder on 16 Jul 2020

Previously to me running kind from master (i.e just running version v0.8.1) I was seeing an apparmor related error so I will check into that. I installed kind with go get sigs.k8s.io/kind@master so not sure on the commit then. I can try to uninstall and then use make install

astoycos on 16 Jul 2020

Ah the issue is probably because I am using cgroupsV2, I will try to revert back now

astoycos on 16 Jul 2020

On Thu, Jul 16, 2020 at 11:43 AM Andrew Stoycos notifications@github.com
wrote:

Ah the issue is probably because I am using cgroupsV2, I will try to
revert back now

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/kubernetes-sigs/kind/issues/1735#issuecomment-659598628,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAHADK7YR6ZWIS7PRJN7Z2DR35C47ANCNFSM4O4WU5CQ
.

BenTheElder on 16 Jul 2020

👍2

Ah the issue is probably because I am using cgroupsV2, I will try to revert back now

yes that is definitely not working. Unless you use kubernetes git master, that is fine with cgroups v2. I've tested it a couple of days ago with kinD and Podman on Fedora 32 and cgroup v2. Rootless is going to take a while, I need to get CNI working inside of the rootless environment

giuseppe on 16 Jul 2020

👍1

Awesome, thank you!! 😀

On Thu, Jul 16, 2020, 13:29 Giuseppe Scrivano notifications@github.com
wrote:

Ah the issue is probably because I am using cgroupsV2, I will try to
revert back now

yes that is definitely not working. Unless you use kubernetes git master,
that is fine with cgroups v2. I've tested it a couple of days ago with kinD
and Podman on Fedora 32 and cgroup v2. Rootless is going to take a while, I
need to get CNI working inside of the rootless environment

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/kubernetes-sigs/kind/issues/1735#issuecomment-659654185,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAHADK55OLCW3ZOZ2ZHL7X3R35PKTANCNFSM4O4WU5CQ
.

BenTheElder on 16 Jul 2020

Yep I was seeing the same thing :), I've reverted back to cgroupsv1 and it seems to be alright now Thanks!

astoycos on 16 Jul 2020

Great!

On Thu, Jul 16, 2020 at 2:39 PM Andrew Stoycos notifications@github.com
wrote:

Yep I was seeing the same thing :), I've reverted back to cgroupsv1 and it
seems to be alright now Thanks!

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/kubernetes-sigs/kind/issues/1735#issuecomment-659689013,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAHADK73ROWSMCWXPVLN7EDR35XRFANCNFSM4O4WU5CQ
.