Kind: Cant create a cluster using image v1.13.10
Issue
We cant create a cluster against docker 1.13 using the node image version: 1.13.10 and kind v0.5.1
export DOCKER_HOST=tcp://192.168.99.50:2376
export DOCKER_TLS_VERIFY=
docker info
Client:
Debug Mode: false
Server:
Containers: 0
Running: 0
Paused: 0
Stopped: 0
Images: 2
Server Version: 1.13.1
Storage Driver: overlay2
Backing Filesystem: xfs
Supports d_type: true
Native Overlay Diff: true
Logging Driver: journald
Cgroup Driver: systemd
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log:
Swarm: inactive
Runtimes: docker-runc runc
Default Runtime: docker-runc
Init Binary: /usr/libexec/docker/docker-init-current
containerd version: (expected: aa8187dbd3b7ad67d8e5e3a15115d3eef43a7ed1)
runc version: 9c3c5f853ebf0ffac0d087e94daef462133b69c7 (expected: 9df8b306d01f59d3a8029be411de015b7304dd8f)
init version: fec3683b971d9c3ef73f284f176672c44b448662 (expected: 949e6facb77383876aeff8a6944dde66b3089574)
Security Options:
seccomp
WARNING: You're not using the default seccomp profile
Profile: /etc/docker/seccomp.json
selinux
Kernel Version: 3.10.0-693.17.1.el7.x86_64
Operating System: CentOS Linux 7 (Core)
OSType: linux
Architecture: x86_64
CPUs: 2
Total Memory: 5.532GiB
Name: cloud
ID: AZJU:4DW4:3F3J:2MFV:IRDO:FDMA:NK4X:GKFB:F3ZD:NEQV:G4KH:MHYX
Docker Root Dir: /var/lib/docker
Debug Mode: false
Registry: https://index.docker.io/v1/
Experimental: false
Insecure Registries:
192.168.99.50:2376
172.30.0.0/16
127.0.0.0/8
Live Restore Enabled: false
WARNING: bridge-nf-call-iptables is disabled
WARNING: bridge-nf-call-ip6tables is disabled
kind create cluster --loglevel debug --name halkyon \
--config kind-config.yml \
--image kindest/node:v1.13.10
DEBU[19:18:14] Running: /usr/local/bin/docker [docker ps -q -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Names}}\t{{.Label "io.k8s.sigs.kind.cluster"}}]
Creating cluster "halkyon" ...
DEBU[19:18:14] Running: /usr/local/bin/docker [docker inspect --type=image kindest/node:v1.13.10]
INFO[19:18:15] Image: kindest/node:v1.13.10 present locally
✓ Ensuring node image (kindest/node:v1.13.10) 🖼
DEBU[19:18:15] Running: /usr/local/bin/docker [docker info --format '{{json .SecurityOptions}}']
DEBU[19:18:15] Running: /usr/local/bin/docker [docker run --detach --tty --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run --volume /var --volume /lib/modules:/lib/modules:ro --hostname halkyon-control-plane --name halkyon-control-plane --label io.k8s.sigs.kind.cluster=halkyon --label io.k8s.sigs.kind.role=control-plane --expose 63424 --publish=192.168.99.50:63424:6443/TCP kindest/node:v1.13.10]
✓ Preparing nodes 📦
DEBU[19:18:17] Running: /usr/local/bin/docker [docker ps -q -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Names}}\t{{.Label "io.k8s.sigs.kind.cluster"}} --filter label=io.k8s.sigs.kind.cluster=halkyon]
DEBU[19:18:17] Running: /usr/local/bin/docker [docker inspect -f {{index .Config.Labels "io.k8s.sigs.kind.role"}} halkyon-control-plane]
DEBU[19:18:17] Running: /usr/local/bin/docker [docker exec --privileged halkyon-control-plane cat /kind/version]
DEBU[19:18:18] Running: /usr/local/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} halkyon-control-plane]
DEBU[19:18:18] Running: /usr/local/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} halkyon-control-plane]
DEBU[19:18:18] Configuration Input data: {halkyon v1.13.10 172.17.0.2:6443 6443 192.168.99.50 true 172.17.0.2 abcdef.0123456789abcdef 10.244.0.0/16 10.96.0.0/12 false {}}
DEBU[19:18:18] Configuration generated:
# config generated by kind
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
metadata:
name: config
kubernetesVersion: v1.13.10
clusterName: "halkyon"
controlPlaneEndpoint: "172.17.0.2:6443"
# on docker for mac we have to expose the api server via port forward,
# so we need to ensure the cert is valid for localhost so we can talk
# to the cluster after rewriting the kubeconfig to point to localhost
apiServer:
certSANs: [localhost, "192.168.99.50"]
controllerManager:
extraArgs:
enable-hostpath-provisioner: "true"
# configure ipv6 default addresses for IPv6 clusters
scheduler:
extraArgs:
# configure ipv6 default addresses for IPv6 clusters
networking:
podSubnet: "10.244.0.0/16"
serviceSubnet: "10.96.0.0/12"
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
metadata:
name: config
# we use a well know token for TLS bootstrap
bootstrapTokens:
- token: "abcdef.0123456789abcdef"
# we use a well know port for making the API server discoverable inside docker network.
# from the host machine such port will be accessible via a random local port instead.
localAPIEndpoint:
advertiseAddress: "172.17.0.2"
bindPort: 6443
nodeRegistration:
criSocket: "/run/containerd/containerd.sock"
kubeletExtraArgs:
fail-swap-on: "false"
node-ip: "172.17.0.2"
---
# no-op entry that exists solely so it can be patched
apiVersion: kubeadm.k8s.io/v1beta1
kind: JoinConfiguration
metadata:
name: config
controlPlane:
localAPIEndpoint:
advertiseAddress: "172.17.0.2"
bindPort: 6443
nodeRegistration:
criSocket: "/run/containerd/containerd.sock"
kubeletExtraArgs:
fail-swap-on: "false"
node-ip: "172.17.0.2"
discovery:
bootstrapToken:
apiServerEndpoint: "172.17.0.2:6443"
token: "abcdef.0123456789abcdef"
unsafeSkipCAVerification: true
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
metadata:
name: config
# configure ipv6 addresses in IPv6 mode
# disable disk resource management by default
# kubelet will see the host disk that the inner container runtime
# is ultimately backed by and attempt to recover disk space. we don't want that.
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
---
# no-op entry that exists solely so it can be patched
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
metadata:
name: config
DEBU[19:18:18] Using kubeadm config:
apiServer:
certSANs:
- localhost
- 192.168.99.50
apiVersion: kubeadm.k8s.io/v1beta1
clusterName: halkyon
controlPlaneEndpoint: 172.17.0.2:6443
controllerManager:
extraArgs:
enable-hostpath-provisioner: "true"
kind: ClusterConfiguration
kubernetesVersion: v1.13.10
networking:
podSubnet: 10.244.0.0/16
serviceSubnet: 10.96.0.0/12
scheduler:
extraArgs: null
---
apiVersion: kubeadm.k8s.io/v1beta1
bootstrapTokens:
- token: abcdef.0123456789abcdef
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 172.17.0.2
bindPort: 6443
nodeRegistration:
criSocket: /run/containerd/containerd.sock
kubeletExtraArgs:
fail-swap-on: "false"
node-ip: 172.17.0.2
---
apiVersion: kubeadm.k8s.io/v1beta1
controlPlane:
localAPIEndpoint:
advertiseAddress: 172.17.0.2
bindPort: 6443
discovery:
bootstrapToken:
apiServerEndpoint: 172.17.0.2:6443
token: abcdef.0123456789abcdef
unsafeSkipCAVerification: true
kind: JoinConfiguration
nodeRegistration:
criSocket: /run/containerd/containerd.sock
kubeletExtraArgs:
fail-swap-on: "false"
node-ip: 172.17.0.2
---
apiVersion: kubelet.config.k8s.io/v1beta1
evictionHard:
imagefs.available: 0%
nodefs.available: 0%
nodefs.inodesFree: 0%
imageGCHighThresholdPercent: 100
kind: KubeletConfiguration
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
DEBU[19:18:18] Running: /usr/local/bin/docker [docker exec --privileged halkyon-control-plane mkdir -p /kind]
DEBU[19:18:18] Running: /usr/local/bin/docker [docker exec --privileged -i halkyon-control-plane cp /dev/stdin /kind/kubeadm.conf]
✓ Creating kubeadm config 📜
DEBU[19:18:18] Running: /usr/local/bin/docker [docker exec --privileged halkyon-control-plane kubeadm init --ignore-preflight-errors=all --config=/kind/kubeadm.conf --skip-token-print --v=6]
DEBU[19:20:35] I1021 17:18:19.018005 52 initconfiguration.go:169] loading configuration from the given file
[config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta1, Kind=JoinConfiguration
W1021 17:18:19.019620 52 common.go:86] WARNING: Detected resource kinds that may not apply: [InitConfiguration JoinConfiguration]
[init] Using Kubernetes version: v1.13.10
[preflight] Running pre-flight checks
I1021 17:18:19.024100 52 feature_gate.go:206] feature gates: &{map[]}
I1021 17:18:19.024452 52 checks.go:572] validating Kubernetes and kubeadm version
I1021 17:18:19.024486 52 checks.go:171] validating if the firewall is enabled and active
I1021 17:18:35.178274 52 checks.go:208] validating availability of port 6443
I1021 17:18:35.178676 52 checks.go:208] validating availability of port 10251
I1021 17:18:35.178719 52 checks.go:208] validating availability of port 10252
I1021 17:18:35.178750 52 checks.go:283] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
I1021 17:18:35.178767 52 checks.go:283] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
I1021 17:18:35.178773 52 checks.go:283] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
I1021 17:18:35.178778 52 checks.go:283] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
I1021 17:18:35.178788 52 checks.go:430] validating if the connectivity type is via proxy or direct
I1021 17:18:35.178825 52 checks.go:466] validating http connectivity to first IP address in the CIDR
I1021 17:18:35.178839 52 checks.go:466] validating http connectivity to first IP address in the CIDR
I1021 17:18:35.178847 52 checks.go:104] validating the container runtime
I1021 17:18:35.187471 52 checks.go:373] validating the presence of executable crictl
I1021 17:18:35.187508 52 checks.go:332] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
[WARNING FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]: /proc/sys/net/bridge/bridge-nf-call-iptables does not exist
I1021 17:18:35.187930 52 checks.go:332] validating the contents of file /proc/sys/net/ipv4/ip_forward
I1021 17:18:35.187995 52 checks.go:644] validating whether swap is enabled or not
I1021 17:18:35.188056 52 checks.go:373] validating the presence of executable ip
I1021 17:18:35.188464 52 checks.go:373] validating the presence of executable iptables
I1021 17:18:35.188510 52 checks.go:373] validating the presence of executable mount
I1021 17:18:35.188527 52 checks.go:373] validating the presence of executable nsenter
I1021 17:18:35.188549 52 checks.go:373] validating the presence of executable ebtables
I1021 17:18:35.188586 52 checks.go:373] validating the presence of executable ethtool
I1021 17:18:35.188942 52 checks.go:373] validating the presence of executable socat
I1021 17:18:35.188996 52 checks.go:373] validating the presence of executable tc
I1021 17:18:35.189026 52 checks.go:373] validating the presence of executable touch
I1021 17:18:35.189049 52 checks.go:515] running all checks
[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/3.10.0-693.17.1.el7.x86_64\n", err: exit status 1
I1021 17:18:35.194260 52 checks.go:403] checking whether the given node name is reachable using net.LookupHost
I1021 17:18:35.194519 52 checks.go:613] validating kubelet version
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 3.10.0-693.17.1.el7.x86_64
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
I1021 17:18:35.251315 52 checks.go:130] validating if the service is enabled and active
I1021 17:18:36.220197 52 checks.go:208] validating availability of port 10250
I1021 17:18:36.220392 52 checks.go:208] validating availability of port 2379
I1021 17:18:36.220443 52 checks.go:208] validating availability of port 2380
I1021 17:18:36.220472 52 checks.go:245] validating the existence and emptiness of directory /var/lib/etcd
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I1021 17:18:36.228623 52 checks.go:833] image exists: k8s.gcr.io/kube-apiserver:v1.13.10
I1021 17:18:36.236403 52 checks.go:833] image exists: k8s.gcr.io/kube-controller-manager:v1.13.10
I1021 17:18:36.245359 52 checks.go:833] image exists: k8s.gcr.io/kube-scheduler:v1.13.10
I1021 17:18:36.251675 52 checks.go:833] image exists: k8s.gcr.io/kube-proxy:v1.13.10
I1021 17:18:36.259759 52 checks.go:833] image exists: k8s.gcr.io/pause:3.1
I1021 17:18:36.283438 52 checks.go:833] image exists: k8s.gcr.io/etcd:3.2.24
I1021 17:18:36.290617 52 checks.go:833] image exists: k8s.gcr.io/coredns:1.2.6
I1021 17:18:36.290651 52 kubelet.go:71] Stopping the kubelet
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1021 17:18:36.306135 52 kubelet.go:89] Starting the kubelet
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
I1021 17:18:36.375275 52 certs.go:113] creating a new certificate authority for front-proxy-ca
[certs] Using certificateDir folder "/etc/kubernetes/pki"
[certs] Generating "front-proxy-ca" certificate and key
I1021 17:18:36.890645 52 certs.go:113] creating a new certificate authority for etcd-ca
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [halkyon-control-plane localhost] and IPs [172.17.0.2 127.0.0.1 ::1]
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [halkyon-control-plane localhost] and IPs [172.17.0.2 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
I1021 17:18:37.876960 52 certs.go:113] creating a new certificate authority for ca
[certs] Generating "ca" certificate and key
[certs] Generating "apiserver-kubelet-client" certificate and key
I1021 17:18:38.452684 52 certs.go:72] creating a new public/private key files for signing service account users
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [halkyon-control-plane kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 172.17.0.2 172.17.0.2 192.168.99.50]
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1021 17:18:38.720937 52 kubeconfig.go:92] creating kubeconfig file for admin.conf
[kubeconfig] Writing "admin.conf" kubeconfig file
I1021 17:18:39.302674 52 kubeconfig.go:92] creating kubeconfig file for kubelet.conf
[kubeconfig] Writing "kubelet.conf" kubeconfig file
I1021 17:18:39.670615 52 kubeconfig.go:92] creating kubeconfig file for controller-manager.conf
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1021 17:18:40.041877 52 kubeconfig.go:92] creating kubeconfig file for scheduler.conf
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
I1021 17:18:40.235927 52 manifests.go:97] [control-plane] getting StaticPodSpecs
[control-plane] Creating static Pod manifest for "kube-controller-manager"
I1021 17:18:40.243128 52 manifests.go:113] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
I1021 17:18:40.243180 52 manifests.go:97] [control-plane] getting StaticPodSpecs
I1021 17:18:40.245189 52 manifests.go:113] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
I1021 17:18:40.245233 52 manifests.go:97] [control-plane] getting StaticPodSpecs
[control-plane] Creating static Pod manifest for "kube-scheduler"
I1021 17:18:40.246049 52 manifests.go:113] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1021 17:18:40.246863 52 local.go:60] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"
I1021 17:18:40.246938 52 waitcontrolplane.go:89] [wait-control-plane] Waiting for the API server to be healthy
I1021 17:18:40.247782 52 loader.go:359] Config loaded from file /etc/kubernetes/admin.conf
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I1021 17:18:40.249320 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:40.752152 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:41.251027 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:41.756916 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:42.252720 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:42.751009 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:43.252657 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:43.750815 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:44.249934 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:44.753703 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:45.250445 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:45.751021 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:46.250937 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:46.752298 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:47.252270 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:47.750342 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:48.252956 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:48.750627 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:49.252002 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:49.751004 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:50.251887 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:50.753528 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:51.251546 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:51.757226 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 7 milliseconds
I1021 17:18:52.250269 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:52.758729 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:53.251466 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:53.751651 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:54.249771 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:54.750382 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:55.252487 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:55.750999 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:56.251102 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:56.749890 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:57.253195 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:57.752647 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:58.252855 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:58.750910 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:59.249775 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:18:59.753186 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:00.250729 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:00.750344 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:01.250755 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:01.750055 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:02.250577 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:02.753162 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:03.251025 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:03.752754 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:04.250596 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:04.751786 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:05.251361 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:05.752730 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:06.252222 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:06.751756 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:07.249870 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:07.753218 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 1 milliseconds
I1021 17:19:08.251486 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:08.750971 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:09.251296 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:09.749948 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:10.251852 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:10.750395 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:11.250491 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:11.751428 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:12.249841 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:12.752898 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:13.251443 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:13.752143 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:14.252187 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:14.751236 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:15.251107 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:15.752333 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:16.250717 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:16.751496 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:17.250589 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:17.751279 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:18.251083 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:18.750638 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:19.250727 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:19.750266 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:20.251133 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
I1021 17:19:20.761134 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 1 milliseconds
I1021 17:19:21.250239 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:21.750241 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:22.252766 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:22.750085 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:23.252599 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:23.751081 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:24.251012 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:24.750888 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:25.249769 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
I1021 17:19:25.750500 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:26.251809 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:26.750339 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:27.251613 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:27.750144 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:28.250010 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:28.751623 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:29.250767 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:29.750040 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:30.251572 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:30.750956 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:31.251604 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:31.749856 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:32.249958 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:32.754142 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:33.251089 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:33.754533 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:34.251307 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:34.750943 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 1 milliseconds
I1021 17:19:35.252962 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
I1021 17:19:35.751658 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:36.250575 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:36.752756 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:37.256659 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:37.751047 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:38.257394 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:38.753674 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:39.253549 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:39.749810 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:40.253076 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:40.750622 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:41.249931 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:41.750938 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:42.252680 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:42.751627 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:43.250394 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:43.752049 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:44.249755 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:44.752237 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:45.251113 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:45.751738 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:46.251057 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:46.752597 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:47.251410 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:47.750868 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:48.253449 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:48.750390 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:49.254145 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:49.751643 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:50.249782 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:50.753368 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:51.250098 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:51.751294 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:52.250548 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:52.749946 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:53.253680 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:53.750452 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:54.250979 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:54.750900 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:55.251083 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
I1021 17:19:55.754309 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:56.252660 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:56.749906 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:57.250872 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:57.750833 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:58.250735 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:58.749900 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:59.251405 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:19:59.752163 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:00.249742 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:00.751088 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:01.250746 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:01.750914 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:02.252604 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:02.750741 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:03.250613 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:03.753018 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:04.252224 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:04.750218 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:05.252003 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:05.752306 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:06.250826 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:06.749920 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:07.249787 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:07.750885 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:08.251156 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:08.751080 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:09.254482 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:09.751078 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:10.252838 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:10.751016 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:11.251242 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:11.750317 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:12.250399 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:12.752894 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:13.249986 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:13.751577 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:14.250656 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:14.749992 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:15.250082 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:15.753700 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:16.251378 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:16.750673 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:17.250694 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:17.750562 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:18.252911 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:18.751035 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:19.249912 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:19.751692 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:20.250349 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:20.750818 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:21.251549 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:21.750718 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:22.250033 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:22.751191 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:23.252110 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:23.750013 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:24.250720 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:24.750345 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:25.251824 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:25.749930 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:26.249870 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:26.750192 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:27.250560 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:27.751262 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:28.250567 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:28.750540 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:29.250046 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:29.751280 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:30.250448 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:30.752121 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:31.249974 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:31.753563 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:32.251983 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:32.751207 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:33.250391 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:33.752118 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:34.250653 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:34.750535 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
I1021 17:20:35.250673 52 round_trippers.go:438] GET https://172.17.0.2:6443/healthz?timeout=32s in 0 milliseconds
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp [::1]:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
✗ Starting control-plane 🕹️
DEBU[19:20:35] Running: /usr/local/bin/docker [docker ps -q -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Names}}\t{{.Label "io.k8s.sigs.kind.cluster"}} --filter label=io.k8s.sigs.kind.cluster=halkyon]
DEBU[19:20:35] Running: /usr/local/bin/docker [docker rm -f -v halkyon-control-plane]
Error: failed to create cluster: failed to init node with kubeadm: exit status 1
kinsupport
cmoulliard
All 12 comments
Could the error be related to this error Failed to create symlink /sys/fs/cgroup/net_cls: File exists ?
See docker container log
docker logs 2121163f1f81
INFO: ensuring we can execute /bin/mount even with userns-remap
INFO: remounting /sys read-only
INFO: making mounts shared
INFO: clearing and regenerating /etc/machine-id
Initializing machine ID from random generator.
INFO: faking /sys/class/dmi/id/product_name to be "kind"
systemd 240 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
Detected virtualization docker.
Detected architecture x86-64.
Failed to create symlink /sys/fs/cgroup/net_cls: File exists
Failed to create symlink /sys/fs/cgroup/net_prio: File exists
Failed to create symlink /sys/fs/cgroup/cpu: File exists
Failed to create symlink /sys/fs/cgroup/cpuacct: File exists
Welcome to Ubuntu Disco Dingo (development branch)!
Set hostname to <halkyon-control-plane>.
File /lib/systemd/system/systemd-journald.service:12 configures an IP firewall (IPAddressDeny=any), but the local system does not support BPF/cgroup based firewalling.
Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.)
Configuration file /kind/systemd/kubelet.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
Configuration file /etc/systemd/system/kubelet.service.d/10-kubeadm.conf is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ OK ] Listening on Journal Socket (/dev/log).
[ OK ] Reached target Local File Systems.
[ OK ] Set up automount Arbitrary…s File System Automount Point.
[ OK ] Reached target Slices.
[ OK ] Started Dispatch Password …ts to Console Directory Watch.
[ OK ] Reached target Paths.
[ OK ] Reached target Local Encrypted Volumes.
[ OK ] Listening on Journal Socket.
Starting Journal Service...
Starting Create System Users...
Mounting Huge Pages File System...
Starting Apply Kernel Variables...
Mounting Kernel Debug File System...
Starting Create list of re…odes for the current kernel...
[ OK ] Reached target Swap.
[ OK ] Reached target Sockets.
Starting Update UTMP about System Boot/Shutdown...
[ OK ] Mounted Kernel Debug File System.
[ OK ] Started Create list of req… nodes for the current kernel.
[ OK ] Mounted Huge Pages File System.
[ OK ] Started Apply Kernel Variables.
[ OK ] Started Update UTMP about System Boot/Shutdown.
[ OK ] Started Create System Users.
Starting Create Static Device Nodes in /dev...
[ OK ] Started Journal Service.
Starting Flush Journal to Persistent Storage...
Can you please share:
~your host information including docker~
- which image SHA (see the release notes regarding pinning images)
BenTheElder
on 21 Oct 2019
This looks like a dupe of https://github.com/kubernetes-sigs/kind/issues/820 ?
Edit: does a newer version of Kubernetes work?
BenTheElder
on 21 Oct 2019
Kubernetes work?
yes. That works with 1.15
cmoulliard
on 21 Oct 2019
ACK, I don't think there's a lot we can do here, v1.13 and lower are not open for patching anymore, and kind only ships upstream Kubernetes.
BenTheElder
on 21 Oct 2019
The problem is that we cant use 1.13 but also 1.14. So how can we rely on tool such as Kind if we cant create a cluster to test projects qualified for 1.13, 1.14 ?
cmoulliard
on 21 Oct 2019
Kubernetes as a project currently supports 1.14, 1.15, 1.16, soon to be 1.15, 1.16, 1.17.
When a version goes out of support shortly after a new one is released the branch closes for all patches. We have no influence over this.
Per #820, 1.14+ should work.
https://kubernetes.io/docs/setup/release/version-skew-policy/#supported-versions
BenTheElder
on 21 Oct 2019
kind makes an additional best effort to support older versions, but technically we probably might not be able to do this on Kubernetes CI actually, the policy is unclear, so we're doing it for now anyhow.
We run tests back to Kubernetes 1.12 despite it being out of support, we had to drop 1.11 due to bugs we can't get fixed.
I also don't think we're likely to support docker that is nearly three years old:
Server Version: 1.13.1
These images should work on more recent hosts, and indeed we test Kubernetes 1.12, 1.13, 1.14, 1.15, 1.16, and master for conformance in CI.
BenTheElder
on 21 Oct 2019
I upgraded on centos7 docker to use this version
[root@cloud ~]# docker info
Client:
Debug Mode: false
Server:
Containers: 1
Running: 1
Paused: 0
Stopped: 0
Images: 3
Server Version: 19.03.4
Storage Driver: overlay2
and I can create a cluster using 1.13
cmoulliard
on 22 Oct 2019
🎉3
@cmoulliard is ok to close now?
aojea
on 22 Oct 2019
we added a note to the known issues https://github.com/kubernetes-sigs/kind/pull/998
https://kind.sigs.k8s.io/docs/user/known-issues/#older-docker-installations
BenTheElder
on 22 Oct 2019
Great to see that you added the note.
cmoulliard
on 23 Oct 2019
Was this page helpful?
0 / 5 - 0 ratings
Related issues
rajalokan
·
3Comments
mithunvikram
·
4Comments
Wenshiqi222
·
4Comments
i3oc9i
·
3Comments
rflorenc
·
3Comments
Most helpful comment
I upgraded on centos7 docker to use this version
and I can create a cluster using 1.13