BUG REPORT (choose one):
Environment:
Minikube version: v0.26.0
minikube start --extra-config=apiserver.Admission.PluginNames=NamespaceLifecycle,LimitRanger,ServiceAccount,PersistentVolumeLabel,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota \
--kubernetes-version=v1.9.0 \
--v=5 --logtostderr --vm-driver=none
I did run kubeadm reset
&& minikube stop
&& minikube delete
every time to clean up before running minikube start
.
W0418 14:50:20.274069 3981 root.go:148] Error reading config file at /root/.minikube/config/config.json: open /root/.minikube/config/config.json: no such file or directory
I0418 14:50:20.274256 3981 notify.go:109] Checking for updates...
I0418 14:50:21.453244 3981 cache_images.go:292] Attempting to cache image: gcr.io/k8s-minikube/storage-provisioner:v1.8.0 at /root/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v1.8.0
I0418 14:50:21.453369 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.4 at /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-kube-dns-amd64_1.14.4
I0418 14:50:21.453454 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.4 at /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64_1.14.4
I0418 14:50:21.453531 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.4 at /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-sidecar-amd64_1.14.4
I0418 14:50:21.453607 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/etcd-amd64:3.0.17 at /root/.minikube/cache/images/k8s.gcr.io/etcd-amd64_3.0.17
I0418 14:50:21.453681 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/kube-proxy-amd64:v1.9.0 at /root/.minikube/cache/images/k8s.gcr.io/kube-proxy-amd64_v1.9.0
I0418 14:50:21.453778 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/kube-scheduler-amd64:v1.9.0 at /root/.minikube/cache/images/k8s.gcr.io/kube-scheduler-amd64_v1.9.0
I0418 14:50:21.453860 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/kube-controller-manager-amd64:v1.9.0 at /root/.minikube/cache/images/k8s.gcr.io/kube-controller-manager-amd64_v1.9.0
Starting local Kubernetes v1.9.0 cluster...
I0418 14:50:21.453934 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/kube-apiserver-amd64:v1.9.0 at /root/.minikube/cache/images/k8s.gcr.io/kube-apiserver-amd64_v1.9.0
Starting VM...
I0418 14:50:21.453245 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/pause-amd64:3.0 at /root/.minikube/cache/images/k8s.gcr.io/pause-amd64_3.0
I0418 14:50:21.454260 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/kubernetes-dashboard-amd64:v1.8.1 at /root/.minikube/cache/images/k8s.gcr.io/kubernetes-dashboard-amd64_v1.8.1
I0418 14:50:21.454299 3981 cluster.go:69] Machine does not exist... provisioning new machine
I0418 14:50:21.454285 3981 cache_images.go:292] Attempting to cache image: k8s.gcr.io/kube-addon-manager:v6.5 at /root/.minikube/cache/images/k8s.gcr.io/kube-addon-manager_v6.5
I0418 14:50:21.454839 3981 cache_images.go:79] Successfully cached all images.
I0418 14:50:21.454710 3981 cluster.go:70] Provisioning machine with config: {MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v0.26.0.iso Memory:2048 CPUs:2 DiskSize:20000 VMDriver:none XhyveDiskDriver:ahci-hd DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: KvmNetwork:default Downloader:{} DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID:}
Getting VM IP address...
I0418 14:50:21.457316 3981 interface.go:360] Looking for default routes with IPv4 addresses
I0418 14:50:21.457359 3981 interface.go:365] Default route transits interface "wlp3s0"
I0418 14:50:21.457630 3981 interface.go:174] Interface wlp3s0 is up
I0418 14:50:21.457827 3981 interface.go:222] Interface "wlp3s0" has 2 addresses :[192.168.3.123/24 fe80::9e4e:36ff:fed5:4e30/64].
I0418 14:50:21.457893 3981 interface.go:189] Checking addr 192.168.3.123/24.
I0418 14:50:21.457929 3981 interface.go:196] IP found 192.168.3.123
I0418 14:50:21.457968 3981 interface.go:228] Found valid IPv4 address 192.168.3.123 for interface "wlp3s0".
I0418 14:50:21.458004 3981 interface.go:371] Found active IP 192.168.3.123
Moving files into cluster...
I0418 14:50:21.459571 3981 kubeadm.go:207] Container runtime flag provided with no value, using defaults.
I0418 14:50:21.459613 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/etcd-amd64_3.0.17
I0418 14:50:21.459652 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/kube-addon-manager_v6.5
I0418 14:50:21.459745 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-kube-dns-amd64_1.14.4
I0418 14:50:21.461895 3981 exec_runner.go:39] Run: docker load -i /tmp/etcd-amd64_3.0.17
I0418 14:50:21.462339 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64_1.14.4
I0418 14:50:21.459617 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/kubernetes-dashboard-amd64_v1.8.1
I0418 14:50:21.469971 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/kube-controller-manager-amd64_v1.9.0
I0418 14:50:21.482064 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/kube-apiserver-amd64_v1.9.0
I0418 14:50:21.482476 3981 exec_runner.go:39] Run: docker load -i /tmp/kube-apiserver-amd64_v1.9.0
I0418 14:50:21.459574 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/pause-amd64_3.0
I0418 14:50:21.490893 3981 exec_runner.go:39] Run: docker load -i /tmp/pause-amd64_3.0
I0418 14:50:21.459574 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v1.8.0
I0418 14:50:21.459569 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-sidecar-amd64_1.14.4
I0418 14:50:21.469850 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/kube-proxy-amd64_v1.9.0
I0418 14:50:21.493952 3981 exec_runner.go:39] Run: docker load -i /tmp/k8s-dns-dnsmasq-nanny-amd64_1.14.4
I0418 14:50:21.469941 3981 cache_images.go:194] Loading image from cache at /root/.minikube/cache/images/k8s.gcr.io/kube-scheduler-amd64_v1.9.0
I0418 14:50:21.552875 3981 exec_runner.go:39] Run: docker load -i /tmp/kube-addon-manager_v6.5
I0418 14:50:21.586807 3981 exec_runner.go:39] Run: docker load -i /tmp/k8s-dns-sidecar-amd64_1.14.4
I0418 14:50:21.591471 3981 exec_runner.go:39] Run: docker load -i /tmp/kube-controller-manager-amd64_v1.9.0
I0418 14:50:21.607032 3981 exec_runner.go:39] Run: docker load -i /tmp/kube-scheduler-amd64_v1.9.0
I0418 14:50:21.613302 3981 exec_runner.go:39] Run: docker load -i /tmp/k8s-dns-kube-dns-amd64_1.14.4
I0418 14:50:21.630591 3981 exec_runner.go:39] Run: docker load -i /tmp/storage-provisioner_v1.8.0
I0418 14:50:21.642348 3981 exec_runner.go:39] Run: docker load -i /tmp/kube-proxy-amd64_v1.9.0
I0418 14:50:21.653070 3981 exec_runner.go:39] Run: docker load -i /tmp/kubernetes-dashboard-amd64_v1.8.1
I0418 14:50:21.731604 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/pause-amd64_3.0
I0418 14:50:21.741213 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/pause-amd64_3.0 from cache
I0418 14:50:21.958807 3981 exec_runner.go:39] Run:
sudo systemctl daemon-reload &&
sudo systemctl enable kubelet &&
sudo systemctl start kubelet
I0418 14:50:22.013588 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/k8s-dns-dnsmasq-nanny-amd64_1.14.4
I0418 14:50:22.018309 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/k8s-dns-sidecar-amd64_1.14.4
I0418 14:50:22.027390 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-sidecar-amd64_1.14.4 from cache
I0418 14:50:22.031763 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64_1.14.4 from cache
I0418 14:50:22.134365 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/kube-scheduler-amd64_v1.9.0
I0418 14:50:22.137355 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/kube-addon-manager_v6.5
I0418 14:50:22.148094 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/kube-scheduler-amd64_v1.9.0 from cache
I0418 14:50:22.150563 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/kube-addon-manager_v6.5 from cache
Setting up certs...
I0418 14:50:22.151549 3981 certs.go:47] Setting up certificates for IP: 192.168.3.123
Connecting to cluster...
I0418 14:50:22.169935 3981 interface.go:360] Looking for default routes with IPv4 addresses
I0418 14:50:22.169950 3981 interface.go:365] Default route transits interface "wlp3s0"
I0418 14:50:22.170039 3981 interface.go:174] Interface wlp3s0 is up
I0418 14:50:22.170082 3981 interface.go:222] Interface "wlp3s0" has 2 addresses :[192.168.3.123/24 fe80::9e4e:36ff:fed5:4e30/64].
I0418 14:50:22.170101 3981 interface.go:189] Checking addr 192.168.3.123/24.
I0418 14:50:22.170113 3981 interface.go:196] IP found 192.168.3.123
I0418 14:50:22.170122 3981 interface.go:228] Found valid IPv4 address 192.168.3.123 for interface "wlp3s0".
I0418 14:50:22.170133 3981 interface.go:371] Found active IP 192.168.3.123
Setting up kubeconfig...
I0418 14:50:22.170194 3981 config.go:101] Using kubeconfig: /root/.kube/config
Starting cluster components...
I0418 14:50:22.170971 3981 exec_runner.go:50] Run with output: sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap
I0418 14:50:22.372187 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/k8s-dns-kube-dns-amd64_1.14.4
I0418 14:50:22.374985 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/storage-provisioner_v1.8.0
I0418 14:50:22.386602 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/k8s-dns-kube-dns-amd64_1.14.4 from cache
I0418 14:50:22.387313 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/kube-controller-manager-amd64_v1.9.0
I0418 14:50:22.391763 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v1.8.0 from cache
I0418 14:50:22.400436 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/kube-controller-manager-amd64_v1.9.0 from cache
I0418 14:50:22.424973 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/kube-proxy-amd64_v1.9.0
I0418 14:50:22.442772 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/kube-proxy-amd64_v1.9.0 from cache
I0418 14:50:22.471827 3981 exec_runner.go:39] Run: sudo rm -rf /tmp/kubernetes-dashboard-amd64_v1.8.1
I0418 14:50:22.490794 3981 cache_images.go:220] Successfully loaded image /root/.minikube/cache/images/k8s.gcr.io/kubernetes-dashboard-amd64_v1.8.1 from cache
Apr 18 14:41:27 ubuntu systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Apr 18 14:41:27 ubuntu systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Apr 18 14:41:27 ubuntu systemd[1]: Started kubelet: The Kubernetes Node Agent.
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.283035 3728 feature_gate.go:220] feature gates: &{{} map[]}
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.283115 3728 controller.go:114] kubelet config controller: starting controller
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.283128 3728 controller.go:118] kubelet config controller: validating combination of defaults and flags
Apr 18 14:41:27 ubuntu kubelet[3728]: W0418 14:41:27.298858 3728 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.301784 3728 server.go:182] Version: v1.9.0
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.301847 3728 feature_gate.go:220] feature gates: &{{} map[]}
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.302060 3728 plugins.go:101] No cloud provider specified.
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.337412 3728 server.go:428] --cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.337668 3728 container_manager_linux.go:242] container manager verified user specified cgroup-root exists: /
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.337681 3728 container_manager_linux.go:247] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>} {Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>}]} ExperimentalQOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s}
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.337790 3728 container_manager_linux.go:266] Creating device plugin manager: false
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.337849 3728 kubelet.go:290] Adding manifest path: /etc/kubernetes/manifests
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.337869 3728 kubelet.go:313] Watching apiserver
Apr 18 14:41:27 ubuntu kubelet[3728]: E0418 14:41:27.338966 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:474: Failed to list *v1.Node: Get https://192.168.3.123:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:27 ubuntu kubelet[3728]: E0418 14:41:27.339073 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:465: Failed to list *v1.Service: Get https://192.168.3.123:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:27 ubuntu kubelet[3728]: E0418 14:41:27.339143 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.3.123:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:27 ubuntu kubelet[3728]: W0418 14:41:27.340299 3728 kubelet_network.go:139] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.340331 3728 kubelet.go:571] Hairpin mode set to "hairpin-veth"
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.341723 3728 client.go:80] Connecting to docker on unix:///var/run/docker.sock
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.342053 3728 client.go:109] Start docker client with request timeout=2m0s
Apr 18 14:41:27 ubuntu kubelet[3728]: W0418 14:41:27.344686 3728 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.347691 3728 docker_service.go:232] Docker cri networking managed by kubernetes.io/no-op
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.362625 3728 docker_service.go:237] Docker Info: &{ID:RT7J:6OWH:ZVZB:UVRZ:5KLP:DFQV:D7B4:OSNL:ORS6:WTI2:KQ5S:DJQ3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:18 Driver:aufs DriverStatus:[[Root Dir /var/lib/docker/aufs] [Backing Filesystem extfs] [Dirs 45] [Dirperm1 Supported true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[]} MemoryLimit:true SwapLimit:false KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:20 OomKillDisable:true NGoroutines:24 SystemTime:2018-04-18T14:41:27.351838853+08:00 LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.4.0-119-generic OperatingSystem:Ubuntu 16.04.4 LTS OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc4204a00e0 NCPU:4 MemTotal:8056209408 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu Labels:[] ExperimentalBuild:false ServerVersion:17.03.0-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:0xc42026e140} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:977c511eda0925a723debdc94d09459af49d082a Expected:977c511eda0925a723debdc94d09459af49d082a} RuncCommit:{ID:a01dafd48bc1c7cc12bdb01206f9fea7dd6feb70 Expected:a01dafd48bc1c7cc12bdb01206f9fea7dd6feb70} InitCommit:{ID:949e6fa Expected:949e6fa} SecurityOptions:[name=apparmor name=seccomp,profile=default]}
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.362752 3728 docker_service.go:250] Setting cgroupDriver to cgroupfs
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.376276 3728 remote_runtime.go:43] Connecting to runtime service unix:///var/run/dockershim.sock
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.383010 3728 kuberuntime_manager.go:186] Container runtime docker initialized, version: 17.03.0-ce, apiVersion: 1.26.0
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.384403 3728 server.go:755] Started kubelet
Apr 18 14:41:27 ubuntu kubelet[3728]: E0418 14:41:27.384823 3728 event.go:209] Unable to write event: 'Post https://192.168.3.123:8443/api/v1/namespaces/default/events: dial tcp 192.168.3.123:8443: getsockopt: connection refused' (may retry after sleeping)
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.385117 3728 server.go:129] Starting to listen on 0.0.0.0:10250
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.385398 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:27 ubuntu kubelet[3728]: E0418 14:41:27.385600 3728 kubelet.go:1275] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data for container /
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.388646 3728 server.go:299] Adding debug handlers to kubelet server.
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.417269 3728 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.417297 3728 status_manager.go:140] Starting to sync pod status with apiserver
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.417314 3728 kubelet.go:1767] Starting kubelet main sync loop.
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.417336 3728 kubelet.go:1778] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.417340 3728 volume_manager.go:247] Starting Kubelet Volume Manager
Apr 18 14:41:27 ubuntu kubelet[3728]: E0418 14:41:27.417406 3728 container_manager_linux.go:583] [ContainerManager]: Fail to get rootfs information unable to find data for container /
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.517611 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.554492 3728 kubelet_node_status.go:82] Attempting to register node minikube
Apr 18 14:41:27 ubuntu kubelet[3728]: E0418 14:41:27.555033 3728 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.3.123:8443/api/v1/nodes: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.755330 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:27 ubuntu kubelet[3728]: I0418 14:41:27.789452 3728 kubelet_node_status.go:82] Attempting to register node minikube
Apr 18 14:41:27 ubuntu kubelet[3728]: E0418 14:41:27.790065 3728 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.3.123:8443/api/v1/nodes: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:28 ubuntu kubelet[3728]: I0418 14:41:28.190407 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:28 ubuntu kubelet[3728]: I0418 14:41:28.225551 3728 kubelet_node_status.go:82] Attempting to register node minikube
Apr 18 14:41:28 ubuntu kubelet[3728]: E0418 14:41:28.226194 3728 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.3.123:8443/api/v1/nodes: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:28 ubuntu kubelet[3728]: E0418 14:41:28.339760 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:474: Failed to list *v1.Node: Get https://192.168.3.123:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:28 ubuntu kubelet[3728]: E0418 14:41:28.340769 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:465: Failed to list *v1.Service: Get https://192.168.3.123:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:28 ubuntu kubelet[3728]: E0418 14:41:28.341993 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.3.123:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:28 ubuntu kubelet[3728]: E0418 14:41:28.417646 3728 container_manager_linux.go:583] [ContainerManager]: Fail to get rootfs information unable to find data for container /
Apr 18 14:41:29 ubuntu kubelet[3728]: I0418 14:41:29.026457 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:29 ubuntu kubelet[3728]: I0418 14:41:29.080440 3728 kubelet_node_status.go:82] Attempting to register node minikube
Apr 18 14:41:29 ubuntu kubelet[3728]: E0418 14:41:29.080962 3728 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.3.123:8443/api/v1/nodes: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:29 ubuntu kubelet[3728]: E0418 14:41:29.340815 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:474: Failed to list *v1.Node: Get https://192.168.3.123:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:29 ubuntu kubelet[3728]: E0418 14:41:29.341601 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:465: Failed to list *v1.Service: Get https://192.168.3.123:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:29 ubuntu kubelet[3728]: E0418 14:41:29.342461 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.3.123:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:29 ubuntu kubelet[3728]: E0418 14:41:29.417937 3728 container_manager_linux.go:583] [ContainerManager]: Fail to get rootfs information unable to find data for container /
Apr 18 14:41:29 ubuntu kubelet[3728]: E0418 14:41:29.634722 3728 eviction_manager.go:238] eviction manager: unexpected err: failed to get node info: node "minikube" not found
Apr 18 14:41:30 ubuntu kubelet[3728]: E0418 14:41:30.342216 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:474: Failed to list *v1.Node: Get https://192.168.3.123:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:30 ubuntu kubelet[3728]: E0418 14:41:30.342695 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:465: Failed to list *v1.Service: Get https://192.168.3.123:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:30 ubuntu kubelet[3728]: E0418 14:41:30.343802 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.3.123:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:30 ubuntu kubelet[3728]: I0418 14:41:30.681203 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:30 ubuntu kubelet[3728]: I0418 14:41:30.743608 3728 kubelet_node_status.go:82] Attempting to register node minikube
Apr 18 14:41:30 ubuntu kubelet[3728]: E0418 14:41:30.744310 3728 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.3.123:8443/api/v1/nodes: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:31 ubuntu kubelet[3728]: E0418 14:41:31.342916 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:474: Failed to list *v1.Node: Get https://192.168.3.123:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:31 ubuntu kubelet[3728]: E0418 14:41:31.344789 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:465: Failed to list *v1.Service: Get https://192.168.3.123:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:31 ubuntu kubelet[3728]: E0418 14:41:31.345650 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.3.123:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:32 ubuntu kubelet[3728]: E0418 14:41:32.343764 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:474: Failed to list *v1.Node: Get https://192.168.3.123:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:32 ubuntu kubelet[3728]: E0418 14:41:32.345339 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:465: Failed to list *v1.Service: Get https://192.168.3.123:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:32 ubuntu kubelet[3728]: E0418 14:41:32.346494 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.3.123:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.417839 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.494657 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.494803 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.576623 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.577214 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: W0418 14:41:32.577199 3728 status_manager.go:459] Failed to get status for pod "kube-addon-manager-minikube_kube-system(c9760ab157812e306964c796adcfaefb)": Get https://192.168.3.123:8443/api/v1/namespaces/kube-system/pods/kube-addon-manager-minikube: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.617860 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "addons" (UniqueName: "kubernetes.io/host-path/c9760ab157812e306964c796adcfaefb-addons") pod "kube-addon-manager-minikube" (UID: "c9760ab157812e306964c796adcfaefb")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.618215 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/c9760ab157812e306964c796adcfaefb-kubeconfig") pod "kube-addon-manager-minikube" (UID: "c9760ab157812e306964c796adcfaefb")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.619124 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd" (UniqueName: "kubernetes.io/host-path/9d80efa9dfda66b126ec4f9b5f7a004f-etcd") pod "etcd-minikube" (UID: "9d80efa9dfda66b126ec4f9b5f7a004f")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.652289 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.652475 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: W0418 14:41:32.653073 3728 status_manager.go:459] Failed to get status for pod "etcd-minikube_kube-system(9d80efa9dfda66b126ec4f9b5f7a004f)": Get https://192.168.3.123:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.718260 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs-etc-pki" (UniqueName: "kubernetes.io/host-path/e2c0a2343a163e8742823adc88e900af-ca-certs-etc-pki") pod "kube-apiserver-minikube" (UID: "e2c0a2343a163e8742823adc88e900af")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.718356 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/e2c0a2343a163e8742823adc88e900af-k8s-certs") pod "kube-apiserver-minikube" (UID: "e2c0a2343a163e8742823adc88e900af")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.718438 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/e2c0a2343a163e8742823adc88e900af-ca-certs") pod "kube-apiserver-minikube" (UID: "e2c0a2343a163e8742823adc88e900af")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.817841 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/5c879d8c9aae0cf057527672e254fca5-kubeconfig") pod "kube-controller-manager-minikube" (UID: "5c879d8c9aae0cf057527672e254fca5")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.817991 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "flexvolume-dir" (UniqueName: "kubernetes.io/host-path/5c879d8c9aae0cf057527672e254fca5-flexvolume-dir") pod "kube-controller-manager-minikube" (UID: "5c879d8c9aae0cf057527672e254fca5")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.818441 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/5c879d8c9aae0cf057527672e254fca5-k8s-certs") pod "kube-controller-manager-minikube" (UID: "5c879d8c9aae0cf057527672e254fca5")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.818571 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/5c879d8c9aae0cf057527672e254fca5-ca-certs") pod "kube-controller-manager-minikube" (UID: "5c879d8c9aae0cf057527672e254fca5")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.818683 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs-etc-pki" (UniqueName: "kubernetes.io/host-path/5c879d8c9aae0cf057527672e254fca5-ca-certs-etc-pki") pod "kube-controller-manager-minikube" (UID: "5c879d8c9aae0cf057527672e254fca5")
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.918139 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.918618 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: W0418 14:41:32.919163 3728 status_manager.go:459] Failed to get status for pod "kube-apiserver-minikube_kube-system(e2c0a2343a163e8742823adc88e900af)": Get https://192.168.3.123:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:32 ubuntu kubelet[3728]: I0418 14:41:32.970140 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:32 ubuntu kubelet[3728]: W0418 14:41:32.970641 3728 status_manager.go:459] Failed to get status for pod "kube-controller-manager-minikube_kube-system(5c879d8c9aae0cf057527672e254fca5)": Get https://192.168.3.123:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:33 ubuntu kubelet[3728]: W0418 14:41:33.036734 3728 status_manager.go:459] Failed to get status for pod "kube-scheduler-minikube_kube-system(daf4ae2370716908643234b98eb0dab8)": Get https://192.168.3.123:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:33 ubuntu kubelet[3728]: I0418 14:41:33.117820 3728 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/daf4ae2370716908643234b98eb0dab8-kubeconfig") pod "kube-scheduler-minikube" (UID: "daf4ae2370716908643234b98eb0dab8")
Apr 18 14:41:33 ubuntu kubelet[3728]: E0418 14:41:33.344802 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:474: Failed to list *v1.Node: Get https://192.168.3.123:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:33 ubuntu kubelet[3728]: E0418 14:41:33.345907 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:465: Failed to list *v1.Service: Get https://192.168.3.123:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:33 ubuntu kubelet[3728]: E0418 14:41:33.346984 3728 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.3.123:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.3.123:8443: getsockopt: connection refused
Apr 18 14:41:33 ubuntu kubelet[3728]: E0418 14:41:33.457245 3728 event.go:209] Unable to write event: 'Post https://192.168.3.123:8443/api/v1/namespaces/default/events: dial tcp 192.168.3.123:8443: getsockopt: connection refused' (may retry after sleeping)
Apr 18 14:41:33 ubuntu kubelet[3728]: I0418 14:41:33.944529 3728 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Apr 18 14:41:34 ubuntu kubelet[3728]: I0418 14:41:34.084411 3728 kubelet_node_status.go:82] Attempting to register node minikube
Apr 18 14:41:34 ubuntu kubelet[3728]: E0418 14:41:34.084941 3728 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.3.123:8443/api/v1/nodes: dial tcp 192.168.3.123:8443: getsockopt: connection refused
** And keep looping "Failed to list ***" errors from here**
extra-config=apiserver.Admission.PluginNames=...
option.--kubernetes-version=v1.10.0
behaves the same.--extra-config=apiserver.admission-control="..."
, also behaves the same.--extra-config=apiserver.enable-admission-plugins="..."
, also behaves the same.http_proxy
and https_proxy
variable is set, local addresses have been omitted.Please help me on this. Thanks in advance.
I am having the same problems 馃憤
OK, the working version:
minikube start \
--extra-config=apiserver.admission-control="NamespaceLifecycle,LimitRanger,ServiceAccount,PersistentVolumeLabel,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota" \
-v 10 --logtostderr --vm-driver=none
--extra-config=apiserver.admission-control="..."
did the work.
This issue can be closed.
minikube start --extra-config=apiserver.enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota,PodSecurityPolicy
Most helpful comment
OK, the working version:
--extra-config=apiserver.admission-control="..."
did the work.This issue can be closed.