Minikube: shadowsock proxy: kube-proxy configmap update: timed out: Unable to register node connection refused

Created on 31 Jul 2018  Â·  22Comments  Â·  Source: kubernetes/minikube

Is this a BUG REPORT or FEATURE REQUEST? (choose one):
BUG REPORT

Please provide the following details:

Environment:
macOS High Sierra(MacBook Pro (Retina, 15-inch, Mid 2015))
Docker version 18.06.0-ce, build 0ffa825
kubectl version:v1.10.2

Minikube version (use minikube version): v0.28.2

  • OS (e.g. from /etc/os-release): macOS High Sierra(MacBook Pro (Retina, 15-inch, Mid 2015))
    cat: /etc/os-release: No such file or directory
  • VM Driver (e.g. cat ~/.minikube/machines/minikube/config.json | grep DriverName): "DriverName": "virtualbox",
  • ISO version (e.g. cat ~/.minikube/machines/minikube/config.json | grep -i ISO or minikube ssh cat /etc/VERSION):"Boot2DockerURL": "file:///Users/ofengx/.minikube/cache/iso/minikube-v0.28.1.iso"
  • Install tools: Homebrew 1.7.1 (Homebrew/homebrew-core (git revision 299fc; last commit 2018-07-30))
  • Others:
    The above can be generated in one go with the following commands (can be copied and pasted directly into your terminal):
minikube version
echo "";
echo "OS:";
cat /etc/os-release
echo "";
echo "VM driver": 
grep DriverName ~/.minikube/machines/minikube/config.json
echo "";
echo "ISO version";
grep -i ISO ~/.minikube/machines/minikube/config.json

What happened:

bogon% minikube start
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
E0731 18:16:39.216933   18636 start.go:305] Error restarting cluster:  restarting kube-proxy: waiting for kube-proxy to be up for configmap update: timed out waiting for the condition
E0731 18:16:39.327064   18636 util.go:151] Error uploading error message: : Post https://clouderrorreporting.googleapis.com/v1beta1/projects/k8s-minikube/events:report?key=AIzaSyACUwzG0dEPcl-eOgpDKnyKoUFgHdfoFuA: read tcp 192.168.1.102:56815->172.217.24.42:443: read: connection reset by peer

What you expected to happen: Can start correctly

How to reproduce it (as minimally and precisely as possible): minikube start

Output of minikube logs (if applicable):

Jul 31 10:32:11 minikube kubelet[3121]: I0731 10:32:11.516325    3121 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Jul 31 10:32:11 minikube kubelet[3121]: I0731 10:32:11.519107    3121 kubelet_node_status.go:82] Attempting to register node minikube
Jul 31 10:32:11 minikube kubelet[3121]: E0731 10:32:11.519447    3121 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:11 minikube kubelet[3121]: E0731 10:32:11.891049    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:11 minikube kubelet[3121]: E0731 10:32:11.892339    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:11 minikube kubelet[3121]: E0731 10:32:11.893691    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: E0731 10:32:12.183082    3121 event.go:209] Unable to write event: 'Patch https://localhost:8443/api/v1/namespaces/default/events/minikube.15466b9eb0ebe955: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.381350    3121 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(8992e871ee1a351e263f594547a078f7)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.381864    3121 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(dba6863aab51a307a859d780f9ae1044)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.382410    3121 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(e46ad27d50ade97ba19ee3c2bbf58276)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.382693    3121 status_manager.go:461] Failed to get status for pod "etcd-minikube_kube-system(e5e1f61a35d019a62e13bbcf10bd25c4)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.382875    3121 status_manager.go:461] Failed to get status for pod "etcd-minikube_kube-system(1721ddabe174a549a90501ff84c8b807)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.383052    3121 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(375ab1764ef440b06253b7d8f5aa513f)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: E0731 10:32:12.892489    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: E0731 10:32:12.892865    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: E0731 10:32:12.894134    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:13 minikube kubelet[3121]: E0731 10:32:13.893413    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:13 minikube kubelet[3121]: E0731 10:32:13.895094    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:13 minikube kubelet[3121]: E0731 10:32:13.895782    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:14 minikube kubelet[3121]: E0731 10:32:14.767104    3121 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Jul 31 10:32:14 minikube kubelet[3121]: E0731 10:32:14.895824    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:14 minikube kubelet[3121]: E0731 10:32:14.895824    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:14 minikube kubelet[3121]: E0731 10:32:14.897166    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:15 minikube kubelet[3121]: E0731 10:32:15.898092    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:15 minikube kubelet[3121]: E0731 10:32:15.898826    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:15 minikube kubelet[3121]: E0731 10:32:15.900280    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:16 minikube kubelet[3121]: E0731 10:32:16.900171    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:16 minikube kubelet[3121]: E0731 10:32:16.901161    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:16 minikube kubelet[3121]: E0731 10:32:16.901786    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:17 minikube kubelet[3121]: I0731 10:32:17.380585    3121 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach

Anything else do we need to know:
Using the Chinese network
Shadowsock + ss + global Mode

arenetworking causfirewall-or-proxy eapiserver-refused help wanted kinbug lifecyclstale omacos prioritbacklog

Most helpful comment

I am seeing this problem as well on MacOS High Sierra and the VMware Fusion Driver.

All 22 comments

I consistently get the reported behavior.

I also see the following in the minikube logs

Aug 03 15:10:36 minikube kubelet[2803]: I0803 15:10:36.525422 2803 kubelet_node_status.go:82] Attempting to register node minikube Aug 03 15:10:36 minikube kubelet[2803]: E0803 15:10:36.783080 2803 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found Aug 03 15:10:44 minikube kubelet[2803]: I0803 15:10:44.495677 2803 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach Aug 03 15:10:45 minikube kubelet[2803]: I0803 15:10:45.090958 2803 reconciler.go:154] Reconciler: start to sync state Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.118588 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d24f46", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df53f46, ext:277649639, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df53f46, ext:277649639, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.173921 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d25e84", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df54e84, ext:277653540, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df54e84, ext:277653540, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.229168 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d2676c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df5576c, ext:277655820, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df5576c, ext:277655820, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.282958 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d26faf", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df55faf, ext:277657936, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df55faf, ext:277657936, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.340582 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d25e84", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df54e84, ext:277653540, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da3a27dde7, ext:482293642, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.397558 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d24f46", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df53f46, ext:277649639, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da3a27937e, ext:482274593, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.456008 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d2676c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df5576c, ext:277655820, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da3a27ea91, ext:482296885, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.512618 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d26faf", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df55faf, ext:277657936, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da3a27f32c, ext:482299091, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.775745 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d25e84", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df54e84, ext:277653540, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da56a6578f, ext:886602546, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:46 minikube kubelet[2803]: E0803 15:10:46.173696 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d24f46", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df53f46, ext:277649639, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da56a5225f, ext:886523395, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:46 minikube kubelet[2803]: E0803 15:10:46.573875 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d2676c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df5576c, ext:277655820, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da56a6696c, ext:886607119, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!) Aug 03 15:10:46 minikube kubelet[2803]: E0803 15:10:46.783538 2803 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found Aug 03 15:10:46 minikube kubelet[2803]: E0803 15:10:46.975036 2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d26faf", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df55faf, ext:277657936, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da56a689ea, ext:886615436, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
I can also add that if I try again repeatedly it eventually works.

Environment:
macOS High Sierra(MacBook Pro (Retina, 15-inch, Mid 2017))
Docker version 18.06.0-ce, build 0ffa825
kubectl version:v1.10.4

Minikube version (use minikube version): v0.28.2

  • OS (e.g. from /etc/os-release): macOS High Sierra(MacBook Pro (Retina, 13-inch, Mid 2017)) cat: /etc/os-release: No such file or directory
  • VM Driver (e.g. cat ~/.minikube/machines/minikube/config.json | grep DriverName): "DriverName": "virtualbox",
  • ISO version (e.g. cat ~/.minikube/machines/minikube/config.json | grep -i ISO")
  • Install tools: Homebrew 1.7.1 (Homebrew/homebrew-core (git revision 92d5; last commit 2018-08-01))

Also getting this behavior when attempting to start minikube with the kvm2 driver.

I am having same problem...I tried on ubuntu 16.04, LUbuntu 16.04 and 18. Tired of setting up minikube on Ubuntu. Could anyone guide on how to resolve this ?

minikube version: v0.28.2
OS - Ubuntu 16.04
VBox- 5.1.38_Ubuntur122592
Laptop - HP Notebook 15
Memory - 4GB, 2 cpus

output -
Below are exact output -
minikube start
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
E0822 06:27:21.931685 11383 start.go:305] Error restarting cluster: restarting kube-proxy: waiting for kube-proxy to be up for configmap update: timed out waiting for the condition

I am seeing this problem as well on MacOS High Sierra and the VMware Fusion Driver.

Running to the same issue here using same config as @efengx with the exception that I am using vmwarefusion

Same issue here with the same configuration as @JTG2020

same here Ubuntu 18

I am also having this issue.

Lots of log entries like

Sep 05 22:05:31 minikube kubelet[27422]: E0905 22:05:31.818666   27422 pod_workers.go:186] Error syncing pod fedfcb7b-b14f-11e8-afc9-080027c07615 ("kubernetes-dashboard-5498ccf677-l7kk2_kube-system(fedfcb7b-b14f-11e8-afc9-080027c07615)"), skipping: failed to "StartContainer" for "kubernetes-dashboard" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=kubernetes-dashboard pod=kubernetes-dashboard-5498ccf677-l7kk2_kube-system(fedfcb7b-b14f-11e8-afc9-080027c07615)"

Hello this is my first post so don't mind missing precision,
Im on a Windows 10 Home, I7, 16Gb use Virtualbox,
installed using choco
I had the same error as in the first Question and solved it by:
Giving Virtualbox permanent Admin privileges through
Start-> VirtualBox ->properties ->Compatibility -> start as Administrator
Then Allowing VirtualBox permanentely to communicate through the Windows Defender Firewall (in Adding VirtualBox to the allowed Apps List)
finally restart system
and

minikube delete && minikube start

in a regular non admin cmd shell
made it work

Just let me know if it works for you as well and if you think the privileges are too risky (on a private W-lan)

FWIW, this sounds like either a firewall or routing issue, where the host is not configured to be able to contact the VM it installs.

The issue is happening on laptop. Is there anything that needs to be checked?
Because I can start and stop VM with sudo.

Sent from my iPad

On Sep 18, 2018, at 7:04 PM, Thomas Strömberg notifications@github.com wrote:

FWIW, this sounds like either a firewall or routing issue, where the host is not configured to be able to contact the VM it installs.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

My environment has similar issue.
It is fine last Friday to start a k8s cluster. I use version 0.28. Today it failed with message:
" Error starting cluster: kubeadm init error"

I upgrade minikube to 0.30. It failed with below message for command " minikube start -p cluster1 --kubernetes-version v1.11.0"

"E1028 21:47:30.342880 23752 start.go:302] Error restarting cluster: restarting kube-proxy: waiting for kube-proxy to be up for configmap update: timed out waiting for the condition"

We are having the same issue
MacOs Mojave 10.14
minikube v0.30
kubectl version 1.12

minikube start gives us "restarting kube-proxy: waiting for kube-proxy to be up for configmap update: timed out waiting for the condition"

update: minikube delete solved our issue.

MacOs Mojave 10.14
minikube v0.30
kubectl version 1.12

I got the same exact issue and minikube delete didn't really fix it

Somehow I could resolve the issue by running ubuntu in unsecured mode and minikube started successfully. My issue https://github.com/kubernetes/minikube/issues/3031#issuecomment-414989174 is resolved now but i don't think this is correct resolution.
After enabling secure boot again, minikube hangs up again. So i think the issue is something with communication between host and vm and modules such as dkmg that is causing communication.

I managed to resolve the issue by starting minikube in this way explicitly mentioning the K8S version

minikube start --kubernetes-version v1.11.0

minikube delete only didn't fix the issue for me as many commented mentioned but mentioning the cluster version did

I managed to resolve the issue by starting minikube in this way explicitly mentioning the K8S version

minikube start --kubernetes-version v1.11.0

minikube delete only didn't fix the issue for me as many commented mentioned but mentioning the cluster version did

This worked for me as well! :)

I managed to resolve the issue by starting minikube in this way explicitly mentioning the K8S version

minikube start --kubernetes-version v1.11.0

minikube delete only didn't fix the issue for me as many commented mentioned but mentioning the cluster version did

this actually helped me as well, but not just that, it didn't work as i expected, here's what i did:
open virtual box and remove all vms, then follow @n1t1nv3rma hint:
$ minikube delete
$ rm -rf ~/.minikube

now restart your computer (this did the trick for me, i did all these steps without restarting with no luck)

$ brew cask reinstall minikube

but when you want to start minikube provide kubernetes version to it
first get current kubernetes version by running:
$ kubectl version
(mine is 1.13.1 right now)

now use it like so:
$ minikube start --kubernetes-version v1.13.1

Note: you have to prefix 'v' to the version otherwise it won't work.
Note2: being connected to a vpn will cause timeout issues

all these steps has been posted by others, i just ran them in this order and it worked.

Related: #3145

Hello this is my first post so don't mind missing precision,
Im on a Windows 10 Home, I7, 16Gb use Virtualbox,
installed using choco
I had the same error as in the first Question and solved it by:
Giving Virtualbox permanent Admin privileges through
Start-> VirtualBox ->properties ->Compatibility -> start as Administrator
Then Allowing VirtualBox permanentely to communicate through the Windows Defender Firewall (in Adding VirtualBox to the allowed Apps List)
finally restart system
and

minikube delete && minikube start

in a regular non admin cmd shell
made it work

Just let me know if it works for you as well and if you think the privileges are too risky (on a private W-lan)

This worked perfectly for me. Thanks

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

I believe this issue was resolved in the v1.1.0 release. Please try upgrading to the latest release of minikube, and if the same issue occurs, please re-open this bug. Thank you opening this bug report, and for your patience!

Was this page helpful?
0 / 5 - 0 ratings