Minikube: dns pods are unstable after upgrading to 0.19.0

Created on 15 May 2017  路  9Comments  路  Source: kubernetes/minikube

Minikube version: v0.19.0
Environment:

  • OS: Ubuntu 16.04.2 LTS
  • VM Driver: kvm
  • ISO version (using minikube ssh cat /etc/VERSION): v0.18.0
  • libvirtd (libvirt): 1.3.1
  • docker-machine-kvm: 0.10.0

What happened:
After creating the cluster (without doing anything else) the "dns" pods keep restarting to a point that they fail to do so and report _"CrashLoopBackOff"_ error.

NAME                          READY     STATUS             RESTARTS   AGE
kube-addon-manager-minikube   1/1       Running            1          2d
kube-dns-268032401-2lcs9      2/3       CrashLoopBackOff   25         2d
kubernetes-dashboard-83gs5    1/1       Running            1          2d

What you expected to happen:
dns pods to remain stable.

How to reproduce it (as minimally and precisely as possible):

  • Delete minikube
  • Upgrade minikube to 0.19.0
  • Start minikube
  • Wait for say, 10 minutes and see if the dns pods are stable (kubectl get pods --namespace=kube-system)

Anything else do we need to know:

Here is part of the minikube logs:

-- Logs begin at Fri 2017-05-12 22:22:22 UTC, end at Fri 2017-05-12 22:57:17 UTC. --
May 12 22:22:45 minikube systemd[1]: Starting Localkube...
May 12 22:22:45 minikube localkube[3175]: name = kubeetcd
May 12 22:22:45 minikube localkube[3175]: data dir = /var/lib/localkube/etcd
May 12 22:22:45 minikube localkube[3175]: member dir = /var/lib/localkube/etcd/member
May 12 22:22:45 minikube localkube[3175]: heartbeat = 100ms
May 12 22:22:45 minikube localkube[3175]: election = 1000ms
May 12 22:22:45 minikube localkube[3175]: snapshot count = 10000
May 12 22:22:45 minikube localkube[3175]: advertise client URLs = http://0.0.0.0:2379
May 12 22:22:45 minikube localkube[3175]: initial advertise peer URLs = http://0.0.0.0:2380
May 12 22:22:45 minikube localkube[3175]: initial cluster = kubeetcd=http://0.0.0.0:2380
May 12 22:22:45 minikube localkube[3175]: starting member fcf2ad36debdd5bb in cluster 7f055ae3b0912328
May 12 22:22:45 minikube localkube[3175]: fcf2ad36debdd5bb became follower at term 0
May 12 22:22:45 minikube localkube[3175]: newRaft fcf2ad36debdd5bb [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
May 12 22:22:45 minikube localkube[3175]: fcf2ad36debdd5bb became follower at term 1
May 12 22:22:45 minikube localkube[3175]: starting server... [version: 3.0.17, cluster version: to_be_decided]
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.775727    3175 interface.go:248] Default route transits interface "eth0"
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.775903    3175 interface.go:93] Interface eth0 is up
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.775956    3175 interface.go:138] Interface "eth0" has 2 addresses :[192.168.122.203/24 fe80::5054:ff:fef3:4c2/64].
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.775972    3175 interface.go:105] Checking addr  192.168.122.203/24.
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.775978    3175 interface.go:114] IP found 192.168.122.203
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.775985    3175 interface.go:144] valid IPv4 address for interface "eth0" found as 192.168.122.203.
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.775990    3175 interface.go:254] Choosing IP 192.168.122.203
May 12 22:22:45 minikube localkube[3175]: localkube host ip address: 192.168.122.203
May 12 22:22:45 minikube localkube[3175]: Starting apiserver...
May 12 22:22:45 minikube localkube[3175]: Waiting for apiserver to be healthy...
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.776229    3175 interface.go:248] Default route transits interface "eth0"
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.776300    3175 interface.go:93] Interface eth0 is up
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.776335    3175 interface.go:138] Interface "eth0" has 2 addresses :[192.168.122.203/24 fe80::5054:ff:fef3:4c2/64].
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.776374    3175 interface.go:105] Checking addr  192.168.122.203/24.
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.776379    3175 interface.go:114] IP found 192.168.122.203
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.776383    3175 interface.go:144] valid IPv4 address for interface "eth0" found as 192.168.122.203.
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.776387    3175 interface.go:254] Choosing IP 192.168.122.203
May 12 22:22:45 minikube localkube[3175]: I0512 22:22:45.776404    3175 services.go:51] Setting service IP to "10.0.0.1" (read-write).
May 12 22:22:45 minikube localkube[3175]: W0512 22:22:45.776411    3175 authentication.go:362] AnonymousAuth is not allowed with the AllowAll authorizer.  Resetting AnonymousAuth to false. You should use a different authorizer
May 12 22:22:45 minikube localkube[3175]: added member fcf2ad36debdd5bb [http://0.0.0.0:2380] to cluster 7f055ae3b0912328
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.114117    3175 server.go:224] Initializing deserialization cache size based on 0MB limit
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.116059    3175 server.go:420] Initializing cache sizes based on 0MB limit
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.116122    3175 services.go:51] Setting service IP to "10.0.0.1" (read-write).
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.116431    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.116467    3175 storage_factory.go:250] storing { podtemplates} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.118195    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.118320    3175 reflector.go:236] Listing and watching *api.PodTemplate from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.118427    3175 storage_factory.go:250] storing { events} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.120337    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.120417    3175 storage_factory.go:250] storing { limitranges} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.120831    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.120863    3175 storage_factory.go:250] storing { resourcequotas} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.121386    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.121410    3175 storage_factory.go:250] storing { secrets} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.121549    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.121559    3175 storage_factory.go:250] storing { serviceaccounts} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.121688    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.121707    3175 storage_factory.go:250] storing { persistentvolumes} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.121793    3175 reflector.go:236] Listing and watching *api.ServiceAccount from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.122028    3175 reflector.go:236] Listing and watching *api.LimitRange from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.122352    3175 reflector.go:236] Listing and watching *api.ResourceQuota from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.122496    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.122587    3175 storage_factory.go:250] storing { persistentvolumeclaims} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.122911    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.123025    3175 storage_factory.go:250] storing { configmaps} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.123282    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.123371    3175 storage_factory.go:250] storing { namespaces} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.123638    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.123730    3175 storage_factory.go:250] storing { endpoints} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.123820    3175 reflector.go:236] Listing and watching *api.PersistentVolume from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.122500    3175 reflector.go:236] Listing and watching *api.Secret from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.124277    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.124372    3175 storage_factory.go:250] storing { nodes} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.125029    3175 reflector.go:236] Listing and watching *api.ConfigMap from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.125191    3175 reflector.go:236] Listing and watching *api.PersistentVolumeClaim from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.125349    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.125473    3175 storage_factory.go:250] storing { pods} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.126148    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.126273    3175 storage_factory.go:250] storing { services} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.126407    3175 reflector.go:236] Listing and watching *api.Endpoints from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.126602    3175 reflector.go:236] Listing and watching *api.Namespace from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.127207    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.127332    3175 storage_factory.go:250] storing { services} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.127510    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.127607    3175 storage_factory.go:250] storing { replicationcontrollers} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.127713    3175 reflector.go:236] Listing and watching *api.Service from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.127672    3175 reflector.go:236] Listing and watching *api.Node from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.127693    3175 reflector.go:236] Listing and watching *api.Pod from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.134331    3175 reflector.go:236] Listing and watching *api.ReplicationController from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.146121    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.146306    3175 storage_factory.go:250] storing {extensions thirdpartyresources} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.146413    3175 master.go:323] Enabling API group "authentication.k8s.io".
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.146508    3175 master.go:323] Enabling API group "authorization.k8s.io".
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.146598    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.146698    3175 storage_factory.go:250] storing {autoscaling horizontalpodautoscalers} in autoscaling/v1, reading as autoscaling/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.147203    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.147313    3175 storage_factory.go:250] storing {autoscaling horizontalpodautoscalers} in autoscaling/v1, reading as autoscaling/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.147514    3175 master.go:323] Enabling API group "autoscaling".
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.147611    3175 reflector.go:236] Listing and watching *autoscaling.HorizontalPodAutoscaler from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.147619    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.147786    3175 storage_factory.go:250] storing {batch cronjobs} in batch/v2alpha1, reading as batch/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.147340    3175 reflector.go:236] Listing and watching *autoscaling.HorizontalPodAutoscaler from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.148211    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.148304    3175 storage_factory.go:250] storing {batch jobs} in batch/v1, reading as batch/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.148574    3175 master.go:323] Enabling API group "batch".
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.148671    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.148758    3175 storage_factory.go:250] storing {certificates.k8s.io certificatesigningrequests} in certificates.k8s.io/v1beta1, reading as certificates.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.148859    3175 reflector.go:236] Listing and watching *batch.Job from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.149281    3175 master.go:323] Enabling API group "certificates.k8s.io".
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.149409    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.149521    3175 storage_factory.go:250] storing { replicationcontrollers} in v1, reading as __internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.149710    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.149818    3175 storage_factory.go:250] storing {extensions thirdpartyresources} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.148767    3175 reflector.go:236] Listing and watching *batch.CronJob from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.150048    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.149882    3175 reflector.go:236] Listing and watching *api.ReplicationController from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.150400    3175 storage_factory.go:250] storing {extensions daemonsets} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.151066    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.151282    3175 storage_factory.go:250] storing {extensions deployments} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.151956    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.152158    3175 storage_factory.go:250] storing {extensions ingresses} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.149770    3175 reflector.go:236] Listing and watching *certificates.CertificateSigningRequest from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.153071    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.153520    3175 storage_factory.go:250] storing {extensions podsecuritypolicies} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.153783    3175 reflector.go:236] Listing and watching *extensions.DaemonSet from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.155384    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.155839    3175 storage_factory.go:250] storing {extensions replicasets} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.156497    3175 reflector.go:236] Listing and watching *extensions.Deployment from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.156820    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.156924    3175 storage_factory.go:250] storing {extensions networkpolicies} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.157145    3175 reflector.go:236] Listing and watching *extensions.Ingress from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.157530    3175 master.go:323] Enabling API group "extensions".
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.157636    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.157712    3175 reflector.go:236] Listing and watching *extensions.ReplicaSet from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.157800    3175 storage_factory.go:250] storing {policy poddisruptionbudgets} in policy/v1beta1, reading as policy/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.158186    3175 master.go:323] Enabling API group "policy".
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.158282    3175 reflector.go:236] Listing and watching *extensions.NetworkPolicy from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.158387    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.158468    3175 storage_factory.go:250] storing {rbac.authorization.k8s.io roles} in rbac.authorization.k8s.io/v1beta1, reading as rbac.authorization.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.158795    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.158892    3175 storage_factory.go:250] storing {rbac.authorization.k8s.io rolebindings} in rbac.authorization.k8s.io/v1beta1, reading as rbac.authorization.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.158840    3175 reflector.go:236] Listing and watching *policy.PodDisruptionBudget from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.158928    3175 reflector.go:236] Listing and watching *rbac.Role from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.159522    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.159625    3175 storage_factory.go:250] storing {rbac.authorization.k8s.io clusterroles} in rbac.authorization.k8s.io/v1beta1, reading as rbac.authorization.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.159893    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.160012    3175 storage_factory.go:250] storing {rbac.authorization.k8s.io clusterrolebindings} in rbac.authorization.k8s.io/v1beta1, reading as rbac.authorization.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.160325    3175 reflector.go:236] Listing and watching *rbac.RoleBinding from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.160336    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.160515    3175 storage_factory.go:250] storing {rbac.authorization.k8s.io roles} in rbac.authorization.k8s.io/v1beta1, reading as rbac.authorization.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.160692    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.160778    3175 storage_factory.go:250] storing {rbac.authorization.k8s.io rolebindings} in rbac.authorization.k8s.io/v1beta1, reading as rbac.authorization.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.160997    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161093    3175 storage_factory.go:250] storing {rbac.authorization.k8s.io clusterroles} in rbac.authorization.k8s.io/v1beta1, reading as rbac.authorization.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161241    3175 reflector.go:236] Listing and watching *rbac.RoleBinding from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.161248    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161406    3175 storage_factory.go:250] storing {rbac.authorization.k8s.io clusterrolebindings} in rbac.authorization.k8s.io/v1beta1, reading as rbac.authorization.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161591    3175 master.go:323] Enabling API group "rbac.authorization.k8s.io".
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.161703    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161776    3175 reflector.go:236] Listing and watching *rbac.ClusterRole from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161787    3175 storage_factory.go:250] storing {settings.k8s.io podpresets} in settings.k8s.io/v1alpha1, reading as settings.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.157696    3175 reflector.go:236] Listing and watching *extensions.PodSecurityPolicy from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161139    3175 reflector.go:236] Listing and watching *rbac.ClusterRole from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161111    3175 reflector.go:236] Listing and watching *rbac.ClusterRoleBinding from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: fcf2ad36debdd5bb is starting a new election at term 1
May 12 22:22:46 minikube localkube[3175]: fcf2ad36debdd5bb became candidate at term 2
May 12 22:22:46 minikube localkube[3175]: fcf2ad36debdd5bb received vote from fcf2ad36debdd5bb at term 2
May 12 22:22:46 minikube localkube[3175]: fcf2ad36debdd5bb became leader at term 2
May 12 22:22:46 minikube localkube[3175]: raft.node: fcf2ad36debdd5bb elected leader fcf2ad36debdd5bb at term 2
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.162995    3175 master.go:323] Enabling API group "settings.k8s.io".
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.163115    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.163201    3175 storage_factory.go:250] storing {storage.k8s.io storageclasses} in storage.k8s.io/v1beta1, reading as storage.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.163449    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.163541    3175 storage_factory.go:250] storing {storage.k8s.io storageclasses} in storage.k8s.io/v1beta1, reading as storage.k8s.io/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.163754    3175 master.go:323] Enabling API group "storage.k8s.io".
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.163859    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.163977    3175 storage_factory.go:250] storing {extensions deployments} in extensions/v1beta1, reading as extensions/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: W0512 22:22:46.164227    3175 storage_codec.go:52] storage type "etcd2" does not support media type "application/vnd.kubernetes.protobuf", using "application/json"
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.164320    3175 storage_factory.go:250] storing {apps statefulsets} in apps/v1beta1, reading as apps/__internal from {etcd2 /registry [http://0.0.0.0:2379]    false 1000 <nil> 0xc4203a1240}
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.164653    3175 master.go:323] Enabling API group "apps".
May 12 22:22:46 minikube localkube[3175]: published {Name:kubeetcd ClientURLs:[http://0.0.0.0:2379]} to cluster 7f055ae3b0912328
May 12 22:22:46 minikube localkube[3175]: setting up the initial cluster version to 3.0
May 12 22:22:46 minikube localkube[3175]: set the initial cluster version to 3.0
May 12 22:22:46 minikube localkube[3175]: enabled capabilities for version 3.0
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.170196    3175 reflector.go:236] Listing and watching *storage.StorageClass from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.171415    3175 reflector.go:236] Listing and watching *rbac.ClusterRoleBinding from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.161163    3175 reflector.go:236] Listing and watching *rbac.Role from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.172985    3175 reflector.go:236] Listing and watching *settings.PodPreset from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.178153    3175 reflector.go:236] Listing and watching *extensions.Deployment from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.178462    3175 reflector.go:236] Listing and watching *storage.StorageClass from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.181622    3175 reflector.go:236] Listing and watching *apps.StatefulSet from k8s.io/minikube/vendor/k8s.io/apiserver/pkg/storage/cacher.go:215
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.198516    3175 reflector.go:198] Starting reflector *api.Namespace (10m0s) from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.198591    3175 reflector.go:236] Listing and watching *api.Namespace from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.198696    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/namespaces?resourceVersion=0
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.198706    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.198711    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.198718    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.198725    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199285    3175 reflector.go:198] Starting reflector *api.ResourceQuota (10m0s) from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199337    3175 reflector.go:236] Listing and watching *api.ResourceQuota from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199433    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/resourcequotas?resourceVersion=0
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199440    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199446    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199454    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199459    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199777    3175 reflector.go:198] Starting reflector *api.Secret (10m0s) from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199854    3175 reflector.go:236] Listing and watching *api.Secret from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199988    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/secrets?resourceVersion=0
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.199997    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200003    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200010    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200016    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200176    3175 round_trippers.go:420] Response Status:  in 1 milliseconds
May 12 22:22:46 minikube localkube[3175]: E0512 22:22:46.200222    3175 reflector.go:201] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70: Failed to list *api.Namespace: Get https://localhost:8443/api/v1/namespaces?resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200268    3175 round_trippers.go:420] Response Status:  in 0 milliseconds
May 12 22:22:46 minikube localkube[3175]: E0512 22:22:46.200298    3175 reflector.go:201] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70: Failed to list *api.Secret: Get https://localhost:8443/api/v1/secrets?resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200345    3175 round_trippers.go:420] Response Status:  in 0 milliseconds
May 12 22:22:46 minikube localkube[3175]: E0512 22:22:46.200369    3175 reflector.go:201] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70: Failed to list *api.ResourceQuota: Get https://localhost:8443/api/v1/resourcequotas?resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200578    3175 reflector.go:198] Starting reflector *api.LimitRange (10m0s) from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200599    3175 reflector.go:236] Listing and watching *api.LimitRange from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200672    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/limitranges?resourceVersion=0
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200687    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200695    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200701    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200708    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.200841    3175 round_trippers.go:420] Response Status:  in 0 milliseconds
May 12 22:22:46 minikube localkube[3175]: E0512 22:22:46.200867    3175 reflector.go:201] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70: Failed to list *api.LimitRange: Get https://localhost:8443/api/v1/limitranges?resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201087    3175 reflector.go:198] Starting reflector *api.ServiceAccount (10m0s) from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201108    3175 reflector.go:236] Listing and watching *api.ServiceAccount from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201215    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/serviceaccounts?resourceVersion=0
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201224    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201231    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201237    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201242    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201366    3175 round_trippers.go:420] Response Status:  in 0 milliseconds
May 12 22:22:46 minikube localkube[3175]: E0512 22:22:46.201394    3175 reflector.go:201] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70: Failed to list *api.ServiceAccount: Get https://localhost:8443/api/v1/serviceaccounts?resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201684    3175 reflector.go:198] Starting reflector *storage.StorageClass (10m0s) from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201719    3175 reflector.go:236] Listing and watching *storage.StorageClass from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201802    3175 round_trippers.go:395] GET https://localhost:8443/apis/storage.k8s.io/v1beta1/storageclasses?resourceVersion=0
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201811    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201819    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201825    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.201831    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.202002    3175 round_trippers.go:420] Response Status:  in 0 milliseconds
May 12 22:22:46 minikube localkube[3175]: E0512 22:22:46.202057    3175 reflector.go:201] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70: Failed to list *storage.StorageClass: Get https://localhost:8443/apis/storage.k8s.io/v1beta1/storageclasses?resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
May 12 22:22:46 minikube localkube[3175]: [restful] 2017/05/12 22:22:46 log.go:30: [restful/swagger] listing is available at https://192.168.122.203:8443/swaggerapi/
May 12 22:22:46 minikube localkube[3175]: [restful] 2017/05/12 22:22:46 log.go:30: [restful/swagger] https://192.168.122.203:8443/swaggerui/ is mapped to folder /swagger-ui/
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.312901    3175 serve.go:79] Serving securely on 0.0.0.0:8443
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.312982    3175 serve.go:94] Serving insecurely on 127.0.0.1:8080
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.313403    3175 round_trippers.go:395] POST https://localhost:8443/api/v1/namespaces
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.313410    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.313414    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.313418    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.313422    3175 round_trippers.go:405]     Content-Type: application/vnd.kubernetes.protobuf
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.313426    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube systemd[1]: Started Localkube.
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.316171    3175 round_trippers.go:395] GET https://localhost:8443/apis/extensions/v1beta1/thirdpartyresources
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.316417    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.316587    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.316726    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.316845    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.321093    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/services
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.321691    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.321981    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.322102    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.322249    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.345471    3175 wrap.go:75] POST /api/v1/namespaces: (3.317775ms) 201 [[localkube/v1.6.0 (linux/amd64) kubernetes/$Format] 127.0.0.1:56054]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.345738    3175 wrap.go:75] GET /apis/extensions/v1beta1/thirdpartyresources: (3.000205ms) 200 [[localkube/v1.6.0 (linux/amd64) kubernetes/$Format] 127.0.0.1:56054]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.346318    3175 round_trippers.go:420] Response Status: 200 OK in 28 milliseconds
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.346459    3175 round_trippers.go:420] Response Status: 201 Created in 33 milliseconds
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.346548    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/namespaces/kube-system/configmaps/extension-apiserver-authentication
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.346555    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.346559    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.346564    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.346568    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.348154    3175 wrap.go:75] GET /api/v1/namespaces/kube-system/configmaps/extension-apiserver-authentication: (1.342629ms) 404 [[localkube/v1.6.0 (linux/amd64) kubernetes/$Format] 127.0.0.1:56054]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.348671    3175 round_trippers.go:420] Response Status: 404 Not Found in 2 milliseconds
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.348883    3175 round_trippers.go:395] POST https://localhost:8443/api/v1/namespaces/kube-system/configmaps
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.348896    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.348901    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.348909    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.348914    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.348918    3175 round_trippers.go:405]     Content-Type: application/vnd.kubernetes.protobuf
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.352706    3175 wrap.go:75] GET /api/v1/services: (3.081835ms) 200 [[localkube/v1.6.0 (linux/amd64) kubernetes/$Format] 127.0.0.1:56054]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.354055    3175 round_trippers.go:420] Response Status: 200 OK in 31 milliseconds
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.358855    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/services
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.358907    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.358914    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.358920    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.358924    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.359505    3175 wrap.go:75] GET /api/v1/services: (435.874碌s) 200 [[localkube/v1.6.0 (linux/amd64) kubernetes/$Format] 127.0.0.1:56054]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.359679    3175 round_trippers.go:420] Response Status: 200 OK in 0 milliseconds
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.360535    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/namespaces/default
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.360565    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.360570    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.360575    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.360579    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.361075    3175 wrap.go:75] GET /api/v1/namespaces/default: (374.873碌s) 404 [[localkube/v1.6.0 (linux/amd64) kubernetes/$Format] 127.0.0.1:56054]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.361220    3175 round_trippers.go:420] Response Status: 404 Not Found in 0 milliseconds
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.361283    3175 round_trippers.go:395] POST https://localhost:8443/api/v1/namespaces
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.361289    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.361293    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.361297    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.361301    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.361305    3175 round_trippers.go:405]     Content-Type: application/vnd.kubernetes.protobuf
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.363425    3175 wrap.go:75] POST /api/v1/namespaces: (1.985108ms) 201 [[localkube/v1.6.0 (linux/amd64) kubernetes/$Format] 127.0.0.1:56054]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.363591    3175 round_trippers.go:420] Response Status: 201 Created in 2 milliseconds
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.363651    3175 round_trippers.go:395] GET https://localhost:8443/api/v1/namespaces/default/services/kubernetes
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.363656    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.363661    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.363666    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.363670    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.364295    3175 wrap.go:75] GET /api/v1/namespaces/default/services/kubernetes: (410.193碌s) 404 [[localkube/v1.6.0 (linux/amd64) kubernetes/$Format] 127.0.0.1:56054]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.364444    3175 round_trippers.go:420] Response Status: 404 Not Found in 0 milliseconds
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.364520    3175 round_trippers.go:395] POST https://localhost:8443/api/v1/namespaces/default/services
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.364537    3175 round_trippers.go:402] Request Headers:
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.364542    3175 round_trippers.go:405]     Authorization: Bearer aa876c43-758a-45e8-9826-c30aa64bb54f
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.364546    3175 round_trippers.go:405]     Accept: application/vnd.kubernetes.protobuf, */*
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.364550    3175 round_trippers.go:405]     Content-Type: application/vnd.kubernetes.protobuf
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.364554    3175 round_trippers.go:405]     User-Agent: localkube/v1.6.0 (linux/amd64) kubernetes/$Format
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.776583    3175 ready.go:30] Performing healthcheck on http://127.0.0.1:8080/healthz
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.778090    3175 wrap.go:75] GET /healthz: (282.3碌s) 500
May 12 22:22:46 minikube localkube[3175]: goroutine 976 [running]:
May 12 22:22:46 minikube localkube[3175]: k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).recordStatus(0xc42187ba40, 0x1f4)
May 12 22:22:46 minikube localkube[3175]:         /var/lib/jenkins/go2/src/k8s.io/minikube/_gopath/src/k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/httplog/log.go:219 +0xbb
May 12 22:22:46 minikube localkube[3175]: k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/httplog.(*respLogger).WriteHeader(0xc42187ba40, 0x1f4)
May 12 22:22:46 minikube localkube[3175]:         /var/lib/jenkins/go2/src/k8s.io/minikube/_gopath/src/k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/httplog/log.go:198 +0x35
May 12 22:22:46 minikube localkube[3175]: net/http.Error(0x68d82c0, 0xc42187ba40, 0xc420634b40, 0x109, 0x1f4)
May 12 22:22:46 minikube localkube[3175]:         /usr/local/go/src/net/http/server.go:1738 +0xda
May 12 22:22:46 minikube localkube[3175]: k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/healthz.handleRootHealthz.func1(0x68d82c0, 0xc42187ba40, 0xc4212024b0)
May 12 22:22:46 minikube localkube[3175]:         /var/lib/jenkins/go2/src/k8s.io/minikube/_gopath/src/k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/healthz/healthz.go:110 +0x41a
May 12 22:22:46 minikube localkube[3175]: net/http.HandlerFunc.ServeHTTP(0xc422db4680, 0x68d82c0, 0xc42187ba40, 0xc4212024b0)
May 12 22:22:46 minikube localkube[3175]:         /usr/local/go/src/net/http/server.go:1726 +0x44
May 12 22:22:46 minikube localkube[3175]: net/http.(*ServeMux).ServeHTTP(0xc420ec3920, 0x68d82c0, 0xc42187ba40, 0xc4212024b0)
May 12 22:22:46 minikube localkube[3175]:         /usr/local/go/src/net/http/server.go:2022 +0x7f
May 12 22:22:46 minikube localkube[3175]: k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/filters.WithPanicRecovery.func1(0x68d82c0, 0xc42187ba40, 0xc4212024b0)
May 12 22:22:46 minikube localkube[3175]:         /var/lib/jenkins/go2/src/k8s.io/minikube/_gopath/src/k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:74 +0x24a
May 12 22:22:46 minikube localkube[3175]: net/http.HandlerFunc.ServeHTTP(0xc420ef68d0, 0x7fb77c79b4d0, 0xc420de0b68, 0xc4212024b0)
May 12 22:22:46 minikube localkube[3175]:         /usr/local/go/src/net/http/server.go:1726 +0x44
May 12 22:22:46 minikube localkube[3175]: k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1(0xc420ed0e60, 0x68ea680, 0xc420de0b68, 0xc4212024b0, 0xc4209c16e0)
May 12 22:22:46 minikube localkube[3175]:         /var/lib/jenkins/go2/src/k8s.io/minikube/_gopath/src/k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:91 +0x8d
May 12 22:22:46 minikube localkube[3175]: created by k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP
May 12 22:22:46 minikube localkube[3175]:         /var/lib/jenkins/go2/src/k8s.io/minikube/_gopath/src/k8s.io/minikube/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:93 +0x1d1
May 12 22:22:46 minikube localkube[3175]: logging error output: "[+]ping ok\n[-]poststarthook/bootstrap-controller failed: reason withheld\n[+]poststarthook/extensions/third-party-resources ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[-]poststarthook/ca-registration failed: reason withheld\nhealthz check failed\n"
May 12 22:22:46 minikube localkube[3175]:  [[Go-http-client/1.1] 127.0.0.1:53856]
May 12 22:22:46 minikube localkube[3175]: I0512 22:22:46.778405    3175 ready.go:42] Got healthcheck response: [+]ping ok
May 12 22:22:46 minikube localkube[3175]: [-]poststarthook/bootstrap-controller failed: reason withheld
May 12 22:22:46 minikube localkube[3175]: [+]poststarthook/extensions/third-party-resources ok
May 12 22:22:46 minikube localkube[3175]: [-]poststarthook/rbac/bootstrap-roles failed: reason withheld
May 12 22:22:46 minikube localkube[3175]: [-]poststarthook/ca-registration failed: reason withheld
May 12 22:22:46 minikube localkube[3175]: healthz check failed
May 12 22:22:47 minikube localkube[3175]: I0512 22:22:47.200657    3175 reflector.go:236] Listing and watching *api.Namespace from k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:70
kinbug

Most helpful comment

Same issue here using minikube 0.19.1

All 9 comments

In case someone wondering, I did delete the ~/.minikube folder (hence the iso cache) to ensure a new iso is downloaded. Even though that triggered a download, I could still see the following message when I start the cluster:

(minikube) Downloading /home/amir/.minikube/cache/boot2docker.iso from file:///home/amir/.minikube/cache/iso/minikube-v0.18.0.iso...

Wondering if anyone has seen this issue or it's just me.

Same issue here using minikube 0.19.1

@r2d4 that PR is merged into 0.19.1, which I still have these issues on

This should be fixed by #1577

@r2d4 Thanks. Do I have to wait for the next release or can I update the addon by itself?

@gheibia You can disable kube dns with minikube addons disable kube-dns and add these files https://github.com/kubernetes/minikube/tree/master/deploy/addons/kube-dns

into ~/.minikube/addons and it should work properly. The next release will be coming early next week.

Got it! Thanks.

Was this page helpful?
0 / 5 - 0 ratings