Minikube: Issue starting 1.7.3

Created on 11 Aug 2017 · 12Comments · Source: kubernetes/minikube

Environment:

OS: Fedora 26
VM Driver: VirtualBox 5.1.26
ISO version: minikube-v0.23.0.iso

What happened:

Starting a cluster based on v1.7.3 fails and deployment is never healthy.

How to reproduce it:

$ minikube version
minikube version: v0.21.0

$ kubectl version --client --short
Client Version: v1.8.0-alpha.1.2748+868fef189c8de9

$ minikube start --kubernetes-version=v1.7.3
Starting local Kubernetes v1.7.3 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Starting cluster components...
Connecting to cluster...
Setting up kubeconfig...
Kubectl is now configured to use the cluster.

$ minikube status
minikube: Running
localkube: Running
kubectl: Correctly Configured: pointing to minikube-vm at 192.168.99.100

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"8+", GitVersion:"v1.8.0-alpha.1.2748+868fef189c8de9", GitCommit:"868fef189c8de9fcb61039f064fe0a02a3b06198", GitTreeState:"clean", BuildDate:"2017-08-11T18:35:13Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"7", GitVersion:"v1.7.3", GitCommit:"2c2fe6e8278a5db2d15a013987b53968c743f2a1", GitTreeState:"dirty", BuildDate:"2017-08-11T10:05:43Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}

$ kubectl run nginx --image=nginx --replicas=5
deployment "nginx" created

$ kubectl describe deployment nginx
Name:           nginx
Namespace:      default
CreationTimestamp:  Fri, 11 Aug 2017 16:45:43 -0300
Labels:         run=nginx
Annotations:        <none>
Selector:       run=nginx
Replicas:       5 desired | 0 updated | 0 total | 0 available | 0 unavailable
StrategyType:       RollingUpdate
MinReadySeconds:    0
RollingUpdateStrategy:  1 max unavailable, 1 max surge
Pod Template:
  Labels:   run=nginx
  Containers:
   nginx:
    Image:      nginx
    Port:       <none>
    Environment:    <none>
    Mounts:     <none>
  Volumes:      <none>
OldReplicaSets:     <none>
NewReplicaSet:      <none>
Events:         <none>

$ kubectl get componentstatus 
NAME                 STATUS      MESSAGE                                                                                        ERROR
controller-manager   Unhealthy   Get http://127.0.0.1:10252/healthz: dial tcp 127.0.0.1:10252: getsockopt: connection refused   
scheduler            Unhealthy   Get http://127.0.0.1:10251/healthz: dial tcp 127.0.0.1:10251: getsockopt: connection refused   
etcd-0               Healthy     {"health": "true"}

$ minikube logs
-- Logs begin at Fri 2017-08-11 19:43:24 UTC, end at Fri 2017-08-11 19:46:28 UTC. --
Aug 11 19:43:39 minikube systemd[1]: Starting Localkube...
Aug 11 19:43:39 minikube localkube[3768]: proto: duplicate proto type registered: google.protobuf.Any
Aug 11 19:43:39 minikube localkube[3768]: proto: duplicate proto type registered: google.protobuf.Duration
Aug 11 19:43:39 minikube localkube[3768]: proto: duplicate proto type registered: google.protobuf.Timestamp
Aug 11 19:43:39 minikube localkube[3768]: listening for peers on http://localhost:2380
Aug 11 19:43:39 minikube localkube[3768]: listening for client requests on localhost:2379
Aug 11 19:43:40 minikube localkube[3768]: name = default
Aug 11 19:43:40 minikube localkube[3768]: data dir = /var/lib/localkube/etcd
Aug 11 19:43:40 minikube localkube[3768]: member dir = /var/lib/localkube/etcd/member
Aug 11 19:43:40 minikube localkube[3768]: heartbeat = 100ms
Aug 11 19:43:40 minikube localkube[3768]: election = 1000ms
Aug 11 19:43:40 minikube localkube[3768]: snapshot count = 10000
Aug 11 19:43:40 minikube localkube[3768]: advertise client URLs = http://localhost:2379
Aug 11 19:43:40 minikube localkube[3768]: initial advertise peer URLs = http://localhost:2380
Aug 11 19:43:40 minikube localkube[3768]: initial cluster = default=http://localhost:2380
Aug 11 19:43:40 minikube localkube[3768]: starting member 8e9e05c52164694d in cluster cdf818194e3a8c32
Aug 11 19:43:40 minikube localkube[3768]: 8e9e05c52164694d became follower at term 0
Aug 11 19:43:40 minikube localkube[3768]: newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
Aug 11 19:43:40 minikube localkube[3768]: 8e9e05c52164694d became follower at term 1
Aug 11 19:43:40 minikube localkube[3768]: starting server... [version: 3.1.5, cluster version: to_be_decided]
Aug 11 19:43:40 minikube localkube[3768]: added member 8e9e05c52164694d [http://localhost:2380] to cluster cdf818194e3a8c32
Aug 11 19:43:40 minikube localkube[3768]: 8e9e05c52164694d is starting a new election at term 1
Aug 11 19:43:40 minikube localkube[3768]: 8e9e05c52164694d became candidate at term 2
Aug 11 19:43:40 minikube localkube[3768]: 8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2
Aug 11 19:43:40 minikube localkube[3768]: 8e9e05c52164694d became leader at term 2
Aug 11 19:43:40 minikube localkube[3768]: raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2
Aug 11 19:43:40 minikube localkube[3768]: I0811 19:43:40.705901    3768 etcd.go:58] Etcd server is ready
Aug 11 19:43:40 minikube localkube[3768]: published {Name:default ClientURLs:[http://localhost:2379]} to cluster cdf818194e3a8c32
Aug 11 19:43:40 minikube localkube[3768]: localkube host ip address: 10.0.2.15
Aug 11 19:43:40 minikube localkube[3768]: Starting apiserver...
Aug 11 19:43:40 minikube localkube[3768]: Waiting for apiserver to be healthy...
Aug 11 19:43:40 minikube localkube[3768]: setting up the initial cluster version to 3.1
Aug 11 19:43:40 minikube localkube[3768]: ready to serve client requests
Aug 11 19:43:40 minikube localkube[3768]: I0811 19:43:40.707978    3768 server.go:112] Version: v1.7.3
Aug 11 19:43:40 minikube localkube[3768]: serving insecure client requests on 127.0.0.1:2379, this is strongly discouraged!
Aug 11 19:43:40 minikube localkube[3768]: W0811 19:43:40.708609    3768 authentication.go:368] AnonymousAuth is not allowed with the AllowAll authorizer.  Resetting AnonymousAuth to false. You should use a different authorizer
Aug 11 19:43:40 minikube localkube[3768]: set the initial cluster version to 3.1
Aug 11 19:43:40 minikube localkube[3768]: enabled capabilities for version 3.1
Aug 11 19:43:41 minikube localkube[3768]: [restful] 2017/08/11 19:43:41 log.go:33: [restful/swagger] listing is available at https://10.0.2.15:8443/swaggerapi
Aug 11 19:43:41 minikube localkube[3768]: [restful] 2017/08/11 19:43:41 log.go:33: [restful/swagger] https://10.0.2.15:8443/swaggerui/ is mapped to folder /swagger-ui/
Aug 11 19:43:41 minikube localkube[3768]: I0811 19:43:41.707501    3768 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 11 19:43:41 minikube localkube[3768]: E0811 19:43:41.717548    3768 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Aug 11 19:43:42 minikube localkube[3768]: I0811 19:43:42.717597    3768 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 11 19:43:42 minikube localkube[3768]: E0811 19:43:42.719852    3768 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.662787    3768 serve.go:85] Serving securely on 0.0.0.0:8443
Aug 11 19:43:43 minikube systemd[1]: Started Localkube.
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667021    3768 apiservice_controller.go:113] Starting APIServiceRegistrationController
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667031    3768 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667042    3768 available_controller.go:201] Starting AvailableConditionController
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667048    3768 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667056    3768 tprregistration_controller.go:144] Starting tpr-autoregister controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667064    3768 controller_utils.go:994] Waiting for caches to sync for tpr-autoregister controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667281    3768 crd_finalizer.go:248] Starting CRDFinalizer
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667704    3768 autoregister_controller.go:120] Starting autoregister controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.667778    3768 cache.go:32] Waiting for caches to sync for autoregister controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.668042    3768 customresource_discovery_controller.go:152] Starting DiscoveryController
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.668099    3768 naming_controller.go:284] Starting NamingConditionController
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.713201    3768 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 11 19:43:43 minikube localkube[3768]: E0811 19:43:43.716525    3768 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 11 19:43:43 minikube localkube[3768]: http: TLS handshake error from 127.0.0.1:39424: remote error: tls: bad certificate
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.767147    3768 cache.go:39] Caches are synced for APIServiceRegistrationController controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.767175    3768 controller_utils.go:1001] Caches are synced for tpr-autoregister controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.767182    3768 cache.go:39] Caches are synced for AvailableConditionController controller
Aug 11 19:43:43 minikube localkube[3768]: I0811 19:43:43.768449    3768 cache.go:39] Caches are synced for autoregister controller
Aug 11 19:43:43 minikube localkube[3768]: E0811 19:43:43.786815    3768 autoregister_controller.go:167] v1alpha1.admissionregistration.k8s.io failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1alpha1.admissionregistration.k8s.io": the object has been modified; please apply your changes to the latest version and try again
Aug 11 19:43:43 minikube localkube[3768]: E0811 19:43:43.790118    3768 available_controller.go:234] v1beta1.apiextensions.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.apiextensions.k8s.io": the object has been modified; please apply your changes to the latest version and try again
Aug 11 19:43:43 minikube localkube[3768]: E0811 19:43:43.801116    3768 autoregister_controller.go:167] v1beta1.authentication.k8s.io failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.authentication.k8s.io": the object has been modified; please apply your changes to the latest version and try again
Aug 11 19:43:43 minikube localkube[3768]: E0811 19:43:43.802840    3768 autoregister_controller.go:167] v1.authorization.k8s.io failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1.authorization.k8s.io": the object has been modified; please apply your changes to the latest version and try again
Aug 11 19:43:43 minikube localkube[3768]: E0811 19:43:43.805316    3768 autoregister_controller.go:167] v1.batch failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1.batch": the object has been modified; please apply your changes to the latest version and try again
Aug 11 19:43:44 minikube localkube[3768]: I0811 19:43:44.710117    3768 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 11 19:43:44 minikube localkube[3768]: E0811 19:43:44.715060    3768 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost

Additional information:
v1.6.4 works fine.

Source

gtirloni

👍1

All 12 comments

Issue seems to have been fixed in master (02400c194b92fa9e54c710e164d3abe726fa3eae) with ISO minikube-v0.23.1.iso

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"8+", GitVersion:"v1.8.0-alpha.1.2748+868fef189c8de9", GitCommit:"868fef189c8de9fcb61039f064fe0a02a3b06198", GitTreeState:"clean", BuildDate:"2017-08-11T18:35:13Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"7", GitVersion:"v1.7.3", GitCommit:"2c2fe6e8278a5db2d15a013987b53968c743f2a1", GitTreeState:"clean", BuildDate:"2017-08-11T16:58:53Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}
[gtirloni@main minikube]$ kubectl get componentstatus 
NAME                 STATUS    MESSAGE              ERROR
controller-manager   Healthy   ok                   
scheduler            Healthy   ok                   
etcd-0               Healthy   {"health": "true"}

That was fast :+1:

gtirloni on 11 Aug 2017

@gtirloni how can i download the minikube-v0.23.1.iso you mentioned. Do i need to build the minikube master branch?

prat0318 on 21 Aug 2017

@prat0318 --iso-url https://storage.googleapis.com/minikube/iso/minikube-v0.23.1.iso

r2d4 on 21 Aug 2017

Aha! I have been trying to figure this one out, just stumbled across the issue.

Is there an ETA for 0.23.1 becoming default ISO?
I appear still to have the issue. See below:

$ minikube start --kubernetes-version=v1.7.4 --iso-url https://storage.googleapis.com/minikube/iso/minikube-v0.23.1.iso
Starting local Kubernetes v1.7.4 cluster...
Starting VM...
Downloading Minikube ISO
 106.18 MB / 106.18 MB [============================================] 100.00% 0s
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Starting cluster components...
Connecting to cluster...
Setting up kubeconfig...
Kubectl is now configured to use the cluster.


$ kubectl get componentstatus
NAME                 STATUS      MESSAGE                                                                                        ERROR
controller-manager   Unhealthy   Get http://127.0.0.1:10252/healthz: dial tcp 127.0.0.1:10252: getsockopt: connection refused
scheduler            Unhealthy   Get http://127.0.0.1:10251/healthz: dial tcp 127.0.0.1:10251: getsockopt: connection refused
etcd-0               Healthy     {"health": "true"}


$ minikube logs
-- Logs begin at Wed 2017-08-30 05:28:33 UTC, end at Wed 2017-08-30 05:29:03 UTC. --
Aug 30 05:28:48 minikube systemd[1]: Starting Localkube...
Aug 30 05:28:49 minikube localkube[3316]: proto: duplicate proto type registered: google.protobuf.Any
Aug 30 05:28:49 minikube localkube[3316]: proto: duplicate proto type registered: google.protobuf.Duration
Aug 30 05:28:49 minikube localkube[3316]: proto: duplicate proto type registered: google.protobuf.Timestamp
Aug 30 05:28:49 minikube localkube[3316]: listening for peers on http://localhost:2380
Aug 30 05:28:49 minikube localkube[3316]: listening for client requests on localhost:2379
Aug 30 05:28:49 minikube localkube[3316]: name = default
Aug 30 05:28:49 minikube localkube[3316]: data dir = /var/lib/localkube/etcd
Aug 30 05:28:49 minikube localkube[3316]: member dir = /var/lib/localkube/etcd/member
Aug 30 05:28:49 minikube localkube[3316]: heartbeat = 100ms
Aug 30 05:28:49 minikube localkube[3316]: election = 1000ms
Aug 30 05:28:49 minikube localkube[3316]: snapshot count = 10000
Aug 30 05:28:49 minikube localkube[3316]: advertise client URLs = http://localhost:2379
Aug 30 05:28:49 minikube localkube[3316]: initial advertise peer URLs = http://localhost:2380
Aug 30 05:28:49 minikube localkube[3316]: initial cluster = default=http://localhost:2380
Aug 30 05:28:49 minikube localkube[3316]: starting member 8e9e05c52164694d in cluster cdf818194e3a8c32
Aug 30 05:28:49 minikube localkube[3316]: 8e9e05c52164694d became follower at term 0
Aug 30 05:28:49 minikube localkube[3316]: newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
Aug 30 05:28:49 minikube localkube[3316]: 8e9e05c52164694d became follower at term 1
Aug 30 05:28:49 minikube localkube[3316]: starting server... [version: 3.1.5, cluster version: to_be_decided]
Aug 30 05:28:49 minikube localkube[3316]: added member 8e9e05c52164694d [http://localhost:2380] to cluster cdf818194e3a8c32
Aug 30 05:28:49 minikube localkube[3316]: 8e9e05c52164694d is starting a new election at term 1
Aug 30 05:28:49 minikube localkube[3316]: 8e9e05c52164694d became candidate at term 2
Aug 30 05:28:49 minikube localkube[3316]: 8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2
Aug 30 05:28:49 minikube localkube[3316]: 8e9e05c52164694d became leader at term 2
Aug 30 05:28:49 minikube localkube[3316]: raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2
Aug 30 05:28:49 minikube localkube[3316]: setting up the initial cluster version to 3.1
Aug 30 05:28:49 minikube localkube[3316]: set the initial cluster version to 3.1
Aug 30 05:28:49 minikube localkube[3316]: I0830 05:28:49.926424    3316 etcd.go:58] Etcd server is ready
Aug 30 05:28:49 minikube localkube[3316]: localkube host ip address: 192.168.64.13
Aug 30 05:28:49 minikube localkube[3316]: Starting apiserver...
Aug 30 05:28:49 minikube localkube[3316]: Waiting for apiserver to be healthy...
Aug 30 05:28:49 minikube localkube[3316]: enabled capabilities for version 3.1
Aug 30 05:28:49 minikube localkube[3316]: I0830 05:28:49.927969    3316 server.go:112] Version: v1.7.4
Aug 30 05:28:49 minikube localkube[3316]: W0830 05:28:49.928440    3316 authentication.go:368] AnonymousAuth is not allowed with the AllowAll authorizer.  Resetting AnonymousAuth to false. You should use a different authorizer
Aug 30 05:28:49 minikube localkube[3316]: published {Name:default ClientURLs:[http://localhost:2379]} to cluster cdf818194e3a8c32
Aug 30 05:28:49 minikube localkube[3316]: ready to serve client requests
Aug 30 05:28:49 minikube localkube[3316]: serving insecure client requests on 127.0.0.1:2379, this is strongly discouraged!
Aug 30 05:28:50 minikube localkube[3316]: [restful] 2017/08/30 05:28:50 log.go:33: [restful/swagger] listing is available at https://192.168.64.13:8443/swaggerapi
Aug 30 05:28:50 minikube localkube[3316]: [restful] 2017/08/30 05:28:50 log.go:33: [restful/swagger] https://192.168.64.13:8443/swaggerui/ is mapped to folder /swagger-ui/
Aug 30 05:28:50 minikube localkube[3316]: I0830 05:28:50.927956    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:50 minikube localkube[3316]: E0830 05:28:50.929450    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Aug 30 05:28:51 minikube localkube[3316]: I0830 05:28:51.930157    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:51 minikube localkube[3316]: E0830 05:28:51.932418    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Aug 30 05:28:52 minikube localkube[3316]: I0830 05:28:52.951104    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:52 minikube localkube[3316]: E0830 05:28:52.952865    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Aug 30 05:28:53 minikube localkube[3316]: I0830 05:28:53.932339    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:53 minikube localkube[3316]: E0830 05:28:53.933296    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.205036    3316 serve.go:85] Serving securely on 0.0.0.0:8443
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.209400    3316 crd_finalizer.go:248] Starting CRDFinalizer
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.209958    3316 customresource_discovery_controller.go:152] Starting DiscoveryController
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.209987    3316 naming_controller.go:284] Starting NamingConditionController
Aug 30 05:28:54 minikube systemd[1]: Started Localkube.
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.210852    3316 apiservice_controller.go:113] Starting APIServiceRegistrationController
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.210867    3316 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.210881    3316 available_controller.go:201] Starting AvailableConditionController
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.210890    3316 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.210903    3316 tprregistration_controller.go:144] Starting tpr-autoregister controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.210911    3316 controller_utils.go:994] Waiting for caches to sync for tpr-autoregister controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.215752    3316 autoregister_controller.go:120] Starting autoregister controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.215787    3316 cache.go:32] Waiting for caches to sync for autoregister controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.315812    3316 controller_utils.go:1001] Caches are synced for tpr-autoregister controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.315870    3316 cache.go:39] Caches are synced for APIServiceRegistrationController controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.315884    3316 cache.go:39] Caches are synced for AvailableConditionController controller
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.321586    3316 cache.go:39] Caches are synced for autoregister controller
Aug 30 05:28:54 minikube localkube[3316]: E0830 05:28:54.490247    3316 autoregister_controller.go:167] v1beta1.apps failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.apps": the object has been modified; please apply your changes to the latest version and try again
Aug 30 05:28:54 minikube localkube[3316]: E0830 05:28:54.531023    3316 autoregister_controller.go:167] v1alpha1.admissionregistration.k8s.io failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1alpha1.admissionregistration.k8s.io": the object has been modified; please apply your changes to the latest version and try again
Aug 30 05:28:54 minikube localkube[3316]: E0830 05:28:54.550895    3316 available_controller.go:234] v1beta1.apiextensions.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.apiextensions.k8s.io": the object has been modified; please apply your changes to the latest version and try again
Aug 30 05:28:54 minikube localkube[3316]: E0830 05:28:54.578339    3316 available_controller.go:234] v1.autoscaling failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1.autoscaling": the object has been modified; please apply your changes to the latest version and try again
Aug 30 05:28:54 minikube localkube[3316]: E0830 05:28:54.695441    3316 autoregister_controller.go:167] v1.authorization.k8s.io failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1.authorization.k8s.io": the object has been modified; please apply your changes to the latest version and try again
Aug 30 05:28:54 minikube localkube[3316]: I0830 05:28:54.936576    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:54 minikube localkube[3316]: E0830 05:28:54.946304    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:28:54 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54810: remote error: tls: bad certificate
Aug 30 05:28:55 minikube localkube[3316]: I0830 05:28:55.927785    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:55 minikube localkube[3316]: E0830 05:28:55.946315    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:28:55 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54818: remote error: tls: bad certificate
Aug 30 05:28:56 minikube localkube[3316]: I0830 05:28:56.930414    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:56 minikube localkube[3316]: E0830 05:28:56.938094    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:28:56 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54820: remote error: tls: bad certificate
Aug 30 05:28:57 minikube localkube[3316]: I0830 05:28:57.929353    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:57 minikube localkube[3316]: E0830 05:28:57.939069    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:28:57 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54822: remote error: tls: bad certificate
Aug 30 05:28:58 minikube localkube[3316]: I0830 05:28:58.930784    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:58 minikube localkube[3316]: E0830 05:28:58.938505    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:28:58 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54824: remote error: tls: bad certificate
Aug 30 05:28:59 minikube localkube[3316]: I0830 05:28:59.928787    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:28:59 minikube localkube[3316]: E0830 05:28:59.938265    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:28:59 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54832: remote error: tls: bad certificate
Aug 30 05:29:00 minikube localkube[3316]: I0830 05:29:00.929317    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:29:00 minikube localkube[3316]: E0830 05:29:00.937349    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:29:00 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54834: remote error: tls: bad certificate
Aug 30 05:29:01 minikube localkube[3316]: I0830 05:29:01.928147    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:29:01 minikube localkube[3316]: E0830 05:29:01.934187    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:29:01 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54836: remote error: tls: bad certificate
Aug 30 05:29:02 minikube localkube[3316]: I0830 05:29:02.929761    3316 ready.go:32] Performing healthcheck on https://localhost:8443/healthz
Aug 30 05:29:02 minikube localkube[3316]: E0830 05:29:02.938351    3316 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: x509: certificate is valid for kubernetes.default.svc.cluster.local, kubernetes.default.svc, kubernetes.default, kubernetes, not localhost
Aug 30 05:29:02 minikube localkube[3316]: http: TLS handshake error from 127.0.0.1:54838: remote error: tls: bad certificate

deitch on 30 Aug 2017

👍1

1.7.0 is fine...

deitch on 30 Aug 2017

Maybe we can get a new release of minikube that actually has this fix? It doesn't work for minikube version: v0.21.0 ... i get the same issues as @deitch

Are there nightly master builds of minikube that we can try out?

christian-posta on 7 Sep 2017

👍1

Same: I'm unable to get K8S 1.7.3 or 1.7.4 to work for minikube v0.21.0, with or without the --iso-url https://storage.googleapis.com/minikube/iso/minikube-v0.23.1.iso option. Unfortunately, I need K8S >=1.7.3. Any workarounds or interim solutions short of doing a full source build?

theganyo on 7 Sep 2017

We just did a release, with 1.7.5 as the default version. https://github.com/kubernetes/minikube/releases

r2d4 on 7 Sep 2017

❤1

Lovely, thank you!

On Thu, Sep 7, 2017 at 11:52 AM, Matt Rickard notifications@github.com
wrote:

We just did a release, with 1.7.5 as the default version.
https://github.com/kubernetes/minikube/releases

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/kubernetes/minikube/issues/1816#issuecomment-327891039,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AADP0QvwYzs96euf4T7Jqudl0zw8iSDaks5sgDtsgaJpZM4O1EUv
.

--
Christian Posta
twitter: @christianposta
http://www.christianposta.com/blog
http://fabric8.io

christian-posta on 7 Sep 2017

This looks good! Thanks!

theganyo on 7 Sep 2017

i have the same issue in the latest version minikube-v0.22.1