Minikube: Noisy logs: `ERROR: logging before flag.Parse`

[josedonizetti]

After the k8s bump to 1.15.0, I started to see:

ERROR: logging before flag.Parse: I0725 09:04:57.186837   20612 vm_assets.go:203] Created asset deploy/addons/addon-manager.yaml.tmpl with 1452 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.187141   20612 vm_assets.go:203] Created asset deploy/addons/dashboard/dashboard-dp.yaml.tmpl with 1605 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.187247   20612 vm_assets.go:203] Created asset deploy/addons/dashboard/dashboard-svc.yaml.tmpl with 979 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.187274   20612 vm_assets.go:203] Created asset deploy/addons/storageclass/storageclass.yaml.tmpl with 271 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.187562   20612 vm_assets.go:203] Created asset deploy/addons/storage-provisioner/storage-provisioner.yaml.tmpl with 1755 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.187667   20612 vm_assets.go:203] Created asset deploy/addons/storage-provisioner-gluster/storage-gluster-ns.yaml.tmpl with 230 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.187731   20612 vm_assets.go:203] Created asset deploy/addons/storage-provisioner-gluster/glusterfs-daemonset.yaml.tmpl with 3888 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.187813   20612 vm_assets.go:203] Created asset deploy/addons/storage-provisioner-gluster/heketi-deployment.yaml.tmpl with 3932 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.187863   20612 vm_assets.go:203] Created asset deploy/addons/storage-provisioner-gluster/storage-provisioner-glusterfile.yaml.tmpl with 3145 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.188529   20612 vm_assets.go:203] Created asset deploy/addons/heapster/influx-grafana-rc.yaml.tmpl with 2540 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.188700   20612 vm_assets.go:203] Created asset deploy/addons/heapster/grafana-svc.yaml.tmpl with 1085 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.188763   20612 vm_assets.go:203] Created asset deploy/addons/heapster/influxdb-svc.yaml.tmpl with 1048 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.188917   20612 vm_assets.go:203] Created asset deploy/addons/heapster/heapster-rc.yaml.tmpl with 1651 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.188968   20612 vm_assets.go:203] Created asset deploy/addons/heapster/heapster-svc.yaml.tmpl with 1006 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189103   20612 vm_assets.go:203] Created asset deploy/addons/efk/elasticsearch-rc.yaml.tmpl with 2209 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189155   20612 vm_assets.go:203] Created asset deploy/addons/efk/elasticsearch-svc.yaml.tmpl with 947 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189296   20612 vm_assets.go:203] Created asset deploy/addons/efk/fluentd-es-rc.yaml.tmpl with 2096 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189429   20612 vm_assets.go:203] Created asset deploy/addons/efk/fluentd-es-configmap.yaml.tmpl with 9863 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189481   20612 vm_assets.go:203] Created asset deploy/addons/efk/kibana-rc.yaml.tmpl with 1606 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189528   20612 vm_assets.go:203] Created asset deploy/addons/efk/kibana-svc.yaml.tmpl with 1011 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189588   20612 vm_assets.go:203] Created asset deploy/addons/ingress/ingress-configmap.yaml.tmpl with 1281 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189646   20612 vm_assets.go:203] Created asset deploy/addons/ingress/ingress-rbac.yaml.tmpl with 2526 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189831   20612 vm_assets.go:203] Created asset deploy/addons/ingress/ingress-dp.yaml.tmpl with 4447 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189886   20612 vm_assets.go:203] Created asset deploy/addons/ingress/ingress-svc.yaml.tmpl with 1091 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.189929   20612 vm_assets.go:203] Created asset deploy/addons/metrics-server/metrics-apiservice.yaml.tmpl with 401 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190060   20612 vm_assets.go:203] Created asset deploy/addons/metrics-server/metrics-server-deployment.yaml.tmpl with 671 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190104   20612 vm_assets.go:203] Created asset deploy/addons/metrics-server/metrics-server-service.yaml.tmpl with 401 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190139   20612 vm_assets.go:203] Created asset deploy/addons/registry/registry-rc.yaml.tmpl with 748 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190170   20612 vm_assets.go:203] Created asset deploy/addons/registry/registry-svc.yaml.tmpl with 333 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190197   20612 vm_assets.go:203] Created asset deploy/addons/registry/registry-proxy.yaml.tmpl with 754 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190239   20612 vm_assets.go:203] Created asset deploy/addons/registry-creds/registry-creds-rc.yaml.tmpl with 2868 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190352   20612 vm_assets.go:203] Created asset deploy/addons/freshpod/freshpod-rc.yaml.tmpl with 1437 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190537   20612 vm_assets.go:203] Created asset deploy/addons/gpu/nvidia-driver-installer.yaml.tmpl with 2487 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190663   20612 vm_assets.go:203] Created asset deploy/addons/gpu/nvidia-gpu-device-plugin.yaml.tmpl with 2111 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190709   20612 vm_assets.go:203] Created asset deploy/addons/logviewer/logviewer-dp-and-svc.yaml.tmpl with 1942 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190743   20612 vm_assets.go:203] Created asset deploy/addons/logviewer/logviewer-rbac.yaml.tmpl with 1064 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190863   20612 vm_assets.go:203] Created asset deploy/addons/gvisor/gvisor-pod.yaml.tmpl with 1908 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.190982   20612 vm_assets.go:203] Created asset deploy/addons/gvisor/gvisor-config.toml with 1789 bytes
ERROR: logging before flag.Parse: I0725 09:04:57.191018   20612 vm_assets.go:203] Created asset deploy/addons/gvisor/gvisor-containerd-shim.toml with 90 bytes
Minikube is a CLI tool that provisions and manages single-node Kubernetes clusters optimized for development workflows.

Usage:
  minikube [command]

Available Commands:

This was happening to k8s repo too. https://github.com/kubernetes/kubernetes/issues/17162

[josedonizetti]

/assign @josedonizetti

[medyagh]

it seems to be glog not playing nice ! (maybe we should migrate to klog like kubernetes soon)

seems to be related to istio/istio#2127
seems like it has been fixed in this PR spf13/cobra#75

I recommend bumping up our cobra to the newer version

[medyagh]

related https://github.com/kubernetes/dns/pull/27

[afbjorklund]

Can this be fixed with the "initflag" hack, or do we need to revert k8s ?

Otherwise this will be blocking v1.3.0, can't release minikube like this...

Yay for global variables!

https://github.com/golang/glog/commit/65d674618f712aa808a7d0104131b9206fc3d5ad

[josedonizetti]

@afbjorklund I'm doing as many tests as possible today on this. Hopefully, we can release it without any problem, I'll write it back here if I think it's a go or not in a few hours. Okay?

[tstromberg]

Oddly enough, I'm seeing this on integration tests, at least on Windows:

14:52:03 ! "minikube" cluster does not exist
14:52:03 * The "minikube" cluster has been deleted.
14:52:04 ERROR: logging before flag.Parse: I0806 14:50:38.565508    8348 vm_assets.go:203] Created asset deploy/addons/addon-manager.yaml.tmpl with 1452 bytes
14:52:04 ERROR: logging before flag.Parse: I0806 14:50:38.565508    8348 vm_assets.go:203] Created asset deploy/addons/dashboard/dashboard-dp.yaml.tmpl with 1605 bytes
14:52:04 ERROR: logging before flag.Parse: I0806 14:50:38.565508    8348 vm_assets.go:203] Created asset deploy/addons/dashboard/dashboard-svc.yaml.tmpl with 979 bytes
14:52:04 ERROR: logging before flag.Parse: I0806 14:50:38.565508    8348 vm_assets.go:203]
Created asset deploy/addons/storageclass/storageclass.yaml.tmpl with 271 bytes
14:52:04 ERROR: logging before flag.Parse: I0806 14:50:38.565508    8348 vm_assets.go:203] Created asset deploy/addons/storage-provisioner/storage-provisioner.yaml.tmpl with 1755 bytes
14:52:04 ERROR: logging before flag.Parse: I0806 14:50:38.565508    8348 vm_assets.go:203] 

[tstromberg]

Fixed.