Minikube: Cannot start minikube when using non-default profile
Is this a BUG REPORT or FEATURE REQUEST?: BUG REPORT
Environment:
Minikube version: v0.26.0
- OS: Arch Linux (4.15.15-1-ARCH)
- VM Driver: virtualbox
- ISO version: minikube-v0.26.0.iso
- Install tools:
- Others:
What happened:
â•â”€peter@peter-arch-9370 ~
╰─$ minikube profile default
minikube profile was successfully set to minikube
â•â”€peter@peter-arch-9370 ~
╰─$ minikube delete
Deleting local Kubernetes cluster...
Errors occurred deleting machine: Error deleting host: minikube: Error loading host from store: Docker machine "minikube" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
â•â”€peter@peter-arch-9370 ~
╰─$ minikube start 1 ↵
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
Kubectl is now configured to use the cluster.
Loading cached images from config file.
â•â”€peter@peter-arch-9370 ~
╰─$ minikube stop
Stopping local Kubernetes cluster...
Machine stopped.
â•â”€peter@peter-arch-9370 ~
╰─$ minikube profile minikube-test
minikube profile was successfully set to minikube-test
â•â”€peter@peter-arch-9370 ~
╰─$ minikube start
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
E0412 15:12:08.112719 17668 start.go:276] Error starting cluster: kubeadm init error sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap running command: : running command: sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap
output: [init] Using Kubernetes version: v1.10.0
[init] Using Authorization modes: [Node RBAC]
[preflight] Running pre-flight checks.
[certificates] Using the existing ca certificate and key.
[WARNING Swap]: running with swap on is not supported. Please disable swap
Flag --admission-control has been deprecated, Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version.
[certificates] Using the existing apiserver certificate and key.
[certificates] Generated apiserver-kubelet-client certificate and key.
[certificates] Generated etcd/ca certificate and key.
[certificates] Generated etcd/server certificate and key.
[certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1]
[certificates] Generated etcd/peer certificate and key.
[certificates] etcd/peer serving cert is signed for DNS names [minikube-test] and IPs [192.168.99.100]
[certificates] Generated etcd/healthcheck-client certificate and key.
[certificates] Generated apiserver-etcd-client certificate and key.
[certificates] Generated sa key and public key.
[certificates] Generated front-proxy-ca certificate and key.
[certificates] Generated front-proxy-client certificate and key.
[certificates] Valid certificates and keys now exist in "/var/lib/localkube/certs/"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf"
[controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml"
[init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests".
[init] This might take a minute or longer if the control plane images have to be pulled.
[apiclient] All control plane components are healthy after 36.001321 seconds
[uploadconfig]Â Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
[markmaster] Will mark node minikube-test as master by adding a label and a taint
: running command: sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap
.: Process exited with status 1
================================================================================
An error has occurred. Would you like to opt in to sending anonymized crash
information to minikube to help prevent future errors?
To opt out of these messages, run the command:
minikube config set WantReportErrorPrompt false
================================================================================
Please enter your response [Y/n]:
Y
What you expected to happen:
Expect minikube start to run correctly when the profile is not default.
How to reproduce it (as minimally and precisely as possible):
minikube profile minikube-test
minikube start
Output of minikube logs (if applicable):
-- Logs begin at Thu 2018-04-12 14:09:15 UTC, end at Thu 2018-04-12 14:24:02 UTC. --
Apr 12 14:09:26 minikube-test systemd[1]: /etc/systemd/system/kubelet.service.d/10-kubeadm.conf:7: Unknown lvalue 'Wants' in section 'Install'
Apr 12 14:09:26 minikube-test systemd[1]: Started kubelet: The Kubernetes Node Agent.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --allow-privileged has been deprecated, will be removed in a future version
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
Apr 12 14:09:27 minikube-test kubelet[3357]: I0412 14:09:27.067903 3357 feature_gate.go:226] feature gates: &{{} map[]}
Apr 12 14:09:28 minikube-test kubelet[3357]: W0412 14:09:28.200017 3357 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Apr 12 14:09:28 minikube-test kubelet[3357]: I0412 14:09:28.200119 3357 server.go:376] Version: v1.10.0
Apr 12 14:09:28 minikube-test kubelet[3357]: I0412 14:09:28.200151 3357 feature_gate.go:226] feature gates: &{{} map[]}
Apr 12 14:09:28 minikube-test kubelet[3357]: I0412 14:09:28.200241 3357 plugins.go:89] No cloud provider specified.
Apr 12 14:09:28 minikube-test kubelet[3357]: F0412 14:09:28.200263 3357 server.go:233] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Apr 12 14:09:28 minikube-test systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Apr 12 14:09:28 minikube-test systemd[1]: kubelet.service: Unit entered failed state.
Apr 12 14:09:28 minikube-test systemd[1]: kubelet.service: Failed with result 'exit-code'.
Apr 12 14:09:38 minikube-test systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Apr 12 14:09:38 minikube-test systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Apr 12 14:09:38 minikube-test systemd[1]: Started kubelet: The Kubernetes Node Agent.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --allow-privileged has been deprecated, will be removed in a future version
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.339985 3547 feature_gate.go:226] feature gates: &{{} map[]}
Apr 12 14:09:38 minikube-test kubelet[3547]: W0412 14:09:38.349021 3547 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.349050 3547 server.go:376] Version: v1.10.0
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.349076 3547 feature_gate.go:226] feature gates: &{{} map[]}
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.349145 3547 plugins.go:89] No cloud provider specified.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378325 3547 server.go:613] --cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378530 3547 container_manager_linux.go:242] container manager verified user specified cgroup-root exists: /
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378538 3547 container_manager_linux.go:247] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>}]} ExperimentalQOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true}
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378620 3547 container_manager_linux.go:266] Creating device plugin manager: true
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378679 3547 state_mem.go:36] [cpumanager] initializing new in-memory state store
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378731 3547 state_file.go:82] [cpumanager] state file: created new state file "/var/lib/kubelet/cpu_manager_state"
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378792 3547 kubelet.go:272] Adding pod path: /etc/kubernetes/manifests
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378802 3547 kubelet.go:297] Watching apiserver
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.385443 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://192.168.99.100:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.385695 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.99.100:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.385867 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://192.168.99.100:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:38 minikube-test kubelet[3547]: W0412 14:09:38.392884 3547 kubelet_network.go:139] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.393028 3547 kubelet.go:556] Hairpin mode set to "hairpin-veth"
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.393837 3547 client.go:75] Connecting to docker on unix:///var/run/docker.sock
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.393953 3547 client.go:104] Start docker client with request timeout=2m0s
Apr 12 14:09:38 minikube-test kubelet[3547]: W0412 14:09:38.397562 3547 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.398299 3547 docker_service.go:244] Docker cri networking managed by kubernetes.io/no-op
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.405787 3547 docker_service.go:249] Docker Info: &{ID:G2X3:QTVG:DSMQ:LLZ7:PG2P:GTRB:KMU5:TSRG:LVKL:B3YN:BSQF:2DI4 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:12 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:35 SystemTime:2018-04-12T14:09:38.400447021Z LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.64 OperatingSystem:Buildroot 2017.11 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc420238e00 NCPU:2 MemTotal:2097205248 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:minikube-test Labels:[provider=virtualbox] ExperimentalBuild:false ServerVersion:17.12.1-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9b55aab90508bd389d7654c4baf173a981477d55 Expected:9b55aab90508bd389d7654c4baf173a981477d55} RuncCommit:{ID:9f9c96235cc97674e935002fc3d78361b696a69e Expected:9f9c96235cc97674e935002fc3d78361b696a69e} InitCommit:{ID:N/A Expected:} SecurityOptions:[name=seccomp,profile=default]}
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.406646 3547 docker_service.go:262] Setting cgroupDriver to cgroupfs
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.416083 3547 remote_runtime.go:43] Connecting to runtime service unix:///var/run/dockershim.sock
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.435962 3547 kuberuntime_manager.go:186] Container runtime docker initialized, version: 17.12.1-ce, apiVersion: 1.35.0
Apr 12 14:09:38 minikube-test kubelet[3547]: W0412 14:09:38.436271 3547 probe.go:215] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.436502 3547 csi_plugin.go:61] kubernetes.io/csi: plugin initializing...
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.438068 3547 kubelet.go:1277] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data for container /
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438354 3547 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438373 3547 status_manager.go:140] Starting to sync pod status with apiserver
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438426 3547 kubelet.go:1777] Starting kubelet main sync loop.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438436 3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438515 3547 server.go:129] Starting to listen on 0.0.0.0:10250
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438886 3547 server.go:299] Adding debug handlers to kubelet server.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.439609 3547 volume_manager.go:247] Starting Kubelet Volume Manager
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.440974 3547 server.go:944] Started kubelet
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.441006 3547 desired_state_of_world_populator.go:129] Desired state populator starts to run
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.443834 3547 event.go:209] Unable to write event: 'Post https://192.168.99.100:8443/api/v1/namespaces/default/events: dial tcp 192.168.99.100:8443: getsockopt: connection refused' (may retry after sleeping)
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.538616 3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.540158 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.554417 3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.555172 3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.739728 3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.755575 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.768319 3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.770030 3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.140219 3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.171043 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.186353 3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:39 minikube-test kubelet[3547]: E0412 14:09:39.187048 3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: E0412 14:09:39.387243 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://192.168.99.100:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: E0412 14:09:39.395714 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://192.168.99.100:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: E0412 14:09:39.395714 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.99.100:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.940808 3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.987623 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.007318 3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.007839 3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.389333 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://192.168.99.100:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.396845 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://192.168.99.100:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.397966 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.99.100:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.562870 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.573328 3547 cpu_manager.go:155] [cpumanager] starting with none policy
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.573345 3547 cpu_manager.go:156] [cpumanager] reconciling every 10s
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.573351 3547 policy_none.go:42] [cpumanager] none policy: Start
Apr 12 14:09:40 minikube-test kubelet[3547]: Starting Device Plugin manager
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.583391 3547 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Apr 12 14:09:41 minikube-test kubelet[3547]: E0412 14:09:41.390901 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://192.168.99.100:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: E0412 14:09:41.399135 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://192.168.99.100:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: E0412 14:09:41.399552 3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.99.100:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.541886 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.572567 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.577412 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: W0412 14:09:41.588369 3547 status_manager.go:461] Failed to get status for pod "kube-addon-manager-minikube_kube-system(3afaf06535cc3b85be93c31632b765da)": Get https://192.168.99.100:8443/api/v1/namespaces/kube-system/pods/kube-addon-manager-minikube: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.596106 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.596196 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.608184 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: W0412 14:09:41.612564 3547 status_manager.go:461] Failed to get status for pod "etcd-minikube_kube-system(940d4985f94e6ed126cfc4d1f57697e6)": Get https://192.168.99.100:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.618305 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.618873 3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.621350 3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:41 minikube-test kubelet[3547]: E0412 14:09:41.624449 3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: W0412 14:09:41.632924 3547 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(e50b4f2cea204f117cba6ed8206cd941)": Get https://192.168.99.100:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Anything else do we need to know:
The name given doesn't seem to make a difference.
petertrotman
All 8 comments
After some reading through the source and a bit of testing, I have found the source of the problem:
The kubelets are started with --hostname-override=minikube as hard coded, even though the kubeadm and kubelet configs are updated with the profile name given - so in this example the kubeadm hostname runs at minikube-test but the kubelets are still looking for minikube and can't find it.
I'm actually not sure which way to go - either we could update the hostname-override to also refer to the profile, but actually I don't think it makes sense for minikube to use that profile name as a host name in the first place, so perhaps we should change the kubeadm and kubelet confs to use minikube instead of using the given profile name.
Thoughts?
petertrotman
on 12 Apr 2018
kevindrosendahl
on 13 Apr 2018
FWIW, I was able to resolve the issue by applying the patch from https://github.com/kubernetes/minikube/pull/2722#issuecomment-382615706
zaa
on 19 Apr 2018
👍1
Applying the patch from #2796 also resolves my issue with profiles. Thanks @petertrotman!
stevesloka
on 23 May 2018
👍1
I tried to locally re-build a Minikube ISO with that patch. But I still seem to get the _old_ kubeadm:
https://kubernetes.slack.com/archives/C1F5CT6Q1/p1528636475000058
Any hints how to proceed?
ascheman
on 11 Jun 2018
i can't start the minikube VM using a profile
KUBECONFIG=./deploy/minikube/kube-config minikube start --profile atmos \
--docker-env HTTP_PROXY=${HTTP_PROXY} \
--docker-env HTTPS_PROXY=${HTTPS_PROXY} \
--docker-env NO_PROXY=192.168.99.0/24
There is a newer version of minikube available (v0.28.0). Download it here:
https://github.com/kubernetes/minikube/releases/tag/v0.28.0
To disable this notification, run the following:
minikube config set WantUpdateNotification false
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Downloading Minikube ISO
150.53 MB / 150.53 MB [============================================] 100.00% 0s
Getting VM IP address...
Moving files into cluster...
Downloading kubeadm v1.10.0
Downloading kubelet v1.10.0
Finished Downloading kubelet v1.10.0
Finished Downloading kubeadm v1.10.0
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
E0614 18:43:20.423392 18434 start.go:276] Error starting cluster: kubeadm init error sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--
etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=File
Available--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvai$
able--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap --ignore-preflight-errors=CRI running command: : running command: sudo /usr/bin/kubeadm init --config /var/lib/k$
beadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifest$
-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-control$
er-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap --ignore-preflight-errors=CRI
output: [init] Using Kubernetes version: v1.10.0
[init] Using Authorization modes: [Node RBAC]
[preflight] Running pre-flight checks.
[certificates] Using the existing ca certificate and key.
[WARNING Swap]: running with swap on is not supported. Please disable swap
Flag --admission-control has been deprecated, Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version.
[certificates] Using the existing apiserver certificate and key.
[certificates] Generated apiserver-kubelet-client certificate and key.
[certificates] Generated etcd/ca certificate and key.
[certificates] Generated etcd/server certificate and key.
[certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1]
[certificates] Generated etcd/peer certificate and key.
[certificates] etcd/peer serving cert is signed for DNS names [atmos] and IPs [192.168.99.102]
[certificates] Generated etcd/healthcheck-client certificate and key.
[certificates] Generated apiserver-etcd-client certificate and key.
[certificates] Generated sa key and public key.
[certificates] Generated front-proxy-ca certificate and key.
[certificates] Generated front-proxy-client certificate and key.
[certificates] Valid certificates and keys now exist in "/var/lib/localkube/certs/"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf"
[controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml"
[init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests".
[init] This might take a minute or longer if the control plane images have to be pulled.
[apiclient] All control plane components are healthy after 38.507298 seconds
[uploadconfig]Â Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
[markmaster] Will mark node atmos as master by adding a label and a taint
: running command: sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--dat$
--ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-pre$
light-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=S$
ap --ignore-preflight-errors=CRI
.: Process exited with status 1
================================================================================
An error has occurred. Would you like to opt in to sending anonymized crash
information to minikube to help prevent future errors?
To opt out of these messages, run the command:
minikube config set WantReportErrorPrompt false
================================================================================
Please enter your response [Y/n]:
make: *** [Makefile:64: minikube-start] Error 1
According to #2818 i try with --bootstrapper localkube and it works :
$ KUBECONFIG=./deploy/minikube/kube-config minikube start --bootstrapper localkube --profile atmos \
--docker-env HTTP_PROXY=${HTTP_PROXY} \
--docker-env HTTPS_PROXY=${HTTPS_PROXY} \
--docker-env NO_PROXY=192.168.99.0/24
There is a newer version of minikube available (v0.28.0). Download it here:
https://github.com/kubernetes/minikube/releases/tag/v0.28.0
To disable this notification, run the following:
minikube config set WantUpdateNotification false
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Downloading Minikube ISO
150.53 MB / 150.53 MB [============================================] 100.00% 0s
Getting VM IP address...
WARNING: The localkube bootstrapper is now deprecated and support for it
will be removed in a future release. Please consider switching to the kubeadm bootstrapper, which
is intended to replace the localkube bootstrapper. To disable this message, run
[minikube config set ShowBootstrapperDeprecationNotification false]
Moving files into cluster...
Downloading localkube binary
173.54 MB / 173.54 MB [============================================] 100.00% 0s
0 B / 65 B [----------------------------------------------------------] 0.00%
65 B / 65 B [======================================================] 100.00% 0sSetting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
Kubectl is now configured to use the cluster.
Loading cached images from config file.
$ KUBECONFIG=./deploy/minikube/kube-config kubectl get all --all-namespaces
NAMESPACE NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
kube-system deploy/kube-dns 1 1 1 1 45s
kube-system deploy/kubernetes-dashboard 1 1 1 1 45s
NAMESPACE NAME DESIRED CURRENT READY AGE
kube-system rs/kube-dns-6dcb57bcc8 1 1 1 45s
kube-system rs/kubernetes-dashboard-5498ccf677 1 1 1 45s
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system po/kube-addon-manager-atmos 1/1 Running 0 54s
kube-system po/kube-dns-6dcb57bcc8-4ctdj 3/3 Running 0 45s
kube-system po/kubernetes-dashboard-5498ccf677-8qx54 1/1 Running 0 45s
kube-system po/storage-provisioner 1/1 Running 0 43s
NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
default svc/kubernetes ClusterIP 10.96.0.1 <none> 443/TCP 1m
kube-system svc/kube-dns ClusterIP 10.96.0.10 <none> 53/UDP,53/TCP 45s
kube-system svc/kubernetes-dashboard NodePort 10.99.27.184 <none> 80:30000/TCP 45s
$ KUBECONFIG=./deploy/minikube/kube-config minikube dashboard -p atmos
Opening kubernetes dashboard in default browser...
nlamirault
on 14 Jun 2018
Can confirm this still exists on 0.28
Can see in the minikube logs:
Jun 16 22:28:10 agones kubelet[2714]: I0616 22:28:10.302613 2714 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Jun 16 22:28:10 agones kubelet[2714]: I0616 22:28:10.312948 2714 kubelet_node_status.go:82] Attempting to register node minikube
Jun 16 22:28:10 agones kubelet[2714]: E0616 22:28:10.316095 2714 kubelet_node_status.go:106] Unable to register node "minikube" with API server: nodes "minikube" is forbidden: node "agones" cannot modify node "minikube"
Jun 16 22:28:10 agones kubelet[2714]: I0616 22:28:10.399470 2714 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
markmandel
on 17 Jun 2018
👍3
This should be fixed with https://github.com/kubernetes/minikube/pull/2796
dlorenc
on 18 Jun 2018
Was this page helpful?
0 / 5 - 0 ratings
Related issues
jroucheton
·
3Comments
xmnlab
·
3Comments
tstromberg
·
3Comments
vainikkaj
·
3Comments
alber70g
·
3Comments
Most helpful comment
Can confirm this still exists on 0.28
Can see in the minikube logs: