minikube with --vm-driver=none leaves docker containers running after stop
Is this a BUG REPORT or FEATURE REQUEST? (choose one): BUG
Minikube version (use minikube version): minikube version: v0.21.0
Environment:
- OS (e.g. from /etc/os-release):
NAME="Ubuntu"
VERSION="16.04.2 LTS (Xenial Xerus)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 16.04.2 LTS"
VERSION_ID="16.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
VERSION_CODENAME=xenial
UBUNTU_CODENAME=xenial - VM Driver (e.g.
cat ~/.minikube/machines/minikube/config.json | grep DriverName): none - ISO version (e.g.
cat ~/.minikube/machines/minikube/config.json | grep -i ISOorminikube ssh cat /etc/VERSION): none - Install tools: Followed release notes for 'none' driver install
- Others:
I have istio and helm installed, but this happens w/o those, too.
I am trying to use minikube in a VM, so I need to use the none driver.
What happened:
$ minikube.start (this is a script containing lines from release notes)
Starting local Kubernetes v1.7.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Starting cluster components...
Connecting to cluster...
Setting up kubeconfig...
$ docker ps -a
docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
dccb3ad82033 istio/grafana "/start.sh" 52 seconds ago Up 51 seconds k8s_grafana_boiling-garfish-istio-grafana-23547851-1gl1m_default_5c6b83c7-740b-11e7-b8b0-06fc26b097a3_1
28ff3f619cf1 istio/pilot "/usr/local/bin/pi..." 53 seconds ago Up 52 seconds k8s_apiserver_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
632ae34219d9 gcr.io/istio-testing/servicegraph "/usr/local/bin/se..." 54 seconds ago Up 52 seconds k8s_servicegraph_boiling-garfish-istio-servicegraph-607266090-59069_default_5abbfa8b-740b-11e7-b8b0-06fc26b097a3_1
107e693224dc gcr.io/google_containers/k8s-dns-sidecar-amd64 "/sidecar --v=2 --..." 54 seconds ago Up 53 seconds k8s_sidecar_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
2f36113cb424 istio/proxy_debug "/usr/local/bin/pi..." 54 seconds ago Up 53 seconds k8s_proxy_boiling-garfish-istio-egress-3650407050-tqzmg_default_5bab5c96-740b-11e7-b8b0-06fc26b097a3_1
5a7d13279d3c istio/mixer "/usr/local/bin/mi..." 55 seconds ago Up 53 seconds k8s_boiling-garfish-istio-mixer_boiling-garfish-istio-mixer-2254433407-fq8vz_default_5b59e00f-740b-11e7-b8b0-06fc26b097a3_1
90fc6410275a gcr.io/google_containers/k8s-dns-dnsmasq-nanny-amd64 "/dnsmasq-nanny -v..." 56 seconds ago Up 54 seconds k8s_dnsmasq_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
f9aa78bf499a istio/proxy_debug "/usr/local/bin/pi..." 56 seconds ago Up 55 seconds k8s_istio-ingress_boiling-garfish-istio-ingress-2874957162-j2vcv_default_5bec3467-740b-11e7-b8b0-06fc26b097a3_1
c3e6107ccd8f gcr.io/google_containers/k8s-dns-kube-dns-amd64 "/kube-dns --domai..." 57 seconds ago Up 56 seconds k8s_kubedns_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
17ef0d315e20 openzipkin/zipkin "/bin/sh -c 'test ..." 58 seconds ago Up 57 seconds k8s_zipkin_boiling-garfish-istio-zipkin-2811283378-1cwbw_default_5aaa402a-740b-11e7-b8b0-06fc26b097a3_1
b532fb5121a2 gcr.io/google_containers/kubernetes-dashboard-amd64 "/dashboard --inse..." 58 seconds ago Up 57 seconds k8s_kubernetes-dashboard_kubernetes-dashboard-58pkd_kube-system_dbd2a179-7401-11e7-96d5-06fc26b097a3_1
bbf136defe70 istio/pilot "/usr/local/bin/pi..." 58 seconds ago Up 57 seconds k8s_discovery_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
ca7f867846e9 gcr.io/google_containers/pause-amd64:3.0 "/pause" 59 seconds ago Up 57 seconds k8s_POD_boiling-garfish-istio-grafana-23547851-1gl1m_default_5c6b83c7-740b-11e7-b8b0-06fc26b097a3_1
4c7a077ad18c gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up 58 seconds k8s_POD_boiling-garfish-istio-servicegraph-607266090-59069_default_5abbfa8b-740b-11e7-b8b0-06fc26b097a3_1
20be1d00539c gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up 58 seconds k8s_POD_boiling-garfish-istio-egress-3650407050-tqzmg_default_5bab5c96-740b-11e7-b8b0-06fc26b097a3_1
40b83f052fd4 gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up 58 seconds k8s_POD_boiling-garfish-istio-mixer-2254433407-fq8vz_default_5b59e00f-740b-11e7-b8b0-06fc26b097a3_1
5daad4b8b95c quay.io/coreos/prometheus "/bin/prometheus -..." About a minute ago Up 59 seconds k8s_prometheus_boiling-garfish-istio-prometheus-2740950361-gdk7k_default_5aa9c188-740b-11e7-b8b0-06fc26b097a3_1
d7736c547b4d gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up 58 seconds k8s_POD_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
6fb592dd6c8f gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up 59 seconds k8s_POD_boiling-garfish-istio-ingress-2874957162-j2vcv_default_5bec3467-740b-11e7-b8b0-06fc26b097a3_1
d6ad575b4580 gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up 59 seconds k8s_POD_kubernetes-dashboard-58pkd_kube-system_dbd2a179-7401-11e7-96d5-06fc26b097a3_1
199dc39ef887 gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up 59 seconds k8s_POD_boiling-garfish-istio-zipkin-2811283378-1cwbw_default_5aaa402a-740b-11e7-b8b0-06fc26b097a3_1
69b9abb58cdc gcr.io/kubernetes-helm/tiller "/tiller" About a minute ago Up 59 seconds k8s_tiller_tiller-deploy-3117381935-jcw9k_kube-system_039796e5-740b-11e7-b8b0-06fc26b097a3_1
3ec7685136a9 gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up About a minute k8s_POD_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
316ae082333c istio/istio-ca "/usr/local/bin/is..." About a minute ago Up About a minute k8s_ca_boiling-garfish-istio-ca-3289113953-10bms_default_5ad2348c-740b-11e7-b8b0-06fc26b097a3_1
affa5ce281c1 gcr.io/google-containers/kube-addon-manager "/opt/kube-addons.sh" About a minute ago Up About a minute k8s_kube-addon-manager_kube-addon-manager-gameonvm_kube-system_c654b2f084cf26941c334a2c3d6db53d_1
13dd6dbf1e04 gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up About a minute k8s_POD_boiling-garfish-istio-prometheus-2740950361-gdk7k_default_5aa9c188-740b-11e7-b8b0-06fc26b097a3_1
995341b49088 gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up About a minute k8s_POD_tiller-deploy-3117381935-jcw9k_kube-system_039796e5-740b-11e7-b8b0-06fc26b097a3_1
09f3240bbb6d gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up About a minute k8s_POD_boiling-garfish-istio-ca-3289113953-10bms_default_5ad2348c-740b-11e7-b8b0-06fc26b097a3_1
bef95a6ab5c2 gcr.io/google_containers/pause-amd64:3.0 "/pause" About a minute ago Up About a minute k8s_POD_kube-addon-manager-gameonvm_kube-system_c654b2f084cf26941c334a2c3d6db53d_1
$ minikube stop
Stopping local Kubernetes cluster...
Machine stopped.
$ kubectl get node
The connection to the server 127.0.0.1:8443 was refused - did you specify the right host or port?
$ docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
dccb3ad82033 istio/grafana "/start.sh" 2 minutes ago Up 2 minutes k8s_grafana_boiling-garfish-istio-grafana-23547851-1gl1m_default_5c6b83c7-740b-11e7-b8b0-06fc26b097a3_1
28ff3f619cf1 istio/pilot "/usr/local/bin/pi..." 2 minutes ago Up 2 minutes k8s_apiserver_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
632ae34219d9 gcr.io/istio-testing/servicegraph "/usr/local/bin/se..." 2 minutes ago Up 2 minutes k8s_servicegraph_boiling-garfish-istio-servicegraph-607266090-59069_default_5abbfa8b-740b-11e7-b8b0-06fc26b097a3_1
107e693224dc gcr.io/google_containers/k8s-dns-sidecar-amd64 "/sidecar --v=2 --..." 2 minutes ago Up 2 minutes k8s_sidecar_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
2f36113cb424 istio/proxy_debug "/usr/local/bin/pi..." 2 minutes ago Up 2 minutes k8s_proxy_boiling-garfish-istio-egress-3650407050-tqzmg_default_5bab5c96-740b-11e7-b8b0-06fc26b097a3_1
5a7d13279d3c istio/mixer "/usr/local/bin/mi..." 2 minutes ago Up 2 minutes k8s_boiling-garfish-istio-mixer_boiling-garfish-istio-mixer-2254433407-fq8vz_default_5b59e00f-740b-11e7-b8b0-06fc26b097a3_1
90fc6410275a gcr.io/google_containers/k8s-dns-dnsmasq-nanny-amd64 "/dnsmasq-nanny -v..." 2 minutes ago Up 2 minutes k8s_dnsmasq_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
f9aa78bf499a istio/proxy_debug "/usr/local/bin/pi..." 2 minutes ago Up 2 minutes k8s_istio-ingress_boiling-garfish-istio-ingress-2874957162-j2vcv_default_5bec3467-740b-11e7-b8b0-06fc26b097a3_1
c3e6107ccd8f gcr.io/google_containers/k8s-dns-kube-dns-amd64 "/kube-dns --domai..." 2 minutes ago Up 2 minutes k8s_kubedns_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
17ef0d315e20 openzipkin/zipkin "/bin/sh -c 'test ..." 2 minutes ago Up 2 minutes k8s_zipkin_boiling-garfish-istio-zipkin-2811283378-1cwbw_default_5aaa402a-740b-11e7-b8b0-06fc26b097a3_1
b532fb5121a2 gcr.io/google_containers/kubernetes-dashboard-amd64 "/dashboard --inse..." 2 minutes ago Up 2 minutes k8s_kubernetes-dashboard_kubernetes-dashboard-58pkd_kube-system_dbd2a179-7401-11e7-96d5-06fc26b097a3_1
bbf136defe70 istio/pilot "/usr/local/bin/pi..." 2 minutes ago Up 2 minutes k8s_discovery_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
ca7f867846e9 gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-grafana-23547851-1gl1m_default_5c6b83c7-740b-11e7-b8b0-06fc26b097a3_1
4c7a077ad18c gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-servicegraph-607266090-59069_default_5abbfa8b-740b-11e7-b8b0-06fc26b097a3_1
20be1d00539c gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-egress-3650407050-tqzmg_default_5bab5c96-740b-11e7-b8b0-06fc26b097a3_1
40b83f052fd4 gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-mixer-2254433407-fq8vz_default_5b59e00f-740b-11e7-b8b0-06fc26b097a3_1
5daad4b8b95c quay.io/coreos/prometheus "/bin/prometheus -..." 2 minutes ago Up 2 minutes k8s_prometheus_boiling-garfish-istio-prometheus-2740950361-gdk7k_default_5aa9c188-740b-11e7-b8b0-06fc26b097a3_1
d7736c547b4d gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
6fb592dd6c8f gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-ingress-2874957162-j2vcv_default_5bec3467-740b-11e7-b8b0-06fc26b097a3_1
d6ad575b4580 gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_kubernetes-dashboard-58pkd_kube-system_dbd2a179-7401-11e7-96d5-06fc26b097a3_1
199dc39ef887 gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-zipkin-2811283378-1cwbw_default_5aaa402a-740b-11e7-b8b0-06fc26b097a3_1
69b9abb58cdc gcr.io/kubernetes-helm/tiller "/tiller" 2 minutes ago Up 2 minutes k8s_tiller_tiller-deploy-3117381935-jcw9k_kube-system_039796e5-740b-11e7-b8b0-06fc26b097a3_1
3ec7685136a9 gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
316ae082333c istio/istio-ca "/usr/local/bin/is..." 2 minutes ago Up 2 minutes k8s_ca_boiling-garfish-istio-ca-3289113953-10bms_default_5ad2348c-740b-11e7-b8b0-06fc26b097a3_1
affa5ce281c1 gcr.io/google-containers/kube-addon-manager "/opt/kube-addons.sh" 2 minutes ago Up 2 minutes k8s_kube-addon-manager_kube-addon-manager-gameonvm_kube-system_c654b2f084cf26941c334a2c3d6db53d_1
13dd6dbf1e04 gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-prometheus-2740950361-gdk7k_default_5aa9c188-740b-11e7-b8b0-06fc26b097a3_1
995341b49088 gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_tiller-deploy-3117381935-jcw9k_kube-system_039796e5-740b-11e7-b8b0-06fc26b097a3_1
09f3240bbb6d gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_boiling-garfish-istio-ca-3289113953-10bms_default_5ad2348c-740b-11e7-b8b0-06fc26b097a3_1
bef95a6ab5c2 gcr.io/google_containers/pause-amd64:3.0 "/pause" 2 minutes ago Up 2 minutes k8s_POD_kube-addon-manager-gameonvm_kube-system_c654b2f084cf26941c334a2c3d6db53d_1
$ docker stop $(docker ps -a -q)
<.. stops all containers ...>
$ docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
dccb3ad82033 istio/grafana "/start.sh" 3 minutes ago Exited (143) 5 seconds ago k8s_grafana_boiling-garfish-istio-grafana-23547851-1gl1m_default_5c6b83c7-740b-11e7-b8b0-06fc26b097a3_1
28ff3f619cf1 istio/pilot "/usr/local/bin/pi..." 3 minutes ago Exited (0) 5 seconds ago k8s_apiserver_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
632ae34219d9 gcr.io/istio-testing/servicegraph "/usr/local/bin/se..." 3 minutes ago Exited (143) 4 seconds ago k8s_servicegraph_boiling-garfish-istio-servicegraph-607266090-59069_default_5abbfa8b-740b-11e7-b8b0-06fc26b097a3_1
107e693224dc gcr.io/google_containers/k8s-dns-sidecar-amd64 "/sidecar --v=2 --..." 3 minutes ago Exited (143) 5 seconds ago k8s_sidecar_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
2f36113cb424 istio/proxy_debug "/usr/local/bin/pi..." 3 minutes ago Exited (0) 5 seconds ago k8s_proxy_boiling-garfish-istio-egress-3650407050-tqzmg_default_5bab5c96-740b-11e7-b8b0-06fc26b097a3_1
5a7d13279d3c istio/mixer "/usr/local/bin/mi..." 3 minutes ago Exited (143) 4 seconds ago k8s_boiling-garfish-istio-mixer_boiling-garfish-istio-mixer-2254433407-fq8vz_default_5b59e00f-740b-11e7-b8b0-06fc26b097a3_1
90fc6410275a gcr.io/google_containers/k8s-dns-dnsmasq-nanny-amd64 "/dnsmasq-nanny -v..." 3 minutes ago Exited (137) 4 seconds ago k8s_dnsmasq_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
f9aa78bf499a istio/proxy_debug "/usr/local/bin/pi..." 3 minutes ago Exited (0) 5 seconds ago k8s_istio-ingress_boiling-garfish-istio-ingress-2874957162-j2vcv_default_5bec3467-740b-11e7-b8b0-06fc26b097a3_1
c3e6107ccd8f gcr.io/google_containers/k8s-dns-kube-dns-amd64 "/kube-dns --domai..." 3 minutes ago Exited (137) 4 seconds ago k8s_kubedns_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
17ef0d315e20 openzipkin/zipkin "/bin/sh -c 'test ..." 3 minutes ago Exited (143) 4 seconds ago k8s_zipkin_boiling-garfish-istio-zipkin-2811283378-1cwbw_default_5aaa402a-740b-11e7-b8b0-06fc26b097a3_1
b532fb5121a2 gcr.io/google_containers/kubernetes-dashboard-amd64 "/dashboard --inse..." 3 minutes ago Exited (143) 4 seconds ago k8s_kubernetes-dashboard_kubernetes-dashboard-58pkd_kube-system_dbd2a179-7401-11e7-96d5-06fc26b097a3_1
bbf136defe70 istio/pilot "/usr/local/bin/pi..." 3 minutes ago Exited (0) 4 seconds ago k8s_discovery_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
ca7f867846e9 gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_boiling-garfish-istio-grafana-23547851-1gl1m_default_5c6b83c7-740b-11e7-b8b0-06fc26b097a3_1
4c7a077ad18c gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_boiling-garfish-istio-servicegraph-607266090-59069_default_5abbfa8b-740b-11e7-b8b0-06fc26b097a3_1
20be1d00539c gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_boiling-garfish-istio-egress-3650407050-tqzmg_default_5bab5c96-740b-11e7-b8b0-06fc26b097a3_1
40b83f052fd4 gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_boiling-garfish-istio-mixer-2254433407-fq8vz_default_5b59e00f-740b-11e7-b8b0-06fc26b097a3_1
5daad4b8b95c quay.io/coreos/prometheus "/bin/prometheus -..." 3 minutes ago Exited (0) 4 seconds ago k8s_prometheus_boiling-garfish-istio-prometheus-2740950361-gdk7k_default_5aa9c188-740b-11e7-b8b0-06fc26b097a3_1
d7736c547b4d gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_kube-dns-910330662-01d46_kube-system_dc1b3f00-7401-11e7-96d5-06fc26b097a3_1
6fb592dd6c8f gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_boiling-garfish-istio-ingress-2874957162-j2vcv_default_5bec3467-740b-11e7-b8b0-06fc26b097a3_1
d6ad575b4580 gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 5 seconds ago k8s_POD_kubernetes-dashboard-58pkd_kube-system_dbd2a179-7401-11e7-96d5-06fc26b097a3_1
199dc39ef887 gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_boiling-garfish-istio-zipkin-2811283378-1cwbw_default_5aaa402a-740b-11e7-b8b0-06fc26b097a3_1
69b9abb58cdc gcr.io/kubernetes-helm/tiller "/tiller" 3 minutes ago Exited (143) 5 seconds ago k8s_tiller_tiller-deploy-3117381935-jcw9k_kube-system_039796e5-740b-11e7-b8b0-06fc26b097a3_1
3ec7685136a9 gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_boiling-garfish-istio-istio-pilot-3702728360-l4ck1_default_5be7ae2d-740b-11e7-b8b0-06fc26b097a3_1
316ae082333c istio/istio-ca "/usr/local/bin/is..." 3 minutes ago Exited (143) 4 seconds ago k8s_ca_boiling-garfish-istio-ca-3289113953-10bms_default_5ad2348c-740b-11e7-b8b0-06fc26b097a3_1
affa5ce281c1 gcr.io/google-containers/kube-addon-manager "/opt/kube-addons.sh" 3 minutes ago Exited (143) 5 seconds ago k8s_kube-addon-manager_kube-addon-manager-gameonvm_kube-system_c654b2f084cf26941c334a2c3d6db53d_1
13dd6dbf1e04 gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 5 seconds ago k8s_POD_boiling-garfish-istio-prometheus-2740950361-gdk7k_default_5aa9c188-740b-11e7-b8b0-06fc26b097a3_1
995341b49088 gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 5 seconds ago k8s_POD_tiller-deploy-3117381935-jcw9k_kube-system_039796e5-740b-11e7-b8b0-06fc26b097a3_1
09f3240bbb6d gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_boiling-garfish-istio-ca-3289113953-10bms_default_5ad2348c-740b-11e7-b8b0-06fc26b097a3_1
bef95a6ab5c2 gcr.io/google_containers/pause-amd64:3.0 "/pause" 3 minutes ago Exited (0) 4 seconds ago k8s_POD_kube-addon-manager-gameonvm_kube-system_c654b2f084cf26941c334a2c3d6db53d_1
$ minikube.start
( repeat above)
$ docker ps -a
( similar to above )
$ minikube stop
( similar to above )
$ minikube.start
(all above containers are still used.. so this thankfully doesn't result in lots of new containers)
$ minikube delete
Deleting local Kubernetes cluster...
Machine deleted.
$ docker ps -a
(ALL THE SAME CONTAINERS ARE STILL RUNNING, but now kubectl can't work with them)
What you expected to happen:
I expected the docker containers to be stopped when minikube was stopped (granted, this may not happen when running in a VM, as the VM itself would be stopped)
How to reproduce it (as minimally and precisely as possible):
install minikube, start it, stop it, see what containers are left running.
Anything else do we need to know:
I may be missing something, and this is expected behavior, but it confused the heck out of me. ;)
ebullient
👍6
All 11 comments
As you discovered, we don't really do any cleanup of the pods in the none driver. https://github.com/kubernetes/minikube/blob/master/pkg/minikube/machine/drivers/none/none.go#L170-L191
We might be able to do something by marking the node unschedulable and waiting for all the pods to be evicted before stopping the localkube process. And uncordon the node upon a minikube start. I'm not sure if a lot of the strategies to "drain" the node will work in a single node cluster.
If that doesn't work... we could always manually cordon the node by adding a line here to shell out to docker and stop any running containers with the prefix k8s_*.
Either way, there should probably be some docker cleanup on stop and delete for the none driver.
r2d4
on 29 Jul 2017
👍4
Workaround would be running the following:
docker stop (docker ps -q --filter name=k8s); docker rm (docker ps -aq --filter name=k8s)
This will stop and remove all Docker containers that have 'k8s' in their name.
Siilwyn
on 2 Oct 2017
👍7
I have the same issue, but I am using the "DriverName": "virtualbox"
When I run your commands @Siilwyn, all the services are recreated. What am I missing?
I was doing the minikube tutorial and in the end, all the services keep running.
How do I finish the tutorial to a clean state, with no containers running?
viktorsmari
on 19 Dec 2017
👍1
Hi @viktorsmari, if you also ran minikube stop before that I don't know.
Siilwyn
on 19 Dec 2017
With minikube v.0.25.0 on a non-systemd system, minikube stop stops the containers, but minikube delete doesn't delete them - whether they were stopped or not.
drigz
on 7 Feb 2018
Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale
fejta-bot
on 8 May 2018
Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
If this issue is safe to close now please do so with /close.
Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle rotten
/remove-lifecycle stale
fejta-bot
on 7 Jun 2018
Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.
Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/close
fejta-bot
on 7 Jul 2018
I have the same issue, but I am using the
"DriverName": "virtualbox"When I run your commands @Siilwyn, all the services are recreated. What am I missing?
I was doing the minikube tutorial and in the end, all the services keep running.
How do I finish the tutorial to a clean state, with no containers running?
Did you find a answer to this, @viktorsmari ? I have the exact same problem after following that tutorial.
Bulletninja
on 1 Oct 2018
Did you find a answer to this, @viktorsmari ? I have the exact same problem after following that tutorial.
Sorry, I don't remember @Bulletninja - I ended up uninstalling anything Docker and kube related at that time. I did the tutorial again 6 months later, and then I did not have the same problem, maybe because that time I did not miss anything, or the tutorial was updated.
viktorsmari
on 1 Oct 2018
👍1
Thanks @viktorsmari. I found the "solution", the services are always running, really, but you can hide them from docker ps unchecking this:
(Of course, you can also disable kubernetes)
Bulletninja
on 3 Oct 2018
Was this page helpful?
0 / 5 - 0 ratings
Related issues
javajon
路
3Comments
hank-cp
路
3Comments
Starefossen
路
3Comments
RaeesBhatti
路
3Comments
kphatak
路
3Comments
Most helpful comment
Workaround would be running the following:
docker stop (docker ps -q --filter name=k8s); docker rm (docker ps -aq --filter name=k8s)This will stop and remove all Docker containers that have 'k8s' in their name.