minikube will not start on Windows 10 with hyperv: cannot ssh to VM

[mnuttall]

BUG REPORT

Minikube version (use minikube version): v0.12.2
Environment:

• OS (e.g. from /etc/os-release): Windows 10
• VM Driver (e.g. cat ~/.minikube/machines/minikube/config.json | grep DriverName): hyperv
• Docker version (e.g. docker -v): Docker version 1.12.3, build 6b644ec
• Install tools:
• Others:

What happened: 'minikube start' hangs at 'Waiting for SSH to be available'.

What you expected to happen: 'minikube start' should complete successfully.

How to reproduce it (as minimally and precisely as possible):

1. Install Windows 10.
2. Enable hyper-v.
3. Install Docker for Windows.
4. Download minikube.
5. minikube start --vm-driver=hyperv

Anything else do we need to know: The minikube virtual machine starts. It can be connected to from the Hyper-V Manager. It comes up with a prompt, root@boot2docker, build version 1.11.1.

It is not possible to ssh into the VM: putty to [fe80::215:5dff:fe4b:10f] refuses to connect.

Here's the output from minikube start --vm-driver="hyperv" --show-libmachine-logs --alsologtostderr --v=3

C:\WINDOWS\system32> minikube start --vm-driver="hyperv" --show-libmachine-logs
--alsologtostderr --v=3
W1129 11:58:11.108087 13884 root.go:134] Error reading config file at C:\Users
\mnuttall.minikube\config\config.json: open C:\Users\mnuttall.minikube\config\
config.json: The system cannot find the file specified.
I1129 11:58:11.115088 13884 notify.go:111] Checking for updates...
Starting local Kubernetes cluster...
Found binary path at c:\bin\minikube.exe
Launching plugin server for driver hyperv
Plugin server listening at address 127.0.0.1:52789
() Calling .GetVersion
Using API Version 1
() Calling .SetConfigRaw
() Calling .GetMachineName
(minikube) Calling .GetMachineName
(minikube) Calling .DriverName
Running pre-create checks...
(minikube) Calling .PreCreateCheck
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive @(Get-Command Get-VM).ModuleName
(minikube) DBG | [stdout =====>] : Hyper-V
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive @([Security.Principal.WindowsPrincipal][
Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole("Hyper-V Administrat
ors")
(minikube) DBG | [stdout =====>] : False
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive @([Security.Principal.WindowsPrincipal][
Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole([Security.Principal.
WindowsBuiltInRole] "Administrator")
(minikube) DBG | [stdout =====>] : True
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (Get-VMSwitch).Name
(minikube) DBG | [stdout =====>] : DockerNAT
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) Calling .GetConfigRaw
Creating machine...
(minikube) Calling .Create
(minikube) Downloading C:\Users\mnuttall.minikube\cache\boot2docker.iso from fi
le://C:/Users/mnuttall/.minikube/cache/iso/minikube-0.7.iso...
(minikube) Creating SSH key...
(minikube) Creating VM...
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (Get-VMSwitch).Name
(minikube) DBG | [stdout =====>] : DockerNAT
(minikube) Using switch "DockerNAT"
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive @([Security.Principal.WindowsPrincipal][
Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole([Security.Principal.
WindowsBuiltInRole] "Administrator")
(minikube) DBG | [stdout =====>] : True
(minikube) Creating VHD
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive New-VHD -Path 'C:\Users\mnuttall.miniku
be\machines\minikube\fixed.vhd' -SizeBytes 10MB -Fixed
(minikube) DBG | [stdout =====>] :
(minikube) DBG |
(minikube) DBG | ComputerName : IBM797-R9ZN2LB
(minikube) DBG | Path : C:\Users\mnuttall.minikube\machines\
minikube\fixed.v
(minikube) DBG | hd
(minikube) DBG | VhdFormat : VHD
(minikube) DBG | VhdType : Fixed
(minikube) DBG | FileSize : 10486272
(minikube) DBG | Size : 10485760
(minikube) DBG | MinimumSize :
(minikube) DBG | LogicalSectorSize : 512
(minikube) DBG | PhysicalSectorSize : 512
(minikube) DBG | BlockSize : 0
(minikube) DBG | ParentPath :
(minikube) DBG | DiskIdentifier : 1DB42AB3-11B5-42FD-BF65-460BDBD70A4F
(minikube) DBG | FragmentationPercentage : 0
(minikube) DBG | Alignment : 1
(minikube) DBG | Attached : False
(minikube) DBG | DiskNumber :
(minikube) DBG | Number :
(minikube) DBG |
(minikube) DBG |
(minikube) DBG |
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | Writing magic tar header
(minikube) DBG | Writing SSH key tar header
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive Convert-VHD -Path 'C:\Users\mnuttall.mi
nikube\machines\minikube\fixed.vhd' -DestinationPath 'C:\Users\mnuttall.minikub
e\machines\minikube\disk.vhd' -VHDType Dynamic -DeleteSource
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive Resize-VHD -Path 'C:\Users\mnuttall.min
ikube\machines\minikube\disk.vhd' -SizeBytes 20000MB
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive New-VM minikube -Path 'C:\Users\mnuttall
.minikube\machines\minikube' -SwitchName 'DockerNAT' -MemoryStartupBytes 2048MB

(minikube) DBG | [stdout =====>] :
(minikube) DBG | Name State CPUUsage(%) MemoryAssigned(M) Uptime Status
Versio
(minikube) DBG |
n
(minikube) DBG | ---- ----- ----------- ----------------- ------ ------
------
(minikube) DBG | minikube Off 0 0 00:00:00 Operating
normally 7.0
(minikube) DBG |
(minikube) DBG |
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive Set-VMProcessor minikube -Count 2
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive Set-VMDvdDrive -VMName minikube -Path 'C
:\Users\mnuttall.minikube\machines\minikube\boot2docker.iso'
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive Add-VMHardDiskDrive -VMName minikube -Pa
th 'C:\Users\mnuttall.minikube\machines\minikube\disk.vhd'
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) Starting VM...
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive Start-VM minikube
(minikube) DBG | [stdout =====>] :
(minikube) Waiting for host to start...
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] :
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] : fe80::215:5dff:fe4b:10f
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) Calling .GetConfigRaw
(minikube) Calling .DriverName
(minikube) Calling .DriverName
Waiting for machine to be running, this may take a few minutes...
(minikube) Calling .GetState
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
Detecting operating system of created instance...
Waiting for SSH to be available...
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
Getting to WaitForSSH function...
(minikube) Calling .GetSSHHostname
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive ( Get-VM minikube ).state
(minikube) DBG | [stdout =====>] : Running
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) DBG | [executing ==>] : C:\WINDOWS\System32\WindowsPowerShellv1.0\po
wershell.exe -NoProfile -NonInteractive (( Get-VM minikube ).networkadapters[0])
.ipaddresses[0]
(minikube) DBG | [stdout =====>] : fe80::215:5dff:fe4b:10f
(minikube) DBG |
(minikube) DBG | [stderr =====>] :
(minikube) Calling .GetSSHPort
(minikube) Calling .GetSSHKeyPath
(minikube) Calling .GetSSHKeyPath
(minikube) Calling .GetSSHUsername
SSH binary not found, using native Go implementation
&{{{ 0 [] [] []} docker [0xafc330] []} fe80::215:5dff:fe4b:10f 22 il>}
About to run SSH command:
exit 0
Error dialing TCP: dial tcp [fe80::215:5dff:fe4b:10f]:22: connectex: A connectio
n attempt failed because the connected party did not properly respond after a pe
riod of time, or established connection failed because connected host has failed
to respond.
Error dialing TCP: dial tcp [fe80::215:5dff:fe4b:10f]:22: connectex: A connectio
n attempt failed because the connected party did not properly respond after a pe
riod of time, or established connection failed because connected host has failed
to respond.

(This last message repeats indefinitely).

[mnuttall]

This looks very similar to https://github.com/kubernetes/minikube/pull/625 and https://github.com/kubernetes/minikube/issues/576 - but the September 27 fix either isn't live yet, or doesn't work for me.

[mnuttall]

I've fixed the problem. Further digging led me to to https://docs.docker.com/machine/drivers/hyper-v. The steps in section 2, 'Set up a new external network switch' must be completed before 'minikube start' will complete successfully. I'd have been saved a morning if this had been mentioned in the https://github.com/kubernetes/minikube readme.

[mnuttall]

Please see https://github.com/kubernetes/minikube/pull/860 for a proposed changed to the README.

[jevy-wangfei]

Minikube uses system ssh by default. But windows system don't have a ssh by default. Try using git bash as terminal have try. If it is not work, try re-install git bash as system ssh client.