Kubevirt: Request help Start window VM blue screen

[biliwewe]

Is this a BUG REPORT or FEATURE REQUEST?:

/kind bug

What happened:
I have a Windows 2003 image and a blue screen appears when I launch it with kubevirt

Environment:

• KubeVirt version (use virtctl version): v0.17.0
• Kubernetes version (use kubectl version): v1.14.6
• OS (e.g. from /etc/os-release): centos7
• Kernel (e.g. uname -a): 5.2.11-1.el7.elrepo.x86_64

How to reproduce it (as minimally and precisely as possible):

apiVersion: kubevirt.io/v1alpha3
kind: VirtualMachineInstance
metadata:
  name: win2k3
spec:
  domain:
    devices:
      disks:
      - disk: {}
        name: vmdisk
      interfaces:
      - bridge: {}
        model: e1000
        name: default
    firmware:
      uuid: c2c96209-0ed8-5332-b2b1-cdd83c273e17
    machine:
      type: q35
    resources:
      requests:
        cpu: "2"
        memory: 2048M
    features:
      acpi: {}
      apic: {}
      hyperv:
        relaxed: {}
        vapic: {}
        spinlocks:
          spinlocks: 8191
  networks:
  - name: default
    pod: {}
  volumes:
    - persistentVolumeClaim:
        claimName: win2k3pvc
      name: vmdisk

$ kubectl create -f win2k3.yaml
.......
$ kubectl get vmis
NAME    AGE   PHASE      IP                 NODENAME
win2k3   9s      Running   10.42.0.191   ip-192-168-4-102

view some logs:

kubectl logs -f virt-launcher-win2k3-6pnxl -c compute

{"component":"virt-launcher","level":"info","msg":"Collected all requested hook sidecar sockets","pos":"manager.go:67","timestamp":"2019-09-29T10:58:55.182214Z"}
{"component":"virt-launcher","level":"info","msg":"Sorted all collected sidecar sockets per hook point based on their priority and name: map[]","pos":"manager.go:70","timestamp":"2019-09-29T10:58:55.182430Z"}
{"component":"virt-launcher","level":"info","msg":"Watchdog file created at /var/run/kubevirt/watchdog-files/default_win2k3","pos":"virt-launcher.go:156","timestamp":"2019-09-29T10:58:55.184984Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon: qemu:///system","pos":"libvirt.go:348","timestamp":"2019-09-29T10:58:55.190116Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory')","pos":"libvirt.go:356","timestamp":"2019-09-29T10:58:55.228690Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory')","pos":"libvirt.go:356","timestamp":"2019-09-29T10:58:55.729710Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 5.0.0, package: 1.fc28 (Unknown, 2019-01-22-08:04:34, 64723eea657e48d296e6beb0b1be9c4c)","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:55.816000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: win2k3","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:55.816000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get DBus system bus connection: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory","pos":"virDBusGetSystemBus:110","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:55.816000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get DBus system bus connection: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory","pos":"virDBusGetSystemBus:110","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.012000Z"}
{"component":"virt-launcher","level":"warning","msg":"DBus not available, disabling firewalld support in bridge_network_driver: internal error: Unable to get DBus system bus connection: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory","pos":"networkStateInitialize:762","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.012000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:00.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.246000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:01.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.247000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:07.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.248000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:07.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.249000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:07.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.256000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:07.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.264000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:0f.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.265000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:10.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.275000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:11.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.279000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.279000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:03:00.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.280000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.281000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.2/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.282000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.282000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.4/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.283000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.5/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.284000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.6/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.285000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.286000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.287000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.288000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.2/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.289000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.290000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.4/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.291000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.5/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.292000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.6/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.293000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.294000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.295000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.295000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.2/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.296000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.297000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.4/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.298000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.5/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.299000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.6/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.300000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.301000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.302000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.303000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.2/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.304000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.305000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.4/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.306000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.5/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.307000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.6/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.308000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.309000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Child process (/usr/sbin/dmidecode -q -t 0,1,2,3,4,17) unexpected exit status 1: /dev/mem: No such file or directory","pos":"virCommandWait:2613","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.449000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Cannot probe for supported suspend types","pos":"virNodeSuspendSupportsTarget:336","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.537000Z"}
{"component":"virt-launcher","level":"warning","msg":"Failed to get host power management capabilities","pos":"virQEMUCapsInit:926","subcomponent":"libvirt","timestamp":"2019-09-29T10:58:56.537000Z"}
{"component":"virt-launcher","level":"info","msg":"Connected to libvirt daemon","pos":"libvirt.go:364","timestamp":"2019-09-29T10:58:58.982866Z"}
{"component":"virt-launcher","level":"info","msg":"Registered libvirt event notify callback","pos":"client.go:283","timestamp":"2019-09-29T10:58:58.990977Z"}
{"component":"virt-launcher","level":"info","msg":"Marked as ready","pos":"virt-launcher.go:73","timestamp":"2019-09-29T10:58:58.991841Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Executing PreStartHook on VMI pod environment","name":"win2k3","namespace":"default","pos":"manager.go:689","timestamp":"2019-09-29T10:59:00.250485Z","uid":"1f876f53-e2a8-11e9-8156-0050569175a1"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Starting PreCloudInitIso hook","name":"win2k3","namespace":"default","pos":"manager.go:700","timestamp":"2019-09-29T10:59:00.250697Z","uid":"1f876f53-e2a8-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"updated MAC for eth0 interface: old: 06:e9:3d:33:07:d7 -\u003e new: 06:e9:3d:72:e7:47","pos":"common.go:203","timestamp":"2019-09-29T10:59:00.254213Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"bridge pod interface: VIF: { Name: eth0, IP: 10.42.0.191, Mask: ffffffff, MAC: 06:e9:3d:33:07:d7, Gateway: 169.254.1.1, MTU: 1500}","name":"win2k3","namespace":"default","pos":"podinterface.go:258","timestamp":"2019-09-29T10:59:00.256400Z","uid":"1f876f53-e2a8-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"Found nameservers in /etc/resolv.conf: \n+\u0000\n","pos":"converter.go:1394","timestamp":"2019-09-29T10:59:00.256776Z"}
{"component":"virt-launcher","level":"info","msg":"Found search domains in /etc/resolv.conf: default.svc.cluster.local svc.cluster.local cluster.local","pos":"converter.go:1395","timestamp":"2019-09-29T10:59:00.256869Z"}
{"component":"virt-launcher","level":"info","msg":"Starting SingleClientDHCPServer","pos":"dhcp.go:64","timestamp":"2019-09-29T10:59:00.257232Z"}
{"component":"virt-launcher","level":"info","msg":"Driver cache mode for /var/run/kubevirt-private/vmi-disks/vmdisk/disk.img set to none","pos":"converter.go:166","timestamp":"2019-09-29T10:59:00.257930Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Domain defined.","name":"win2k3","namespace":"default","pos":"manager.go:889","timestamp":"2019-09-29T10:59:00.273138Z","uid":"1f876f53-e2a8-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event 0 with reason 0 received","pos":"client.go:248","timestamp":"2019-09-29T10:59:00.273548Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get DBus system bus connection: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory","pos":"virDBusGetSystemBus:110","subcomponent":"libvirt","timestamp":"2019-09-29T10:59:00.278000Z"}
{"component":"virt-launcher","level":"error","msg":"At least one cgroup controller is required: No such device or address","pos":"virCgroupDetect:394","subcomponent":"libvirt","timestamp":"2019-09-29T10:59:00.381000Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Paused(3):StartingUp(11)","pos":"client.go:179","timestamp":"2019-09-29T10:59:00.437484Z"}
{"component":"virt-launcher","level":"info","msg":"Detected domain with UUID c2c96209-0ed8-5332-b2b1-cdd83c273e17","pos":"virt-launcher.go:246","timestamp":"2019-09-29T10:59:00.444766Z"}
{"component":"virt-launcher","level":"info","msg":"Monitoring loop: rate 1s start timeout 5m0s","pos":"monitor.go:251","timestamp":"2019-09-29T10:59:00.444908Z"}
{"component":"virt-launcher","level":"info","msg":"processed event","pos":"client.go:235","timestamp":"2019-09-29T10:59:00.446614Z"}
{"component":"virt-launcher","level":"info","msg":"GuestAgentLifecycle event state 2 with reason 1 received","pos":"client.go:266","timestamp":"2019-09-29T10:59:00.691404Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Paused(3):StartingUp(11)","pos":"client.go:179","timestamp":"2019-09-29T10:59:00.696618Z"}
{"component":"virt-launcher","level":"info","msg":"processed event","pos":"client.go:235","timestamp":"2019-09-29T10:59:00.699794Z"}
{"component":"virt-launcher","level":"warning","msg":"host doesn't support hyperv 'spinlocks' feature","pos":"qemuProcessVerifyHypervFeatures:4008","subcomponent":"libvirt","timestamp":"2019-09-29T10:59:00.711000Z"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event 4 with reason 0 received","pos":"client.go:248","timestamp":"2019-09-29T10:59:00.723411Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Running(1):Unknown(1)","pos":"client.go:179","timestamp":"2019-09-29T10:59:00.728130Z"}
{"component":"virt-launcher","level":"info","msg":"processed event","pos":"client.go:235","timestamp":"2019-09-29T10:59:00.729628Z"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event 2 with reason 0 received","pos":"client.go:248","timestamp":"2019-09-29T10:59:00.755760Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Domain started.","name":"win2k3","namespace":"default","pos":"manager.go:920","timestamp":"2019-09-29T10:59:00.757974Z","uid":"1f876f53-e2a8-11e9-8156-0050569175a1"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"win2k3","namespace":"default","pos":"server.go:166","timestamp":"2019-09-29T10:59:00.760956Z","uid":"1f876f53-e2a8-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Running(1):Unknown(1)","pos":"client.go:179","timestamp":"2019-09-29T10:59:00.761866Z"}
{"component":"virt-launcher","level":"info","msg":"processed event","pos":"client.go:235","timestamp":"2019-09-29T10:59:00.763337Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"win2k3","namespace":"default","pos":"server.go:166","timestamp":"2019-09-29T10:59:00.810897Z","uid":"1f876f53-e2a8-11e9-8156-0050569175a1"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"win2k3","namespace":"default","pos":"server.go:166","timestamp":"2019-09-29T10:59:00.822112Z","uid":"1f876f53-e2a8-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"Found PID for c2c96209-0ed8-5332-b2b1-cdd83c273e17: 120","pos":"monitor.go:220","timestamp":"2019-09-29T10:59:01.450320Z"}

kubectl exec -it virt-launcher-win2k3-6pnxl -c compute bash

virsh edit default_win2k3:

<domain type='kvm'>
  <name>default_win2k3</name>
  <uuid>c2c96209-0ed8-5332-b2b1-cdd83c273e17</uuid>
  <metadata>
    <kubevirt xmlns="http://kubevirt.io">
      <uid>1f876f53-e2a8-11e9-8156-0050569175a1</uid>
      <graceperiod>
        <deletionGracePeriodSeconds>30</deletionGracePeriodSeconds>
      </graceperiod>
    </kubevirt>
  </metadata>
  <memory unit='KiB'>2000000</memory>
  <currentMemory unit='KiB'>2000000</currentMemory>
  <vcpu placement='static'>2</vcpu>
  <iothreads>1</iothreads>
  <sysinfo type='smbios'>
    <system>
      <entry name='uuid'>c2c96209-0ed8-5332-b2b1-cdd83c273e17</entry>
    </system>
  </sysinfo>
  <os>
    <type arch='x86_64' machine='pc-q35-3.1'>hvm</type>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
    </hyperv>
  </features>
  <cpu mode='host-model' check='partial'>
    <model fallback='allow'/>
    <topology sockets='2' cores='1' threads='1'/>
  </cpu>
  <clock offset='utc'/>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
<devices>
    <emulator>/usr/bin/qemu-system-x86_64</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='none'/>
      <source file='/var/run/kubevirt-private/vmi-disks/vmdisk/disk.img'/>
      <target dev='sda' bus='sata'/>
      <alias name='ua-vmdisk'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <controller type='usb' index='0' model='none'/>
    <controller type='sata' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'/>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x10'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0' multifunction='on'/>
    </controller>
    <controller type='pci' index='2' model='pcie-to-pci-bridge'>
      <model name='pcie-pci-bridge'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </controller>
    <controller type='pci' index='3' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='3' port='0x11'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x1'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0x12'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x2'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='06:e9:3d:33:07:d7'/>
      <source bridge='k6t-eth0'/>
      <model type='e1000'/>
      <mtu size='1500'/>
      <alias name='ua-default'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x01' function='0x0'/>
    </interface>
    <serial type='unix'>
      <source mode='bind' path='/var/run/kubevirt-private/1f876f53-e2a8-11e9-8156-0050569175a1/virt-serial0'/>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='unix'>
      <source mode='bind' path='/var/run/kubevirt-private/1f876f53-e2a8-11e9-8156-0050569175a1/virt-serial0'/>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <graphics type='vnc' socket='/var/run/kubevirt-private/1f876f53-e2a8-11e9-8156-0050569175a1/virt-vnc'>
      <listen type='socket' socket='/var/run/kubevirt-private/1f876f53-e2a8-11e9-8156-0050569175a1/virt-vnc'/>
    </graphics>
    <video>
      <model type='vga' vram='16384' heads='1' primary='yes'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0'/>
    </video>
    <memballoon model='none'/>
  </devices>
</domain>

[rmohr]

@biliwewe would it be possible for you to start your windows VM directly with libvirt and post the resulting domain xml? I guess we just have to enable some guest features (can be that we already support them, or that they need to be exposed).

[rmohr]

/kind bug

[rmohr]

Some people told me that Windows 10 worked for the, This configuration should normally be sufficient: https://github.com/kubevirt/kubevirt/blob/master/examples/vm-template-windows2012r2.yaml#L31. The main difference I see to your configuration seems to be the clock settings. Can you try it with these settings again?

[biliwewe]

Hi @rmohr I updated my yaml file by following https://github.com/kubevirt/kubevirt/blob/master/examples/vm-template-windows2012r2.yaml#L31
win2k3.yaml:

apiVersion: kubevirt.io/v1alpha3
kind: VirtualMachineInstance
metadata:
  name: win2k3
spec:
  domain:
    clock:
      timer:
        hpet:
          present: false
        hyperv: {}
        pit:
          tickPolicy: delay
        rtc:
          tickPolicy: catchup
      utc: {}
    cpu:
      cores: 2
    devices:
      disks:
      - disk:
          bus: sata
        name: pvcdisk
      interfaces:
      - masquerade: {}
        model: e1000
        name: default
    features:
      acpi: {}
      apic: {}
      hyperv:
        relaxed: {}
        spinlocks:
          spinlocks: 8191
        vapic: {}
    firmware:
      uuid: 5d307ca9-b3ef-428c-8861-06e72d69f223
    machine:
      type: q35
    resources:
      requests:
        memory: 2Gi
  networks:
  - name: default
    pod: {}
  terminationGracePeriodSeconds: 0
  volumes:
  - name: pvcdisk
    persistentVolumeClaim:
      claimName: win2k3pvc

The issue still exists

$ kubectl get pods
NAME                                 READY   STATUS    RESTARTS   AGE
virt-launcher-win2k3-6s7zp   0/1     Running   0          6s

$ kubectl get  vmis
NAME     AGE     PHASE     IP            NODENAME
win2k3   5m28s   Running   10.42.0.199   ip-192-168-4-102

view some logs:

kubectl logs -f virt-launcher-win2k3-6s7zp -c compute

{"component":"virt-launcher","level":"info","msg":"Collected all requested hook sidecar sockets","pos":"manager.go:67","timestamp":"2019-09-30T06:44:08.167293Z"}
{"component":"virt-launcher","level":"info","msg":"Sorted all collected sidecar sockets per hook point based on their priority and name: map[]","pos":"manager.go:70","timestamp":"2019-09-30T06:44:08.167511Z"}
{"component":"virt-launcher","level":"info","msg":"Watchdog file created at /var/run/kubevirt/watchdog-files/default_win2k3","pos":"virt-launcher.go:156","timestamp":"2019-09-30T06:44:08.170441Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon: qemu:///system","pos":"libvirt.go:348","timestamp":"2019-09-30T06:44:08.192769Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory')","pos":"libvirt.go:356","timestamp":"2019-09-30T06:44:08.193448Z"}
{"component":"virt-launcher","level":"info","msg":"Connecting to libvirt daemon failed: virError(Code=38, Domain=7, Message='Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory')","pos":"libvirt.go:356","timestamp":"2019-09-30T06:44:08.694374Z"}
{"component":"virt-launcher","level":"info","msg":"libvirt version: 5.0.0, package: 1.fc28 (Unknown, 2019-01-22-08:04:34, 64723eea657e48d296e6beb0b1be9c4c)","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:08.914000Z"}
{"component":"virt-launcher","level":"info","msg":"hostname: win2k3","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:08.914000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get DBus system bus connection: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory","pos":"virDBusGetSystemBus:110","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:08.914000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get DBus system bus connection: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory","pos":"virDBusGetSystemBus:110","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.128000Z"}
{"component":"virt-launcher","level":"warning","msg":"DBus not available, disabling firewalld support in bridge_network_driver: internal error: Unable to get DBus system bus connection: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory","pos":"networkStateInitialize:762","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.128000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:00.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.317000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:01.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.318000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:07.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.319000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:07.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.320000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:07.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.325000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:07.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.333000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:0f.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.334000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:10.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.348000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:11.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.352000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.352000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:03:00.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.353000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.354000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.2/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.355000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.356000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.4/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.357000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.5/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.358000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.6/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.359000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:15.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.360000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.361000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.362000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.2/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.363000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.365000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.4/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.366000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.5/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.367000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.6/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.368000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:16.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.369000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.370000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.371000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.2/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.373000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.374000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.4/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.375000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.5/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.377000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.6/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.379000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:17.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.380000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.0/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.382000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.1/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.383000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.2/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.384000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.3/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.385000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.4/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.386000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.5/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.388000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.6/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.389000Z"}
{"component":"virt-launcher","level":"error","msg":"Failed to open config space file '/sys/bus/pci/devices/0000:00:18.7/config': Read-only file system","pos":"virPCIDeviceConfigOpen:300","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.391000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Child process (/usr/sbin/dmidecode -q -t 0,1,2,3,4,17) unexpected exit status 1: /dev/mem: No such file or directory","pos":"virCommandWait:2613","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.557000Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Cannot probe for supported suspend types","pos":"virNodeSuspendSupportsTarget:336","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.653000Z"}
{"component":"virt-launcher","level":"warning","msg":"Failed to get host power management capabilities","pos":"virQEMUCapsInit:926","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:09.653000Z"}
{"component":"virt-launcher","level":"info","msg":"Connected to libvirt daemon","pos":"libvirt.go:364","timestamp":"2019-09-30T06:44:11.835791Z"}
{"component":"virt-launcher","level":"info","msg":"Registered libvirt event notify callback","pos":"client.go:283","timestamp":"2019-09-30T06:44:11.844629Z"}
{"component":"virt-launcher","level":"info","msg":"Marked as ready","pos":"virt-launcher.go:73","timestamp":"2019-09-30T06:44:11.845491Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Executing PreStartHook on VMI pod environment","name":"win2k3","namespace":"default","pos":"manager.go:689","timestamp":"2019-09-30T06:44:13.007192Z","uid":"b234b1c7-e34d-11e9-8156-0050569175a1"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Starting PreCloudInitIso hook","name":"win2k3","namespace":"default","pos":"manager.go:700","timestamp":"2019-09-30T06:44:13.007383Z","uid":"b234b1c7-e34d-11e9-8156-0050569175a1"}
{"component":"virt-launcher","kind":"","level":"info","msg":"masquerade pod interface: VIF: { Name: eth0, IP: 10.0.2.2, Mask: ffffff00, MAC: 02:00:00:02:00:17, Gateway: 10.0.2.1, MTU: 1500}","name":"win2k3","namespace":"default","pos":"podinterface.go:446","timestamp":"2019-09-30T06:44:13.102843Z","uid":"b234b1c7-e34d-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"Found nameservers in /etc/resolv.conf: \n+\u0000\n","pos":"converter.go:1394","timestamp":"2019-09-30T06:44:13.103193Z"}
{"component":"virt-launcher","level":"info","msg":"Found search domains in /etc/resolv.conf: default.svc.cluster.local svc.cluster.local cluster.local","pos":"converter.go:1395","timestamp":"2019-09-30T06:44:13.103303Z"}
{"component":"virt-launcher","level":"info","msg":"Starting SingleClientDHCPServer","pos":"dhcp.go:64","timestamp":"2019-09-30T06:44:13.103614Z"}
{"component":"virt-launcher","level":"info","msg":"Driver cache mode for /var/run/kubevirt-private/vmi-disks/pvcdisk/disk.img set to none","pos":"converter.go:166","timestamp":"2019-09-30T06:44:13.104185Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Domain defined.","name":"win2k3","namespace":"default","pos":"manager.go:889","timestamp":"2019-09-30T06:44:13.117640Z","uid":"b234b1c7-e34d-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event 0 with reason 0 received","pos":"client.go:248","timestamp":"2019-09-30T06:44:13.117872Z"}
{"component":"virt-launcher","level":"error","msg":"internal error: Unable to get DBus system bus connection: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory","pos":"virDBusGetSystemBus:110","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:13.122000Z"}
{"component":"virt-launcher","level":"error","msg":"At least one cgroup controller is required: No such device or address","pos":"virCgroupDetect:394","subcomponent":"libvirt","timestamp":"2019-09-30T06:44:13.235000Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Paused(3):StartingUp(11)","pos":"client.go:179","timestamp":"2019-09-30T06:44:13.269898Z"}
{"component":"virt-launcher","level":"info","msg":"Detected domain with UUID 5d307ca9-b3ef-428c-8861-06e72d69f223","pos":"virt-launcher.go:246","timestamp":"2019-09-30T06:44:13.275732Z"}
{"component":"virt-launcher","level":"info","msg":"Monitoring loop: rate 1s start timeout 5m0s","pos":"monitor.go:251","timestamp":"2019-09-30T06:44:13.275893Z"}
{"component":"virt-launcher","level":"info","msg":"processed event","pos":"client.go:235","timestamp":"2019-09-30T06:44:13.277623Z"}
{"component":"virt-launcher","level":"info","msg":"GuestAgentLifecycle event state 2 with reason 1 received","pos":"client.go:266","timestamp":"2019-09-30T06:44:13.476347Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Paused(3):StartingUp(11)","pos":"client.go:179","timestamp":"2019-09-30T06:44:13.481733Z"}
{"component":"virt-launcher","level":"info","msg":"processed event","pos":"client.go:235","timestamp":"2019-09-30T06:44:13.484329Z"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event 4 with reason 0 received","pos":"client.go:248","timestamp":"2019-09-30T06:44:13.507303Z"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Running(1):Unknown(1)","pos":"client.go:179","timestamp":"2019-09-30T06:44:13.519415Z"}
{"component":"virt-launcher","level":"info","msg":"processed event","pos":"client.go:235","timestamp":"2019-09-30T06:44:13.521910Z"}
{"component":"virt-launcher","level":"info","msg":"DomainLifecycle event 2 with reason 0 received","pos":"client.go:248","timestamp":"2019-09-30T06:44:13.540775Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Domain started.","name":"win2k3","namespace":"default","pos":"manager.go:920","timestamp":"2019-09-30T06:44:13.542918Z","uid":"b234b1c7-e34d-11e9-8156-0050569175a1"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"win2k3","namespace":"default","pos":"server.go:166","timestamp":"2019-09-30T06:44:13.545645Z","uid":"b234b1c7-e34d-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"kubevirt domain status: Running(1):Unknown(1)","pos":"client.go:179","timestamp":"2019-09-30T06:44:13.546750Z"}
{"component":"virt-launcher","level":"info","msg":"processed event","pos":"client.go:235","timestamp":"2019-09-30T06:44:13.548960Z"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"win2k3","namespace":"default","pos":"server.go:166","timestamp":"2019-09-30T06:44:13.614082Z","uid":"b234b1c7-e34d-11e9-8156-0050569175a1"}
{"component":"virt-launcher","kind":"","level":"info","msg":"Synced vmi","name":"win2k3","namespace":"default","pos":"server.go:166","timestamp":"2019-09-30T06:44:13.625579Z","uid":"b234b1c7-e34d-11e9-8156-0050569175a1"}
{"component":"virt-launcher","level":"info","msg":"Found PID for 5d307ca9-b3ef-428c-8861-06e72d69f223: 131","pos":"monitor.go:220","timestamp":"2019-09-30T06:44:14.280943Z"}

virsh edit default_win2k3:

<domain type='kvm' id='1'>
  <name>default_win2k3</name>
  <uuid>5d307ca9-b3ef-428c-8861-06e72d69f223</uuid>
  <metadata>
    <kubevirt xmlns="http://kubevirt.io">
      <uid>b234b1c7-e34d-11e9-8156-0050569175a1</uid>
      <graceperiod>
        <deletionGracePeriodSeconds>0</deletionGracePeriodSeconds>
      </graceperiod>
    </kubevirt>
  </metadata>
  <memory unit='KiB'>2097152</memory>
  <currentMemory unit='KiB'>2097152</currentMemory>
  <vcpu placement='static'>2</vcpu>
  <iothreads>1</iothreads>
  <resource>
    <partition>/machine</partition>
  </resource>
  <sysinfo type='smbios'>
    <system>
      <entry name='uuid'>5d307ca9-b3ef-428c-8861-06e72d69f223</entry>
    </system>
  </sysinfo>
  <os>
    <type arch='x86_64' machine='pc-q35-3.1'>hvm</type>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
    </hyperv>
  </features>
  <cpu mode='custom' match='exact' check='full'>
    <model fallback='forbid'>IvyBridge</model>
    <vendor>Intel</vendor>
    <topology sockets='1' cores='2' threads='1'/>
    <feature policy='require' name='ss'/>
    <feature policy='require' name='vmx'/>
    <feature policy='require' name='pcid'/>
    <feature policy='require' name='hypervisor'/>
    <feature policy='require' name='arat'/>
    <feature policy='require' name='tsc_adjust'/>
    <feature policy='require' name='umip'/>
    <feature policy='disable' name='erms'/>
    <feature policy='disable' name='xsaveopt'/>
  </cpu>
  <clock offset='utc' adjustment='reset'>
    <timer name='rtc' present='yes' tickpolicy='catchup'/>
    <timer name='pit' present='yes' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
    <timer name='hypervclock' present='yes'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <devices>
    <emulator>/usr/bin/qemu-system-x86_64</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='none'/>
      <source file='/var/run/kubevirt-private/vmi-disks/pvcdisk/disk.img'/>
      <backingStore/>
      <target dev='sda' bus='sata'/>
      <alias name='ua-pvcdisk'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <controller type='usb' index='0' model='none'>
      <alias name='usb'/>
    </controller>
    <controller type='sata' index='0'>
      <alias name='ide'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'>
      <alias name='pcie.0'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <alias name='virtio-serial0'/>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
    </controller>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x10'/>
      <alias name='pci.1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0' multifunction='on'/>
    </controller>
    <controller type='pci' index='2' model='pcie-to-pci-bridge'>
      <model name='pcie-pci-bridge'/>
      <alias name='pci.2'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </controller>
    <controller type='pci' index='3' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='3' port='0x11'/>
      <alias name='pci.3'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x1'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0x12'/>
      <alias name='pci.4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x2'/>
    </controller>
    <interface type='bridge'>
      <mac address='02:00:00:02:00:17'/>
      <source bridge='k6t-eth0'/>
      <target dev='vnet0'/>
      <model type='e1000'/>
      <mtu size='1500'/>
      <alias name='ua-default'/>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x01' function='0x0'/>
    </interface>
    <serial type='unix'>
      <source mode='bind' path='/var/run/kubevirt-private/b234b1c7-e34d-11e9-8156-0050569175a1/virt-serial0'/>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
      <alias name='serial0'/>
    </serial>
    <console type='unix'>
      <source mode='bind' path='/var/run/kubevirt-private/b234b1c7-e34d-11e9-8156-0050569175a1/virt-serial0'/>
      <target type='serial' port='0'/>
      <alias name='serial0'/>
    </console>
    <channel type='unix'>
      <source mode='bind' path='/var/lib/libvirt/qemu/channel/target/domain-1-default_win2k3/org.qemu.guest_agent.0'/>
      <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>
      <alias name='channel0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='mouse' bus='ps2'>
      <alias name='input0'/>
    </input>
    <input type='keyboard' bus='ps2'>
      <alias name='input1'/>
    </input>
    <graphics type='vnc' socket='/var/run/kubevirt-private/b234b1c7-e34d-11e9-8156-0050569175a1/virt-vnc'>
      <listen type='socket' socket='/var/run/kubevirt-private/b234b1c7-e34d-11e9-8156-0050569175a1/virt-vnc'/>
    </graphics>
    <video>
      <model type='vga' vram='16384' heads='1' primary='yes'/>
      <alias name='video0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0'/>
    </video>
    <memballoon model='none'/>
  </devices>
  <seclabel type='dynamic' model='dac' relabel='yes'>
    <label>+107:+107</label>
    <imagelabel>+107:+107</imagelabel>
  </seclabel>
</domain>

[biliwewe]

@biliwewe would it be possible for you to start your windows VM directly with libvirt and post the resulting domain xml? I guess we just have to enable some guest features (can be that we already support them, or that they need to be exposed).

@rmohr I can start win2k3 vm directly using libvirt

$ virsh list

 Id    Name                           State
----------------------------------------------------
 9     win2k3             running

virsh dumpxml win2k3

<domain type='kvm' id='9'>
  <name>win2k3</name>
  <uuid>170ef853-858b-462f-801b-c93cccc85b9b</uuid>
  <memory unit='KiB'>2097152</memory>
  <currentMemory unit='KiB'>2097152</currentMemory>
  <vcpu placement='static'>2</vcpu>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-i440fx-rhel7.0.0'>hvm</type>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
    </hyperv>
  </features>
  <cpu mode='custom' match='exact' check='full'>
    <model fallback='forbid'>IvyBridge</model>
    <feature policy='require' name='hypervisor'/>
    <feature policy='disable' name='erms'/>
    <feature policy='disable' name='xsaveopt'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
    <timer name='hypervclock' present='yes'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <pm>
    <suspend-to-mem enabled='no'/>
    <suspend-to-disk enabled='no'/>
  </pm>
  <devices>
    <emulator>/usr/libexec/qemu-kvm</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/images/test-win2003.img'/>
      <backingStore/>
      <target dev='vda' bus='virtio'/>
      <boot order='1'/>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <alias name='usb'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <alias name='usb'/>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <alias name='usb'/>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <alias name='usb'/>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'>
      <alias name='pci.0'/>
    </controller>
    <controller type='fdc' index='0'>
      <alias name='fdc0'/>
    </controller>
    <controller type='ide' index='0'>
      <alias name='ide'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:c8:8f:c5'/>
      <source bridge='br0'/>
      <target dev='vnet0'/>
      <model type='e1000'/>
      <alias name='net0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </interface>
    <serial type='pty'>
      <source path='/dev/pts/1'/>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
      <alias name='serial0'/>
    </serial>
    <console type='pty' tty='/dev/pts/1'>
      <source path='/dev/pts/1'/>
      <target type='serial' port='0'/>
      <alias name='serial0'/>
    </console>
    <input type='tablet' bus='usb'>
      <alias name='input0'/>
      <address type='usb' bus='0' port='1'/>
    </input>
    <input type='mouse' bus='ps2'>
      <alias name='input1'/>
    </input>
    <input type='keyboard' bus='ps2'>
      <alias name='input2'/>
    </input>
    <graphics type='vnc' port='5910' autoport='no' listen='0.0.0.0'>
      <listen type='address' address='0.0.0.0'/>
    </graphics>
    <video>
      <model type='vga' vram='16384' heads='1' primary='yes'/>
      <alias name='video0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </video>
    <memballoon model='virtio'>
      <alias name='balloon0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </memballoon>
    <rng model='virtio'>
      <backend model='random'>/dev/random</backend>
      <alias name='rng0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
    </rng>
  </devices>
  <seclabel type='dynamic' model='selinux' relabel='yes'>
    <label>system_u:system_r:svirt_t:s0:c273,c792</label>
    <imagelabel>system_u:object_r:svirt_image_t:s0:c273,c792</imagelabel>
  </seclabel>
  <seclabel type='dynamic' model='dac' relabel='yes'>
    <label>+107:+107</label>
    <imagelabel>+107:+107</imagelabel>
  </seclabel>
</domain>

[rmohr]

Hm, I think I remember something like that windows desktop versions also need usb and tablet present.

Can you retry with adding the following to spec.domain.devices:

      inputs:
      - type: tablet
        bus: usb
        name: tablet1

[biliwewe]

Hi @rmohr, I modified my vm.yaml

apiVersion: kubevirt.io/v1alpha3
kind: VirtualMachineInstance
metadata:
  name: win2k3
spec:
  domain:
    clock:
      timer:
        hpet:
          present: false
        hyperv: {}
        pit:
          tickPolicy: delay
        rtc:
          tickPolicy: catchup
      utc: {}
    cpu:
      cores: 2
    devices:
      inputs:
      - type: tablet
        bus: usb
        name: tablet1
      disks:
      - disk:
          bus: sata
        name: pvcdisk
      interfaces:
      - masquerade: {}
        model: e1000
        name: default
    features:
      acpi: {}
      apic: {}
      hyperv:
        relaxed: {}
        spinlocks:
          spinlocks: 8191
        vapic: {}
    firmware:
      uuid: 5d307ca9-b3ef-428c-8861-06e72d69f223
    machine:
      type: q35
    resources:
      requests:
        memory: 2Gi
  networks:
  - name: default
    pod: {}
  terminationGracePeriodSeconds: 0
  volumes:
  - name: pvcdisk
    persistentVolumeClaim:
      claimName: win2k3pvc

Running Windows Server 2003 vm is still blue screen, But running Windows Server 2012 R2 vm succeeded.
This is my win2k3 driver, Is it a problem with my Windows Guest Virtual Machines?

[rmohr]

@biliwewe I am now out of ideas.
@MarSik any ideas?

[biliwewe]

@rmohr Have you successfully run win2k3 vm?

[rmohr]

@biliwewe no I did not. We will have to look at the domain xml differences, to seewhat we are missing.

[rmohr]

Ah now I see it. You need i440 machine type, while we use the newer q35 machine type. You can have a look here https://kubevirt.io/user-guide/docs/latest/creating-virtual-machines/virtualized-hardware-configuration.html#machine-type on how to set the older type.

[biliwewe]

Hi @rmohr Reference document I modified the Machine Type

spec:
  domain:
    machine:
      type: pc-i440fx-3.1

An error occurred：

The request is invalid: spec.domain.machine.type: spec.domain.machine.type is not supported: pc-i440fx-3.1 (allowed values: [q35* pc-q35*])

I checked the machine supported by qemu-system-x86_64

[root@win2k3 /]# /usr/bin/qemu-system-x86_64 -machine help
Supported machines are:
pc                   Standard PC (i440FX + PIIX, 1996) (alias of pc-i440fx-3.1)
pc-i440fx-3.1        Standard PC (i440FX + PIIX, 1996) (default)
pc-i440fx-3.0        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.9        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.8        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.7        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.6        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.5        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.4        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.3        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.2        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.12       Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.11       Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.10       Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.1        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-2.0        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-1.7        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-1.6        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-1.5        Standard PC (i440FX + PIIX, 1996)
pc-i440fx-1.4        Standard PC (i440FX + PIIX, 1996)
pc-1.3               Standard PC (i440FX + PIIX, 1996)
pc-1.2               Standard PC (i440FX + PIIX, 1996)
pc-1.1               Standard PC (i440FX + PIIX, 1996)
pc-1.0               Standard PC (i440FX + PIIX, 1996)
pc-0.15              Standard PC (i440FX + PIIX, 1996)
pc-0.14              Standard PC (i440FX + PIIX, 1996)
pc-0.13              Standard PC (i440FX + PIIX, 1996)
pc-0.12              Standard PC (i440FX + PIIX, 1996)
pc-0.11              Standard PC (i440FX + PIIX, 1996) (deprecated)
pc-0.10              Standard PC (i440FX + PIIX, 1996) (deprecated)
q35                  Standard PC (Q35 + ICH9, 2009) (alias of pc-q35-3.1)
pc-q35-3.1           Standard PC (Q35 + ICH9, 2009)
pc-q35-3.0           Standard PC (Q35 + ICH9, 2009)
pc-q35-2.9           Standard PC (Q35 + ICH9, 2009)
pc-q35-2.8           Standard PC (Q35 + ICH9, 2009)
pc-q35-2.7           Standard PC (Q35 + ICH9, 2009)
pc-q35-2.6           Standard PC (Q35 + ICH9, 2009)
pc-q35-2.5           Standard PC (Q35 + ICH9, 2009)
pc-q35-2.4           Standard PC (Q35 + ICH9, 2009)
pc-q35-2.12          Standard PC (Q35 + ICH9, 2009)
pc-q35-2.11          Standard PC (Q35 + ICH9, 2009)
pc-q35-2.10          Standard PC (Q35 + ICH9, 2009)
isapc                ISA-only PC
none                 empty machine
xenfv                Xen Fully-virtualized PC
xenpv                Xen Para-virtualized PC

I don't know how to handle it, can you help me?
thank

[rmohr]

Sorry for the late response. There is a regexp in the kubevirt-config configmap which prevents you from creating PC machines by default.

Can you try editing the config map with kubectl edit and change emulated-machines to q35*,pc-q35*,pc*? Here how mine looks like:

$ kubectl.sh get configmaps -n kubevirt -o yaml kubevirt-config
apiVersion: v1
data:
  emulated-machines: q35*,pc-q35*,pc*
  feature-gates: DataVolumes, CPUManager, LiveMigration, ExperimentalIgnitionSupport,
    Sidecar
  machine-type: ""

[biliwewe]

Cool, @rmohr Thank you for your kind help, Problem solved perfectly!

[rmohr]

Great to hear. Is the whole issue solved? Can the issue be closed?

[biliwewe]

Yes, @rmohr Thanks again When. I change the Machine Type to pc-i440fx-3.1 I can start windows 2003/xp.