# Installing Windows Server 2016 on OpenNebula 5.6.1 (nested virtualization)

**URL:** <https://forum.opennebula.io/t/installing-windows-server-2016-on-opennebula-5-6-1-nested-virtualization/6634>\
**Category:** Installation & Configuration\
**Created:** [November 12, 2018, 6:38pm UTC](https://forum.opennebula.io/t/installing-windows-server-2016-on-opennebula-5-6-1-nested-virtualization/6634 "2018-11-12T18:38:29Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![amfj](https://avatars.discourse-cdn.com/v4/letter/a/a183cd/32.png) [@amfj](https://forum.opennebula.io/u/amfj)\
**Post date:** [November 12, 2018, 6:38pm UTC](https://forum.opennebula.io/t/installing-windows-server-2016-on-opennebula-5-6-1-nested-virtualization/6634/1 "2018-11-12T18:38:29Z")

</div>

I successfully installed Open Nebula 5.6.1 on VirtualBox under Ubuntu 16.04.  
I achieved to create some linux virtual machines but I stumbled upon Windows Server 2016.

I uploaded a WinServer 2016 ISO, Virtio Drivers ISO and create a new empty disk-image.  
Then I created a new template and added stuff.  
Finally, I instantiated a virtual machine but at the installation process it failed.

That is my template …

> CONTEXT = [  
> NETWORK = “YES”,  
> SSH\_PUBLIC\_KEY = “$USER[SSH\_PUBLIC\_KEY]” ]  
> CPU = “1”  
> DISK = [  
> DEV\_PREFIX = “vd”,  
> IMAGE = “WindowsServer2016\_HD”,  
> IMAGE\_UNAME = “oneadmin” ]  
> DISK = [  
> IMAGE = “WinServer\_ISO”,  
> IMAGE\_UNAME = “oneadmin” ]  
> DISK = [  
> IMAGE = “Virtio Drivers”,  
> IMAGE\_UNAME = “oneadmin” ]  
> FEATURES = [  
> ACPI = “yes”,  
> APIC = “yes”,  
> LOCALTIME = “no” ]  
> GRAPHICS = [  
> LISTEN = “0.0.0.0”,  
> RANDOM\_PASSWD = “YES”,  
> TYPE = “VNC” ]  
> HYPERVISOR = “kvm”  
> INPUT = [  
> BUS = “usb”,  
> TYPE = “tablet” ]  
> INPUTS\_ORDER = “”  
> LOGO = “images/logos/windows8.png”  
> MEMORY = “4096”  
> MEMORY\_UNIT\_COST = “MB”  
> NIC = [  
> NETWORK = “mired”,  
> NETWORK\_UNAME = “oneadmin”,  
> SECURITY\_GROUPS = “0” ]  
> NIC\_DEFAULT = [  
> MODEL = “virtio” ]  
> OS = [  
> ARCH = “x86\_64”,  
> BOOT = “disk0,disk1,disk2” ]

and this is my instance…

> User template  
> HYPERVISOR = “kvm”  
> INPUTS\_ORDER = “”  
> LOGO = “images/logos/windows8.png”  
> MEMORY\_UNIT\_COST = “MB”
> 
> Template  
> AUTOMATIC\_DS\_REQUIREMENTS = “("CLUSTERS/ID" @\> 0)”  
> AUTOMATIC\_REQUIREMENTS = “(CLUSTER\_ID = 0) & !(PUBLIC\_CLOUD = YES)”  
> CONTEXT = [  
> DISK\_ID = “3”,  
> ETH0\_CONTEXT\_FORCE\_IPV4 = “”,  
> ETH0\_DNS = “8.8.8.8”,  
> ETH0\_GATEWAY = “10.0.2.2”,  
> ETH0\_GATEWAY6 = “”,  
> ETH0\_IP = “10.0.2.100”,  
> ETH0\_IP6 = “”,  
> ETH0\_IP6\_PREFIX\_LENGTH = “”,  
> ETH0\_IP6\_ULA = “”,  
> ETH0\_MAC = “02:00:0a:00:02:64”,  
> ETH0\_MASK = “255.255.255.0”,  
> ETH0\_MTU = “”,  
> ETH0\_NETWORK = “10.0.2.0”,  
> ETH0\_SEARCH\_DOMAIN = “”,  
> ETH0\_VLAN\_ID = “”,  
> ETH0\_VROUTER\_IP = “”,  
> ETH0\_VROUTER\_IP6 = “”,  
> ETH0\_VROUTER\_MANAGEMENT = “”,  
> NETWORK = “YES”,  
> SSH\_PUBLIC\_KEY = “ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVpvNrmwNktc2iRzWwthSMFV3/qYVFTWayxyQhOto31R0zaZjWyZXCZBig3aiceTbLRPUmvzpX79bXVeCEolGQUGHQSj+wN6h1/r49zCAkP1FghmM99VlmvZrHgjvyQvLIVRBczuVcliv4b0WFn7e/XY9etHT+qnUQ0U5BTyD8bssAUf0cNb9qirzmW3jDqJmZlDeHPQyZuAFBcNziwN/0EesEg3pfoaM3yYWGwx5pmQL5pXkII+g21toH0lzN2uMHi5Id86joymXnUzYazUasBuqfixNyQ627Z3gRm2vnBqO640mgQcPU2oLBGIdFTmBwMsi7C9W5zjuUTfmqH2Nb oneadmin@osboxes”,  
> TARGET = “hdc” ]  
> CPU = “1”  
> DISK = [  
> ALLOW\_ORPHANS = “NO”,  
> CLONE = “YES”,  
> CLONE\_TARGET = “SYSTEM”,  
> CLUSTER\_ID = “0”,  
> DATASTORE = “default”,  
> DATASTORE\_ID = “1”,  
> DEV\_PREFIX = “vd”,  
> DISK\_ID = “0”,  
> DISK\_SNAPSHOT\_TOTAL\_SIZE = “0”,  
> DISK\_TYPE = “FILE”,  
> DRIVER = “qcow2”,  
> IMAGE = “WindowsServer2016\_HD”,  
> IMAGE\_ID = “23”,  
> IMAGE\_STATE = “2”,  
> IMAGE\_UNAME = “oneadmin”,  
> LN\_TARGET = “SYSTEM”,  
> ORDER = “1”,  
> ORIGINAL\_SIZE = “51200”,  
> READONLY = “NO”,  
> SAVE = “NO”,  
> SIZE = “51200”,  
> SOURCE = “/var/lib/one//datastores/1/7038ee0f0248ee382d9d06eeab954b70”,  
> TARGET = “vda”,  
> TM\_MAD = “ssh”,  
> TYPE = “FILE” ]  
> DISK = [  
> ALLOW\_ORPHANS = “NO”,  
> CLONE = “NO”,  
> CLONE\_TARGET = “SYSTEM”,  
> CLUSTER\_ID = “0”,  
> DATASTORE = “default”,  
> DATASTORE\_ID = “1”,  
> DEV\_PREFIX = “hd”,  
> DISK\_ID = “1”,  
> DISK\_SNAPSHOT\_TOTAL\_SIZE = “0”,  
> DISK\_TYPE = “FILE”,  
> DRIVER = “raw”,  
> IMAGE = “WinServer\_ISO”,  
> IMAGE\_ID = “18”,  
> IMAGE\_STATE = “2”,  
> IMAGE\_UNAME = “oneadmin”,  
> LN\_TARGET = “SYSTEM”,  
> ORDER = “2”,  
> ORIGINAL\_SIZE = “6673”,  
> READONLY = “YES”,  
> SAVE = “NO”,  
> SIZE = “6673”,  
> SOURCE = “/var/lib/one//datastores/1/2963c2542f6d79cb69f700441049af0e”,  
> TARGET = “hda”,  
> TM\_MAD = “ssh”,  
> TYPE = “CDROM” ]  
> DISK = [  
> ALLOW\_ORPHANS = “NO”,  
> CLONE = “NO”,  
> CLONE\_TARGET = “SYSTEM”,  
> CLUSTER\_ID = “0”,  
> DATASTORE = “default”,  
> DATASTORE\_ID = “1”,  
> DEV\_PREFIX = “hd”,  
> DISK\_ID = “2”,  
> DISK\_SNAPSHOT\_TOTAL\_SIZE = “0”,  
> DISK\_TYPE = “FILE”,  
> DRIVER = “raw”,  
> IMAGE = “Virtio Drivers”,  
> IMAGE\_ID = “19”,  
> IMAGE\_STATE = “2”,  
> IMAGE\_UNAME = “oneadmin”,  
> LN\_TARGET = “SYSTEM”,  
> ORDER = “3”,  
> ORIGINAL\_SIZE = “302”,  
> READONLY = “YES”,  
> SAVE = “NO”,  
> SIZE = “302”,  
> SOURCE = “/var/lib/one//datastores/1/b819691f3bd6d5340527754b37329ede”,  
> TARGET = “hdb”,  
> TM\_MAD = “ssh”,  
> TYPE = “CDROM” ]  
> FEATURES = [  
> ACPI = “yes”,  
> APIC = “yes”,  
> LOCALTIME = “no” ]  
> GRAPHICS = [  
> LISTEN = “0.0.0.0”,  
> PASSWD = “e7da8a0b898996b645ac5b1896cfc8723803a4f6”,  
> PORT = “5960”,  
> RANDOM\_PASSWD = “YES”,  
> TYPE = “VNC” ]  
> INPUT = [  
> BUS = “usb”,  
> TYPE = “tablet” ]  
> MEMORY = “4096”  
> NIC = [  
> AR\_ID = “0”,  
> BRIDGE = “br0”,  
> CLUSTER\_ID = “0”,  
> IP = “10.0.2.100”,  
> MAC = “02:00:0a:00:02:64”,  
> MODEL = “virtio”,  
> NETWORK = “mired”,  
> NETWORK\_ID = “0”,  
> NIC\_ID = “0”,  
> SECURITY\_GROUPS = “0”,  
> TARGET = “one-60-0”,  
> VN\_MAD = “bridge” ]  
> NIC\_DEFAULT = [  
> MODEL = “virtio” ]  
> OS = [  
> ARCH = “x86\_64”,  
> BOOT = “disk0,disk1,disk2” ]  
> SECURITY\_GROUP\_RULE = [  
> PROTOCOL = “ALL”,  
> RULE\_TYPE = “OUTBOUND”,  
> SECURITY\_GROUP\_ID = “0”,  
> SECURITY\_GROUP\_NAME = “default” ]  
> SECURITY\_GROUP\_RULE = [  
> PROTOCOL = “ALL”,  
> RULE\_TYPE = “INBOUND”,  
> SECURITY\_GROUP\_ID = “0”,  
> SECURITY\_GROUP\_NAME = “default” ]  
> TEMPLATE\_ID = “10”  
> VMID = “60”

I checked out logs, but I coudn´t find anything strange.

Can anyone give me a hand?

---

<div class="post-metadata">

**Author:** ![svega](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/svega/32/5504_2.png) [@svega](https://forum.opennebula.io/u/svega)\
**Post date:** [November 12, 2018, 11:10pm UTC](https://forum.opennebula.io/t/installing-windows-server-2016-on-opennebula-5-6-1-nested-virtualization/6634/2 "2018-11-12T23:10:34Z")

</div>

> [@amfj](#):
>
> WinServer 2016 ISO, Virtio Drivers ISO and create a new empty disk-image.  
> Then I created a new template and added stuff.  
> Finally, I instantiated a v

You should add the VM logs, they will provide more information about your issue.

---

<div class="post-metadata">

**Author:** ![VURoland](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/vuroland/32/7682_2.png) [@VURoland](https://forum.opennebula.io/u/VURoland)\
**Post date:** [November 13, 2018, 12:46am UTC](https://forum.opennebula.io/t/installing-windows-server-2016-on-opennebula-5-6-1-nested-virtualization/6634/3 "2018-11-13T00:46:57Z")

</div>

hi,

I must admin I haven’t dug thru your template to find a mistake, but I know that from \> win10 (incl. server \> 2016) - Windows will not install on the default “QEMU virtual CPU” or whatever Virtualbox has as CPU emulator setting.

Try the solutions posted in the end of this thread, hope this helps:

> [@How to create Windows VM?](https://forum.opennebula.io/t/how-to-create-windows-vm/1190/29):
>
> Same case here! Thanks marcindulak! Thanks everyone!

see this post:

> [@How to create Windows VM?](https://forum.opennebula.io/t/how-to-create-windows-vm/1190/27):
>
> In my case, this setting helped: RAW = [DATA = "\<cpu mode='host-passthrough'\>\</cpu\>", TYPE = kvm]

---

<div class="post-metadata">

**Author:** ![amfj](https://avatars.discourse-cdn.com/v4/letter/a/a183cd/32.png) [@amfj](https://forum.opennebula.io/u/amfj)\
**Post date:** [November 17, 2018, 4:44pm UTC](https://forum.opennebula.io/t/installing-windows-server-2016-on-opennebula-5-6-1-nested-virtualization/6634/4 "2018-11-17T16:44:37Z")

</div>

Sorry for the delay, but I have been overworked and trying multiple vm configurations.

Windows Server 2016 installation still does not work.

If I don’t attach nothing to my template the vm reboots unexpectedly at some point of installation, allways after language settings:

 ![Screenshot_4](https://canada1.discourse-cdn.com/flex031/uploads/opennebula/original/2X/4/498ca396d5b2493fccaa352c0ff2c5e971c3b8e5.png)

If I add to my template :

> RAW = [DATA = “\<cpu mode=‘host-passthrough’\>\</cpu\>”, TYPE = kvm]

the VM log outputs:

> Sat Nov 17 17:28:03 2018 [Z0][VM][I]: New state is ACTIVE  
> Sat Nov 17 17:28:03 2018 [Z0][VM][I]: New LCM state is BOOT\_POWEROFF  
> Sat Nov 17 17:28:03 2018 [Z0][VMM][I]: Generating deployment file: /var/lib/one/vms/70/deployment.2  
> Sat Nov 17 17:28:04 2018 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm\_context.  
> Sat Nov 17 17:28:04 2018 [Z0][VMM][I]: ExitCode: 0  
> Sat Nov 17 17:28:04 2018 [Z0][VMM][I]: Successfully execute network driver operation: pre.  
> Sat Nov 17 17:28:06 2018 [Z0][VMM][I]: Command execution fail: cat \<\< EOT | /var/tmp/one/vmm/kvm/deploy ‘/var/lib/one//datastores/0/70/deployment.2’ ‘10.0.2.15’ 70 10.0.2.15  
> Sat Nov 17 17:28:06 2018 [Z0][VMM][I]: error: Failed to create domain from /var/lib/one//datastores/0/70/deployment.2  
> Sat Nov 17 17:28:06 2018 [Z0][VMM][I]: error: unsupported configuration: CPU mode ‘host-passthrough’ is only supported with kvm  
> Sat Nov 17 17:28:06 2018 [Z0][VMM][E]: Could not create domain from /var/lib/one//datastores/0/70/deployment.2  
> Sat Nov 17 17:28:06 2018 [Z0][VMM][I]: ExitCode: 255  
> Sat Nov 17 17:28:06 2018 [Z0][VMM][I]: Failed to execute virtualization driver operation: deploy.  
> Sat Nov 17 17:28:06 2018 [Z0][VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/0/70/deployment.2  
> Sat Nov 17 17:28:06 2018 [Z0][VM][I]: New state is POWEROFF  
> Sat Nov 17 17:28:06 2018 [Z0][VM][I]: New LCM state is LCM\_INIT

One thing I have to say here is that I changed “kvm” for “qemu” in `/etc/one/oned.conf` for vms to work.

Anyway, I’ve been trying other configurations such as:

`RAW=[DATA="&lt;cpu&gt;&lt;model fallback='allow'&gt;core2duo&lt;/model&gt;&lt;/cpu&gt;", TYPE="kvm"]`

and either does not work.

I attach the outputs of the following commands just in case they were useful:

```
profe@osboxes:/var/log/one$ cat /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 142
model name : Intel(R) Core(TM) i5-8250U CPU @ 1.60GHz
stepping : 10
cpu MHz : 1800.002
cache size : 6144 KB
physical id : 0
siblings : 4
core id : 0
cpu cores : 4
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 22
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single kaiser fsgsbase avx2 invpcid rdseed clflushopt
bugs : cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf
bogomips : 3600.00
clflush size : 64
cache_alignment : 64
address sizes : 39 bits physical, 48 bits virtual
power management:

processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 142
model name : Intel(R) Core(TM) i5-8250U CPU @ 1.60GHz
stepping : 10
cpu MHz : 1800.002
cache size : 6144 KB
physical id : 0
siblings : 4
core id : 1
cpu cores : 4
apicid : 1
initial apicid : 1
fpu : yes
fpu_exception : yes
cpuid level : 22
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single kaiser fsgsbase avx2 invpcid rdseed clflushopt
bugs : cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf
bogomips : 3600.00
clflush size : 64
cache_alignment : 64
address sizes : 39 bits physical, 48 bits virtual
power management:

processor : 2
vendor_id : GenuineIntel
cpu family : 6
model : 142
model name : Intel(R) Core(TM) i5-8250U CPU @ 1.60GHz
stepping : 10
cpu MHz : 1800.002
cache size : 6144 KB
physical id : 0
siblings : 4
core id : 2
cpu cores : 4
apicid : 2
initial apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 22
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single kaiser fsgsbase avx2 invpcid rdseed clflushopt
bugs : cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf
bogomips : 3600.00
clflush size : 64
cache_alignment : 64
address sizes : 39 bits physical, 48 bits virtual
power management:

processor : 3
vendor_id : GenuineIntel
cpu family : 6
model : 142
model name : Intel(R) Core(TM) i5-8250U CPU @ 1.60GHz
stepping : 10
cpu MHz : 1800.002
cache size : 6144 KB
physical id : 0
siblings : 4
core id : 3
cpu cores : 4
apicid : 3
initial apicid : 3
fpu : yes
fpu_exception : yes
cpuid level : 22
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single kaiser fsgsbase avx2 invpcid rdseed clflushopt
bugs : cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf
bogomips : 3600.00
clflush size : 64
cache_alignment : 64
address sizes : 39 bits physical, 48 bits virtual
power management:

```

…

```
profe@osboxes:/var/log/one$ virsh capabilities
<capabilities>

  <host>
    <uuid>44011110-4f12-4143-938c-91d569e1197d</uuid>
    <cpu>
      <arch>x86_64</arch>
      <model>Westmere</model>
      <vendor>Intel</vendor>
      <topology sockets='1' cores='4' threads='1'/>
      <feature name='invtsc'/>
      <feature name='rdseed'/>
      <feature name='invpcid'/>
      <feature name='avx2'/>
      <feature name='fsgsbase'/>
      <feature name='3dnowprefetch'/>
      <feature name='abm'/>
      <feature name='rdtscp'/>
      <feature name='hypervisor'/>
      <feature name='rdrand'/>
      <feature name='avx'/>
      <feature name='osxsave'/>
      <feature name='xsave'/>
      <feature name='movbe'/>
      <feature name='x2apic'/>
      <feature name='pcid'/>
      <feature name='pclmuldq'/>
      <feature name='ht'/>
      <feature name='vme'/>
      <pages unit='KiB' size='4'/>
      <pages unit='KiB' size='2048'/>
    </cpu>
    <power_management>
      <suspend_mem/>
      <suspend_disk/>
      <suspend_hybrid/>
    </power_management>
    <migration_features>
      <live/>
      <uri_transports>
        <uri_transport>tcp</uri_transport>
        <uri_transport>rdma</uri_transport>
      </uri_transports>
    </migration_features>
    <topology>
      <cells num='1'>
        <cell id='0'>
          <memory unit='KiB'>8174820</memory>
          <pages unit='KiB' size='4'>2043705</pages>
          <pages unit='KiB' size='2048'>0</pages>
          <distances>
            <sibling id='0' value='10'/>
          </distances>
          <cpus num='4'>
            <cpu id='0' socket_id='0' core_id='0' siblings='0'/>
            <cpu id='1' socket_id='0' core_id='1' siblings='1'/>
            <cpu id='2' socket_id='0' core_id='2' siblings='2'/>
            <cpu id='3' socket_id='0' core_id='3' siblings='3'/>
          </cpus>
        </cell>
      </cells>
    </topology>
    <secmodel>
      <model>apparmor</model>
      <doi>0</doi>
    </secmodel>
    <secmodel>
      <model>dac</model>
      <doi>0</doi>
      <baselabel type='kvm'>+9869:+9869</baselabel>
      <baselabel type='qemu'>+9869:+9869</baselabel>
    </secmodel>
  </host>

  <guest>
    <os_type>hvm</os_type>
    <arch name='i686'>
      <wordsize>32</wordsize>
      <emulator>/usr/bin/qemu-system-i386</emulator>
      <machine maxCpus='255'>pc-i440fx-xenial</machine>
      <machine canonical='pc-i440fx-xenial' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='255'>pc-i440fx-2.4</machine>
      <machine maxCpus='255'>pc-1.3</machine>
      <machine maxCpus='255'>pc-0.12</machine>
      <machine maxCpus='255'>pc-q35-1.6</machine>
      <machine maxCpus='255'>pc-q35-1.5</machine>
      <machine maxCpus='1'>xenpv</machine>
      <machine maxCpus='255'>pc-i440fx-1.6</machine>
      <machine maxCpus='255'>pc-q35-2.2</machine>
      <machine maxCpus='255'>pc-i440fx-vivid</machine>
      <machine maxCpus='255'>pc-0.11</machine>
      <machine maxCpus='255'>pc-i440fx-2.3</machine>
      <machine maxCpus='255'>pc-0.10</machine>
      <machine maxCpus='255'>pc-1.2</machine>
      <machine maxCpus='255'>pc-i440fx-2.2</machine>
      <machine maxCpus='1'>isapc</machine>
      <machine maxCpus='255'>pc-i440fx-1.7</machine>
      <machine maxCpus='255'>pc-q35-xenial</machine>
      <machine maxCpus='255'>pc-q35-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-trusty</machine>
      <machine maxCpus='255'>pc-i440fx-wily</machine>
      <machine maxCpus='128'>xenfv</machine>
      <machine maxCpus='255'>pc-q35-2.5</machine>
      <machine canonical='pc-q35-2.5' maxCpus='255'>q35</machine>
      <machine maxCpus='255'>pc-0.15</machine>
      <machine maxCpus='255'>pc-i440fx-utopic</machine>
      <machine maxCpus='255'>pc-i440fx-1.5</machine>
      <machine maxCpus='255'>pc-0.14</machine>
      <machine maxCpus='255'>pc-q35-2.0</machine>
      <machine maxCpus='255'>pc-i440fx-1.4</machine>
      <machine maxCpus='255'>pc-q35-2.1</machine>
      <machine maxCpus='255'>pc-i440fx-2.5</machine>
      <machine canonical='pc-i440fx-2.5' maxCpus='255'>pc</machine>
      <machine maxCpus='255'>pc-1.1</machine>
      <machine maxCpus='255'>pc-q35-1.7</machine>
      <machine maxCpus='255'>pc-i440fx-2.1</machine>
      <machine maxCpus='255'>pc-1.0</machine>
      <machine maxCpus='255'>pc-i440fx-2.0</machine>
      <machine maxCpus='255'>pc-q35-2.4</machine>
      <machine maxCpus='255'>pc-q35-2.3</machine>
      <machine maxCpus='255'>pc-0.13</machine>
      <domain type='qemu'/>
    </arch>
    <features>
      <cpuselection/>
      <deviceboot/>
      <disksnapshot default='on' toggle='no'/>
      <acpi default='on' toggle='yes'/>
      <apic default='on' toggle='no'/>
      <pae/>
      <nonpae/>
    </features>
  </guest>

  <guest>
    <os_type>hvm</os_type>
    <arch name='x86_64'>
      <wordsize>64</wordsize>
      <emulator>/usr/bin/qemu-system-x86_64</emulator>
      <machine maxCpus='255'>pc-i440fx-xenial</machine>
      <machine canonical='pc-i440fx-xenial' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='255'>pc-i440fx-2.4</machine>
      <machine maxCpus='255'>pc-1.3</machine>
      <machine maxCpus='255'>pc-0.12</machine>
      <machine maxCpus='255'>pc-q35-1.6</machine>
      <machine maxCpus='255'>pc-q35-1.5</machine>
      <machine maxCpus='255'>pc-i440fx-1.6</machine>
      <machine maxCpus='255'>pc-q35-2.2</machine>
      <machine maxCpus='255'>pc-i440fx-1.7</machine>
      <machine maxCpus='255'>pc-i440fx-vivid</machine>
      <machine maxCpus='255'>pc-0.11</machine>
      <machine maxCpus='1'>xenpv</machine>
      <machine maxCpus='255'>pc-q35-2.1</machine>
      <machine maxCpus='255'>pc-q35-xenial</machine>
      <machine maxCpus='255'>pc-0.10</machine>
      <machine maxCpus='255'>pc-1.2</machine>
      <machine maxCpus='255'>pc-i440fx-2.2</machine>
      <machine maxCpus='1'>isapc</machine>
      <machine maxCpus='255'>pc-i440fx-2.3</machine>
      <machine maxCpus='255'>pc-i440fx-trusty</machine>
      <machine maxCpus='255'>pc-q35-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-wily</machine>
      <machine maxCpus='128'>xenfv</machine>
      <machine maxCpus='255'>pc-q35-2.5</machine>
      <machine canonical='pc-q35-2.5' maxCpus='255'>q35</machine>
      <machine maxCpus='255'>pc-0.15</machine>
      <machine maxCpus='255'>pc-i440fx-utopic</machine>
      <machine maxCpus='255'>pc-i440fx-1.5</machine>
      <machine maxCpus='255'>pc-q35-2.0</machine>
      <machine maxCpus='255'>pc-i440fx-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.5</machine>
      <machine canonical='pc-i440fx-2.5' maxCpus='255'>pc</machine>
      <machine maxCpus='255'>pc-0.14</machine>
      <machine maxCpus='255'>pc-1.1</machine>
      <machine maxCpus='255'>pc-i440fx-2.1</machine>
      <machine maxCpus='255'>pc-q35-1.7</machine>
      <machine maxCpus='255'>pc-1.0</machine>
      <machine maxCpus='255'>pc-i440fx-2.0</machine>
      <machine maxCpus='255'>pc-q35-2.4</machine>
      <machine maxCpus='255'>pc-q35-2.3</machine>
      <machine maxCpus='255'>pc-0.13</machine>
      <domain type='qemu'/>
    </arch>
    <features>
      <cpuselection/>
      <deviceboot/>
      <disksnapshot default='on' toggle='no'/>
      <acpi default='on' toggle='yes'/>
      <apic default='on' toggle='no'/>
    </features>
  </guest>

</capabilities>

```

…

```
profe@osboxes:/var/log/libvirt/qemu$ nano one-70.log
2018-11-16 14:09:17.344+0000: starting up libvirt version: 1.3.1, package: 1ubuntu10.24 (Marc Deslauriers <marc.deslauriers@ubuntu.com> Wed, 23 May 2018 13:29:29 -0400), qemu version: 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.32), hostname: osboxes
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin QEMU_AUDIO_DRV=none /usr/bin/qemu-system-x86_64 -name one-70 -S -machine pc-i440fx-xenial,accel=tcg,usb=off -m 4096 -realtime mlock=off -smp 1,sockets=1,cores=1,threads=1 -uuid 29ce6c12-c91e-4961-8adf-fe301a8f9d0e -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-one-70/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/one//datastores/0/70/disk.0,format=qcow2,if=none,id=drive-virtio-disk0,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/var/lib/one//datastores/0/70/disk.1,format=raw,if=none,id=drive-ide0-0-0,readonly=on,cache=none -device ide-cd,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=2 -drive file=/var/lib/one//datastores/0/70/disk.2,format=raw,if=none,id=drive-ide0-0-1,readonly=on,cache=none -device ide-cd,bus=ide.0,unit=1,drive=drive-ide0-0-1,id=ide0-0-1,bootindex=3 -drive file=/var/lib/one//datastores/0/70/disk.3,format=raw,if=none,id=drive-ide0-1-0,readonly=on -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev tap,fd=26,id=hostnet0 -device rtl8139,netdev=hostnet0,id=net0,mac=02:00:0a:00:02:66,bus=pci.0,addr=0x3 -device usb-tablet,id=input0 -vnc 0.0.0.0:70,password -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5 -msg timestamp=on
warning: TCG doesn't support requested feature: CPUID.01H:ECX.vmx [bit 5]
main-loop: WARNING: I/O thread spun for 1000 iterations
2018-11-16T15:13:07.938683Z qemu-system-x86_64: terminating on signal 15 from pid 1207
2018-11-16 15:13:09.346+0000: shutting down
2018-11-17 16:21:36.583+0000: starting up libvirt version: 1.3.1, package: 1ubuntu10.24 (Marc Deslauriers <marc.deslauriers@ubuntu.com> Wed, 23 May 2018 13:29:29 -0400), qemu version: 2.5.0 (Debian 1:2.5+dfsg-5ubuntu10.32), hostname: osboxes
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin QEMU_AUDIO_DRV=none /usr/bin/qemu-system-x86_64 -name one-70 -S -machine pc-i440fx-xenial,accel=tcg,usb=off -m 4096 -realtime mlock=off -smp 1,sockets=1,cores=1,threads=1 -uuid 7e6a95a5-016c-44ad-b316-2c519cd85a9d -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-one-70/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/one//datastores/0/70/disk.0,format=qcow2,if=none,id=drive-virtio-disk0,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/var/lib/one//datastores/0/70/disk.1,format=raw,if=none,id=drive-ide0-0-0,readonly=on,cache=none -device ide-cd,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=2 -drive file=/var/lib/one//datastores/0/70/disk.2,format=raw,if=none,id=drive-ide0-0-1,readonly=on,cache=none -device ide-cd,bus=ide.0,unit=1,drive=drive-ide0-0-1,id=ide0-0-1,bootindex=3 -drive file=/var/lib/one//datastores/0/70/disk.3,format=raw,if=none,id=drive-ide0-1-0,readonly=on -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev tap,fd=26,id=hostnet0 -device rtl8139,netdev=hostnet0,id=net0,mac=02:00:0a:00:02:66,bus=pci.0,addr=0x3 -device usb-tablet,id=input0 -vnc 0.0.0.0:70,password -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5 -msg timestamp=on
warning: TCG doesn't support requested feature: CPUID.01H:ECX.vmx [bit 5]
main-loop: WARNING: I/O thread spun for 1000 iterations
2018-11-17T16:25:53.944482Z qemu-system-x86_64: terminating on signal 15 from pid 1255
2018-11-17 16:25:54.146+0000: shutting down
2018-11-17 16:28:05.750+0000: shutting down

```

---

<div class="post-metadata">

**Author:** ![VURoland](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/vuroland/32/7682_2.png) [@VURoland](https://forum.opennebula.io/u/VURoland)\
**Post date:** [November 20, 2018, 10:44am UTC](https://forum.opennebula.io/t/installing-windows-server-2016-on-opennebula-5-6-1-nested-virtualization/6634/5 "2018-11-20T10:44:38Z")

</div>

hi,

I guess that your virtualbox doesnt support a feature qemu wants to use. all threads with similar error messages indicate that using a newer version solved this, but that probably doesnt help you…

> [@amfj](#):
>
> warning: TCG doesn’t support requested feature: CPUID.01H:ECX.vmx [bit 5]

maybe this page [Hosts/Linux - QEMU](https://wiki.qemu.org/Hosts/Linux) helps, it mentions extra packages and a simple qemu test to debug your hypervisor?

See chapters:

- [1.1.1.1 Required additional packages](https://wiki.qemu.org/Hosts/Linux#Required_additional_packages)
- [1.1.1.2 Recommended additional packages](https://wiki.qemu.org/Hosts/Linux#Recommended_additional_packages)

---

<div class="post-metadata">

**Author:** ![amfj](https://avatars.discourse-cdn.com/v4/letter/a/a183cd/32.png) [@amfj](https://forum.opennebula.io/u/amfj)\
**Post date:** [November 21, 2018, 5:43pm UTC](https://forum.opennebula.io/t/installing-windows-server-2016-on-opennebula-5-6-1-nested-virtualization/6634/6 "2018-11-21T17:43:09Z")

</div>

I installed all additional packages as you suggested, but althoug the installation process continued it stopped later with a `"Trusted Installer"` message. I never dealt with Qemu before, so I will have to give a deeper insight .

Until now, the only solution I found was `install Windows Server 2016 on` a hypervisor that allows full nested virtualization, such as `VMWare` (Windows) or `KVM` (Linux). I enable VTx flag on the Virtual Machine and I can install it successfully. I don´t even need Virtio Drivers, only an empty disk-image and Windows Server 2016 ISO.

Although VirtualBox have a VT-x option available in the VM’s Processor tab, I think it does not really support nested virtualization because it does not pass VT-x to the VM.

As I found in this post [https://www.virtualbox.org/ticket/4032](https://www.virtualbox.org/ticket/4032) Nested AMD-V is functional but Nested VT-x is still work-in-progress, so I believe this feature will come out soon.

Regards.