Secondary disk being removed

Community Support
1

Versions of the related components and OS (frontend, hypervisors, VMs):
OpenNebula 5.8.5
CentOS 7.5
ESXi/vCenter 6.5
vSAN datastore
CentOS 8 VM (may have issues with all OSes)

Steps to reproduce:

  1. Create and boot a Linux (maybe Windows too) Instance
  2. Create a blank disk image:
  • Generic storage datablock
  • Empty disk image
  1. Attach new image to running Instance
  2. “Power off” Instance in GUI
  3. Power on Instance in GUI
  4. Instance fails to boot due to a missing secondary drive

This shows up in /var/log/one/oned.log:
Deploy of VM 922 on vCenter cluster vcs-mgf-01 with /var/lib/one/vms/922/deployment.13 failed due to "FileNotFound: File []/vmfs/volumes/vsan:520701adba19118a-fc884a3deaefa728/one/238/one-238-922-2.vmdk was not found"on the final attempt.

After testing it seems like everything is OK until I power the VM back on. vCenter shows OpenNebula re-configuring the VM and then vmdk disappears from the datastore and the VM’s .vmx file.

In addition, when attaching the disk, it looks like OpenNebula is attaching the disk as drive 0 and bumping the boot drive to 1. Not a big deal if it’s attached while the instance is running, but if I attach the disk to a shut down instance, it tries booting off the new/blank drive.

This is from the ESXi host:
[root@esx-mgf-e1b01:~] grep scsi0.*.fileName /vmfs/volumes/vsanDatastore/922_test-dpc-01/922_test-dpc-01.vmx
scsi0:1.fileName = “922_test-dpc-01.vmdk”
scsi0:0.fileName = “/vmfs/volumes/vsan:520701adba19118a-fc884a3deaefa728/7893455e-f102-b6dd-5a59-ecebb880ba70/238/one-238-922-2.vmdk”

2

Upgraded to OpenNebula 5.10.1 and verified that the problem exists in 5.10.1. I really hope I’m doing something wrong and it’s not a bigger issue.

3

Here’s a sample deployment file that i believe is causing the problem:

<VM><ID>915</ID><UID>2</UID><GID>0</GID><UNAME>admcarlo</UNAME><GNAME>oneadmin</GNAME><NAME>tools-dm-02</NAME><PERMISSIONS><OWNER_U>1</OWNER_U><OWNER_M>1</OWNER_M><OWNER_A>0</OWNER_A><GROUP_U>0</GROUP_U><GROUP_M>0</GROUP_M><GROUP_A>0</GROUP_A><OTHER_U>0</OTHER_U><OTHER_M>0</OTHER_M><OTHER_A>0</OTHER_A></PERMISSIONS><LAST_POLL>0</LAST_POLL><STATE>3</STATE><LCM_STATE>20</LCM_STATE><PREV_STATE>3</PREV_STATE><PREV_LCM_STATE>20</PREV_LCM_STATE><RESCHED>0</RESCHED><STIME>1584542091</STIME><ETIME>0</ETIME><DEPLOY_ID>vm-12474</DEPLOY_ID><MONITORING><CPU><![CDATA[0.0]]></CPU><DISKRDBYTES><![CDATA[2457600]]></DISKRDBYTES><DISKRDIOPS><![CDATA[6]]></DISKRDIOPS><DISKWRBYTES><![CDATA[1310720]]></DISKWRBYTES><DISKWRIOPS><![CDATA[0]]></DISKWRIOPS><GUEST_IP_ADDRESSES><![CDATA[10.109.71.89,10.109.71.90,10.109.71.91,10.109.71.92,fe80::aff:fe6d:4759]]></GUEST_IP_ADDRESSES><MEMORY><![CDATA[0]]></MEMORY><NETRX><![CDATA[20480]]></NETRX><NETTX><![CDATA[0]]></NETTX><STATE><![CDATA[a]]></STATE><VCENTER_ESX_HOST><![CDATA[esx-mgf-e1b01]]></VCENTER_ESX_HOST><VCENTER_GUEST_STATE><![CDATA[running]]></VCENTER_GUEST_STATE><VCENTER_RP_NAME><![CDATA[OpenNebula/DM]]></VCENTER_RP_NAME><VCENTER_VMWARETOOLS_RUNNING_STATUS><![CDATA[guestToolsRunning]]></VCENTER_VMWARETOOLS_RUNNING_STATUS><VCENTER_VMWARETOOLS_VERSION><![CDATA[10346]]></VCENTER_VMWARETOOLS_VERSION><VCENTER_VMWARETOOLS_VERSION_STATUS><![CDATA[guestToolsUnmanaged]]></VCENTER_VMWARETOOLS_VERSION_STATUS></MONITORING><TEMPLATE><AUTOMATIC_DS_REQUIREMENTS><![CDATA[("CLUSTERS/ID" @> 105)]]></AUTOMATIC_DS_REQUIREMENTS><AUTOMATIC_NIC_REQUIREMENTS><![CDATA[("CLUSTERS/ID" @> 105)]]></AUTOMATIC_NIC_REQUIREMENTS><AUTOMATIC_REQUIREMENTS><![CDATA[(CLUSTER_ID = 105) & !(PUBLIC_CLOUD = YES)]]></AUTOMATIC_REQUIREMENTS><CONTEXT><CLOUD_ORG><![CDATA[DM]]></CLOUD_ORG><DISK_ID><![CDATA[1]]></DISK_ID><ETH0_ALIAS0_CONTEXT_FORCE_IPV4><![CDATA[]]></ETH0_ALIAS0_CONTEXT_FORCE_IPV4><ETH0_ALIAS0_DNS><![CDATA[10.109.71.50 10.120.85.50 10.120.85.51]]></ETH0_ALIAS0_DNS><ETH0_ALIAS0_EXTERNAL><![CDATA[]]></ETH0_ALIAS0_EXTERNAL><ETH0_ALIAS0_GATEWAY><![CDATA[10.109.71.1]]></ETH0_ALIAS0_GATEWAY><ETH0_ALIAS0_GATEWAY6><![CDATA[]]></ETH0_ALIAS0_GATEWAY6><ETH0_ALIAS0_IP><![CDATA[10.109.71.90]]></ETH0_ALIAS0_IP><ETH0_ALIAS0_IP6><![CDATA[]]></ETH0_ALIAS0_IP6><ETH0_ALIAS0_IP6_PREFIX_LENGTH><![CDATA[]]></ETH0_ALIAS0_IP6_PREFIX_LENGTH><ETH0_ALIAS0_IP6_ULA><![CDATA[]]></ETH0_ALIAS0_IP6_ULA><ETH0_ALIAS0_MAC><![CDATA[02:00:0a:6d:47:5a]]></ETH0_ALIAS0_MAC><ETH0_ALIAS0_MASK><![CDATA[255.255.255.0]]></ETH0_ALIAS0_MASK><ETH0_ALIAS0_MTU><![CDATA[]]></ETH0_ALIAS0_MTU><ETH0_ALIAS0_NETWORK><![CDATA[]]></ETH0_ALIAS0_NETWORK><ETH0_ALIAS0_SEARCH_DOMAIN><![CDATA[cec.local]]></ETH0_ALIAS0_SEARCH_DOMAIN><ETH0_ALIAS0_VLAN_ID><![CDATA[]]></ETH0_ALIAS0_VLAN_ID><ETH0_ALIAS0_VROUTER_IP><![CDATA[]]></ETH0_ALIAS0_VROUTER_IP><ETH0_ALIAS0_VROUTER_IP6><![CDATA[]]></ETH0_ALIAS0_VROUTER_IP6><ETH0_ALIAS0_VROUTER_MANAGEMENT><![CDATA[]]></ETH0_ALIAS0_VROUTER_MANAGEMENT><ETH0_ALIAS1_CONTEXT_FORCE_IPV4><![CDATA[]]></ETH0_ALIAS1_CONTEXT_FORCE_IPV4><ETH0_ALIAS1_DNS><![CDATA[10.109.71.50 10.120.85.50 10.120.85.51]]></ETH0_ALIAS1_DNS><ETH0_ALIAS1_EXTERNAL><![CDATA[]]></ETH0_ALIAS1_EXTERNAL><ETH0_ALIAS1_GATEWAY><![CDATA[10.109.71.1]]></ETH0_ALIAS1_GATEWAY><ETH0_ALIAS1_GATEWAY6><![CDATA[]]></ETH0_ALIAS1_GATEWAY6><ETH0_ALIAS1_IP><![CDATA[10.109.71.91]]></ETH0_ALIAS1_IP><ETH0_ALIAS1_IP6><![CDATA[]]></ETH0_ALIAS1_IP6><ETH0_ALIAS1_IP6_PREFIX_LENGTH><![CDATA[]]></ETH0_ALIAS1_IP6_PREFIX_LENGTH><ETH0_ALIAS1_IP6_ULA><![CDATA[]]></ETH0_ALIAS1_IP6_ULA><ETH0_ALIAS1_MAC><![CDATA[02:00:0a:6d:47:5b]]></ETH0_ALIAS1_MAC><ETH0_ALIAS1_MASK><![CDATA[255.255.255.0]]></ETH0_ALIAS1_MASK><ETH0_ALIAS1_MTU><![CDATA[]]></ETH0_ALIAS1_MTU><ETH0_ALIAS1_NETWORK><![CDATA[]]></ETH0_ALIAS1_NETWORK><ETH0_ALIAS1_SEARCH_DOMAIN><![CDATA[cec.local]]></ETH0_ALIAS1_SEARCH_DOMAIN><ETH0_ALIAS1_VLAN_ID><![CDATA[]]></ETH0_ALIAS1_VLAN_ID><ETH0_ALIAS1_VROUTER_IP><![CDATA[]]></ETH0_ALIAS1_VROUTER_IP><ETH0_ALIAS1_VROUTER_IP6><![CDATA[]]></ETH0_ALIAS1_VROUTER_IP6><ETH0_ALIAS1_VROUTER_MANAGEMENT><![CDATA[]]></ETH0_ALIAS1_VROUTER_MANAGEMENT><ETH0_ALIAS2_CONTEXT_FORCE_IPV4><![CDATA[]]></ETH0_ALIAS2_CONTEXT_FORCE_IPV4><ETH0_ALIAS2_DNS><![CDATA[10.109.71.50 10.120.85.50 10.120.85.51]]></ETH0_ALIAS2_DNS><ETH0_ALIAS2_EXTERNAL><![CDATA[]]></ETH0_ALIAS2_EXTERNAL><ETH0_ALIAS2_GATEWAY><![CDATA[10.109.71.1]]></ETH0_ALIAS2_GATEWAY><ETH0_ALIAS2_GATEWAY6><![CDATA[]]></ETH0_ALIAS2_GATEWAY6><ETH0_ALIAS2_IP><![CDATA[10.109.71.92]]></ETH0_ALIAS2_IP><ETH0_ALIAS2_IP6><![CDATA[]]></ETH0_ALIAS2_IP6><ETH0_ALIAS2_IP6_PREFIX_LENGTH><![CDATA[]]></ETH0_ALIAS2_IP6_PREFIX_LENGTH><ETH0_ALIAS2_IP6_ULA><![CDATA[]]></ETH0_ALIAS2_IP6_ULA><ETH0_ALIAS2_MAC><![CDATA[02:00:0a:6d:47:5c]]></ETH0_ALIAS2_MAC><ETH0_ALIAS2_MASK><![CDATA[255.255.255.0]]></ETH0_ALIAS2_MASK><ETH0_ALIAS2_MTU><![CDATA[]]></ETH0_ALIAS2_MTU><ETH0_ALIAS2_NETWORK><![CDATA[]]></ETH0_ALIAS2_NETWORK><ETH0_ALIAS2_SEARCH_DOMAIN><![CDATA[cec.local]]></ETH0_ALIAS2_SEARCH_DOMAIN><ETH0_ALIAS2_VLAN_ID><![CDATA[]]></ETH0_ALIAS2_VLAN_ID><ETH0_ALIAS2_VROUTER_IP><![CDATA[]]></ETH0_ALIAS2_VROUTER_IP><ETH0_ALIAS2_VROUTER_IP6><![CDATA[]]></ETH0_ALIAS2_VROUTER_IP6><ETH0_ALIAS2_VROUTER_MANAGEMENT><![CDATA[]]></ETH0_ALIAS2_VROUTER_MANAGEMENT><ETH0_CONTEXT_FORCE_IPV4><![CDATA[]]></ETH0_CONTEXT_FORCE_IPV4><ETH0_DNS><![CDATA[10.109.71.50 10.120.85.50 10.120.85.51]]></ETH0_DNS><ETH0_EXTERNAL><![CDATA[]]></ETH0_EXTERNAL><ETH0_GATEWAY><![CDATA[10.109.71.1]]></ETH0_GATEWAY><ETH0_GATEWAY6><![CDATA[]]></ETH0_GATEWAY6><ETH0_IP><![CDATA[10.109.71.89]]></ETH0_IP><ETH0_IP6><![CDATA[]]></ETH0_IP6><ETH0_IP6_PREFIX_LENGTH><![CDATA[]]></ETH0_IP6_PREFIX_LENGTH><ETH0_IP6_ULA><![CDATA[]]></ETH0_IP6_ULA><ETH0_MAC><![CDATA[02:00:0a:6d:47:59]]></ETH0_MAC><ETH0_MASK><![CDATA[255.255.255.0]]></ETH0_MASK><ETH0_MTU><![CDATA[]]></ETH0_MTU><ETH0_NETWORK><![CDATA[]]></ETH0_NETWORK><ETH0_SEARCH_DOMAIN><![CDATA[cec.local]]></ETH0_SEARCH_DOMAIN><ETH0_VLAN_ID><![CDATA[]]></ETH0_VLAN_ID><ETH0_VROUTER_IP><![CDATA[]]></ETH0_VROUTER_IP><ETH0_VROUTER_IP6><![CDATA[]]></ETH0_VROUTER_IP6><ETH0_VROUTER_MANAGEMENT><![CDATA[]]></ETH0_VROUTER_MANAGEMENT><NETWORK><![CDATA[YES]]></NETWORK><SET_HOSTNAME><![CDATA[tools-dm-02.cec.local]]></SET_HOSTNAME><START_SCRIPT_BASE64><![CDATA[SANATIZED]]></START_SCRIPT_BASE64><TARGET><![CDATA[hda]]></TARGET></CONTEXT><CPU><![CDATA[1]]></CPU><DISK><ALLOW_ORPHANS><![CDATA[NO]]></ALLOW_ORPHANS><CLONE><![CDATA[YES]]></CLONE><CLONE_TARGET><![CDATA[SYSTEM]]></CLONE_TARGET><CLUSTER_ID><![CDATA[105]]></CLUSTER_ID><DATASTORE><![CDATA[vsanDatastore [vcs-mgf-01 - Fairfax] (IMG)]]></DATASTORE><DATASTORE_ID><![CDATA[127]]></DATASTORE_ID><DEV_PREFIX><![CDATA[sd]]></DEV_PREFIX><DISK_ID><![CDATA[0]]></DISK_ID><DISK_SNAPSHOT_TOTAL_SIZE><![CDATA[0]]></DISK_SNAPSHOT_TOTAL_SIZE><DISK_TYPE><![CDATA[FILE]]></DISK_TYPE><IMAGE><![CDATA[RHEL8_Template_20190828]]></IMAGE><IMAGE_ID><![CDATA[233]]></IMAGE_ID><IMAGE_STATE><![CDATA[2]]></IMAGE_STATE><LN_TARGET><![CDATA[NONE]]></LN_TARGET><OPENNEBULA_MANAGED><![CDATA[NO]]></OPENNEBULA_MANAGED><ORIGINAL_SIZE><![CDATA[35840]]></ORIGINAL_SIZE><READONLY><![CDATA[NO]]></READONLY><SAVE><![CDATA[NO]]></SAVE><SIZE><![CDATA[35840]]></SIZE><SOURCE><![CDATA[3d2f725e-5fa4-932c-73f6-ecebb880ba70/RHEL8_Template_20190828.vmdk]]></SOURCE><TARGET><![CDATA[sda]]></TARGET><TM_MAD><![CDATA[vcenter]]></TM_MAD><TYPE><![CDATA[FILE]]></TYPE><VCENTER_DS_REF><![CDATA[datastore-1161]]></VCENTER_DS_REF><VCENTER_INSTANCE_ID><![CDATA[caaed0d0-f52e-40ee-a5da-9a54676c5078]]></VCENTER_INSTANCE_ID></DISK><DISK><ALLOW_ORPHANS><![CDATA[NO]]></ALLOW_ORPHANS><CLONE><![CDATA[YES]]></CLONE><CLONE_TARGET><![CDATA[SYSTEM]]></CLONE_TARGET><CLUSTER_ID><![CDATA[105]]></CLUSTER_ID><DATASTORE><![CDATA[vsanDatastore [vcs-mgf-01 - Fairfax] (IMG)]]></DATASTORE><DATASTORE_ID><![CDATA[127]]></DATASTORE_ID><DEV_PREFIX><![CDATA[sd]]></DEV_PREFIX><DISK_ID><![CDATA[2]]></DISK_ID><DISK_SNAPSHOT_TOTAL_SIZE><![CDATA[0]]></DISK_SNAPSHOT_TOTAL_SIZE><DISK_TYPE><![CDATA[FILE]]></DISK_TYPE><DRIVER><![CDATA[raw]]></DRIVER><IMAGE><![CDATA[Blank_Disk_FFX]]></IMAGE><IMAGE_ID><![CDATA[240]]></IMAGE_ID><IMAGE_STATE><![CDATA[2]]></IMAGE_STATE><IMAGE_UNAME><![CDATA[admcarlo]]></IMAGE_UNAME><LN_TARGET><![CDATA[NONE]]></LN_TARGET><ORIGINAL_SIZE><![CDATA[10240]]></ORIGINAL_SIZE><READONLY><![CDATA[NO]]></READONLY><SAVE><![CDATA[NO]]></SAVE><SIZE><![CDATA[10240]]></SIZE><SOURCE><![CDATA[one/240/one-240.vmdk]]></SOURCE><TARGET><![CDATA[sdb]]></TARGET><TM_MAD><![CDATA[vcenter]]></TM_MAD><TM_MAD_SYSTEM><![CDATA[vcenter]]></TM_MAD_SYSTEM><TYPE><![CDATA[FILE]]></TYPE><VCENTER_DISK_TYPE><![CDATA[thin]]></VCENTER_DISK_TYPE><VCENTER_DS_REF><![CDATA[datastore-1161]]></VCENTER_DS_REF><VCENTER_INSTANCE_ID><![CDATA[caaed0d0-f52e-40ee-a5da-9a54676c5078]]></VCENTER_INSTANCE_ID></DISK><GRAPHICS><LISTEN><![CDATA[0.0.0.0]]></LISTEN><PORT><![CDATA[6815]]></PORT><TYPE><![CDATA[VNC]]></TYPE></GRAPHICS><MEMORY><![CDATA[4096]]></MEMORY><NIC><ALIAS_IDS><![CDATA[1,2,3]]></ALIAS_IDS><AR_ID><![CDATA[0]]></AR_ID><BRIDGE><![CDATA[Production]]></BRIDGE><BRIDGE_TYPE><![CDATA[linux]]></BRIDGE_TYPE><CLUSTER_ID><![CDATA[105]]></CLUSTER_ID><IP><![CDATA[10.109.71.89]]></IP><MAC><![CDATA[02:00:0a:6d:47:59]]></MAC><NAME><![CDATA[NIC0]]></NAME><NETWORK><![CDATA[FFX_ProductionDevelopment[10.109.71.0_24]]]></NETWORK><NETWORK_ID><![CDATA[34]]></NETWORK_ID><NIC_ID><![CDATA[0]]></NIC_ID><OPENNEBULA_MANAGED><![CDATA[NO]]></OPENNEBULA_MANAGED><SECURITY_GROUPS><![CDATA[0]]></SECURITY_GROUPS><TARGET><![CDATA[one-915-0]]></TARGET><VCENTER_CCR_REF><![CDATA[domain-c837]]></VCENTER_CCR_REF><VCENTER_INSTANCE_ID><![CDATA[caaed0d0-f52e-40ee-a5da-9a54676c5078]]></VCENTER_INSTANCE_ID><VCENTER_NET_REF><![CDATA[dvportgroup-847]]></VCENTER_NET_REF><VCENTER_PORTGROUP_TYPE><![CDATA[Distributed Port Group]]></VCENTER_PORTGROUP_TYPE><VN_MAD><![CDATA[dummy]]></VN_MAD></NIC><NIC_ALIAS><ALIAS_ID><![CDATA[0]]></ALIAS_ID><AR_ID><![CDATA[0]]></AR_ID><BRIDGE><![CDATA[Production]]></BRIDGE><BRIDGE_TYPE><![CDATA[linux]]></BRIDGE_TYPE><CLUSTER_ID><![CDATA[105]]></CLUSTER_ID><IP><![CDATA[10.109.71.90]]></IP><MAC><![CDATA[02:00:0a:6d:47:5a]]></MAC><NAME><![CDATA[NIC0_ALIAS1]]></NAME><NETWORK><![CDATA[FFX_ProductionDevelopment[10.109.71.0_24]]]></NETWORK><NETWORK_ID><![CDATA[34]]></NETWORK_ID><NETWORK_UNAME><![CDATA[admcarlo]]></NETWORK_UNAME><NIC_ID><![CDATA[1]]></NIC_ID><PARENT><![CDATA[NIC0]]></PARENT><PARENT_ID><![CDATA[0]]></PARENT_ID><SECURITY_GROUPS><![CDATA[0]]></SECURITY_GROUPS><TARGET><![CDATA[one-915-1]]></TARGET><VCENTER_CCR_REF><![CDATA[domain-c837]]></VCENTER_CCR_REF><VCENTER_INSTANCE_ID><![CDATA[caaed0d0-f52e-40ee-a5da-9a54676c5078]]></VCENTER_INSTANCE_ID><VCENTER_NET_REF><![CDATA[dvportgroup-847]]></VCENTER_NET_REF><VCENTER_PORTGROUP_TYPE><![CDATA[Distributed Port Group]]></VCENTER_PORTGROUP_TYPE><VN_MAD><![CDATA[dummy]]></VN_MAD></NIC_ALIAS><NIC_ALIAS><ALIAS_ID><![CDATA[1]]></ALIAS_ID><AR_ID><![CDATA[0]]></AR_ID><BRIDGE><![CDATA[Production]]></BRIDGE><BRIDGE_TYPE><![CDATA[linux]]></BRIDGE_TYPE><CLUSTER_ID><![CDATA[105]]></CLUSTER_ID><IP><![CDATA[10.109.71.91]]></IP><MAC><![CDATA[02:00:0a:6d:47:5b]]></MAC><NAME><![CDATA[NIC0_ALIAS2]]></NAME><NETWORK><![CDATA[FFX_ProductionDevelopment[10.109.71.0_24]]]></NETWORK><NETWORK_ID><![CDATA[34]]></NETWORK_ID><NETWORK_UNAME><![CDATA[admcarlo]]></NETWORK_UNAME><NIC_ID><![CDATA[2]]></NIC_ID><PARENT><![CDATA[NIC0]]></PARENT><PARENT_ID><![CDATA[0]]></PARENT_ID><SECURITY_GROUPS><![CDATA[0]]></SECURITY_GROUPS><TARGET><![CDATA[one-915-2]]></TARGET><VCENTER_CCR_REF><![CDATA[domain-c837]]></VCENTER_CCR_REF><VCENTER_INSTANCE_ID><![CDATA[caaed0d0-f52e-40ee-a5da-9a54676c5078]]></VCENTER_INSTANCE_ID><VCENTER_NET_REF><![CDATA[dvportgroup-847]]></VCENTER_NET_REF><VCENTER_PORTGROUP_TYPE><![CDATA[Distributed Port Group]]></VCENTER_PORTGROUP_TYPE><VN_MAD><![CDATA[dummy]]></VN_MAD></NIC_ALIAS><NIC_ALIAS><ALIAS_ID><![CDATA[2]]></ALIAS_ID><AR_ID><![CDATA[0]]></AR_ID><BRIDGE><![CDATA[Production]]></BRIDGE><BRIDGE_TYPE><![CDATA[linux]]></BRIDGE_TYPE><CLUSTER_ID><![CDATA[105]]></CLUSTER_ID><IP><![CDATA[10.109.71.92]]></IP><MAC><![CDATA[02:00:0a:6d:47:5c]]></MAC><NAME><![CDATA[NIC0_ALIAS3]]></NAME><NETWORK><![CDATA[FFX_ProductionDevelopment[10.109.71.0_24]]]></NETWORK><NETWORK_ID><![CDATA[34]]></NETWORK_ID><NETWORK_UNAME><![CDATA[admcarlo]]></NETWORK_UNAME><NIC_ID><![CDATA[3]]></NIC_ID><PARENT><![CDATA[NIC0]]></PARENT><PARENT_ID><![CDATA[0]]></PARENT_ID><SECURITY_GROUPS><![CDATA[0]]></SECURITY_GROUPS><TARGET><![CDATA[one-915-3]]></TARGET><VCENTER_CCR_REF><![CDATA[domain-c837]]></VCENTER_CCR_REF><VCENTER_INSTANCE_ID><![CDATA[caaed0d0-f52e-40ee-a5da-9a54676c5078]]></VCENTER_INSTANCE_ID><VCENTER_NET_REF><![CDATA[dvportgroup-847]]></VCENTER_NET_REF><VCENTER_PORTGROUP_TYPE><![CDATA[Distributed Port Group]]></VCENTER_PORTGROUP_TYPE><VN_MAD><![CDATA[dummy]]></VN_MAD></NIC_ALIAS><OS><BOOT><![CDATA[]]></BOOT></OS><SECURITY_GROUP_RULE><PROTOCOL><![CDATA[ALL]]></PROTOCOL><RULE_TYPE><![CDATA[OUTBOUND]]></RULE_TYPE><SECURITY_GROUP_ID><![CDATA[0]]></SECURITY_GROUP_ID><SECURITY_GROUP_NAME><![CDATA[default]]></SECURITY_GROUP_NAME></SECURITY_GROUP_RULE><SECURITY_GROUP_RULE><PROTOCOL><![CDATA[ALL]]></PROTOCOL><RULE_TYPE><![CDATA[INBOUND]]></RULE_TYPE><SECURITY_GROUP_ID><![CDATA[0]]></SECURITY_GROUP_ID><SECURITY_GROUP_NAME><![CDATA[default]]></SECURITY_GROUP_NAME></SECURITY_GROUP_RULE><TEMPLATE_ID><![CDATA[102]]></TEMPLATE_ID><TM_MAD_SYSTEM><![CDATA[vcenter]]></TM_MAD_SYSTEM><VCPU><![CDATA[4]]></VCPU><VMID><![CDATA[915]]></VMID></TEMPLATE><USER_TEMPLATE><DESCRIPTION><![CDATA[vCenter Template imported by OpenNebula from Cluster FFX_Production]]></DESCRIPTION><HYPERVISOR><![CDATA[vcenter]]></HYPERVISOR><INPUTS_ORDER><![CDATA[]]></INPUTS_ORDER><LOGO><![CDATA[images/logos/redhat.png]]></LOGO><MEMORY_UNIT_COST><![CDATA[MB]]></MEMORY_UNIT_COST><SUNSTONE><NETWORK_SELECT><![CDATA[NO]]></NETWORK_SELECT></SUNSTONE><VCENTER_CCR_REF><![CDATA[domain-c837]]></VCENTER_CCR_REF><VCENTER_INSTANCE_ID><![CDATA[caaed0d0-f52e-40ee-a5da-9a54676c5078]]></VCENTER_INSTANCE_ID><VCENTER_RESOURCE_POOL><![CDATA[OpenNebula/DM]]></VCENTER_RESOURCE_POOL><VCENTER_TEMPLATE_REF><![CDATA[vm-12472]]></VCENTER_TEMPLATE_REF><VCENTER_VM_FOLDER><![CDATA[/OpenNebula/DM]]></VCENTER_VM_FOLDER></USER_TEMPLATE><HISTORY_RECORDS><HISTORY><OID>915</OID><SEQ>19</SEQ><HOSTNAME>vcs-mgf-01</HOSTNAME><HID>5</HID><CID>105</CID><STIME>1585234510</STIME><ETIME>0</ETIME><VM_MAD><![CDATA[vcenter]]></VM_MAD><TM_MAD><![CDATA[vcenter]]></TM_MAD><DS_ID>128</DS_ID><PSTIME>0</PSTIME><PETIME>0</PETIME><RSTIME>1585234510</RSTIME><RETIME>0</RETIME><ESTIME>0</ESTIME><EETIME>0</EETIME><ACTION>11</ACTION><UID>2</UID><GID>0</GID><REQUEST_ID>2480</REQUEST_ID></HISTORY></HISTORY_RECORDS></VM>

4

Ok, more troubleshooting for someone smarter than I am on OpenNebula. Some instances seem to work OK and some fail. The difference seems to be how the instance orders the hard drives in vCenter. If you look at the VM’s .vmx file on the VMware datastore, VMs with a boot drive of “scsi0:1” fail and VMs with a boot drive of “scsi0:0” work fine.

When OpenNebula adds a disk to a VM with boot drive of “scsi0:1” it adds as “scsi0:0”. Then when ON deploys the VM later, it deletes “scsi0:0”. Anyboody know the scsi ordering logic?

Example of a problem VM:

[root@esx-mgf-e1b01:~] grep scsi0 /vmfs/volumes/vsanDatastore/915_tools-dm-02/915_tools-dm-02.vmx
scsi0.virtualDev = “pvscsi”
scsi0.present = “TRUE”
scsi0:1.deviceType = “scsi-hardDisk”
scsi0:1.fileName = “915_tools-dm-02.vmdk”
sched.scsi0:1.shares = “normal”
sched.scsi0:1.throughputCap = “off”
scsi0:1.present = “TRUE”
scsi0.pciSlotNumber = “160”
scsi0:1.redo = “”
scsi0.sasWWID = “50 05 05 61 08 e9 eb 10”

5

It seems to be the same error as issue:

This should be solved from 5.10.2