Not able to attach a disk to VM (CEPH)

rouxdo · November 11, 2017, 2:30pm

We’re running OpenNebula with a CEPH datastore. Currently we’re trying to attach new disks (raw format) but everytime we we get an qemu error:

Sat Nov 11 15:24:40 2017 [Z0][VM][I]: New LCM state is HOTPLUG
Sat Nov 11 15:24:41 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_attach.
Sat Nov 11 15:24:41 2017 [Z0][VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/attach_disk 'one-21404' '/var/lib/one//datastores/100/21404/disk.2' 'vdb' '1' 'PFZNTV9EUklWRVJfQUNUSU9OX0RBVEE+PEhPU1Q+c2VydmVyMzwvSE9TVD48TUlHUl9IT1NULz48REVQTE9ZX0lEPm9uZS0yMTQwNDwvREVQTE9ZX0lEPjxMT0NBTF9ERVBMT1lNRU5UX0ZJTEUvPjxSRU1PVEVfREVQTE9ZTUVOVF9GSUxFLz48Q0hFQ0tQT0lOVF9GSUxFLz48VE1fQ09NTUFORD48IVtDREFUQVtNS0lNQUdFIGNlcGggMTAyNCByYXcgc2VydmVyMzovdmFyL2xpYi9vbmUvL2RhdGFzdG9yZXMvMTAwLzIxNDA0L2Rpc2suMiAyMTQwNCAxMDAKXV0+PC9UTV9DT01NQU5EPjxUTV9DT01NQU5EX1JPTExCQUNLPjwhW0NEQVRBW0RFTEVURSBjZXBoIHNlcnZlcjM6L3Zhci9saWIvb25lLy9kYXRhc3RvcmVzLzEwMC8yMTQwNC9kaXNrLjIgMjE0MDQgMTAwCl1dPjwvVE1fQ09NTUFORF9ST0xMQkFDSz48RElTS19UQVJHRVRfUEFUSD4vdmFyL2xpYi9vbmUvL2RhdGFzdG9yZXMvMTAwLzIxNDA0L2Rpc2suMjwvRElTS19UQVJHRVRfUEFUSD48Vk0+PElEPjIxNDA0PC9JRD48VUlEPjIzPC9VSUQ+PEdJRD4wPC9HSUQ+PFVOQU1FPmRvbWluaXF1ZS5yb3V4QHVuZ2xlaWNoLmNoPC9VTkFNRT48R05BTUU+b25lYWRtaW48L0dOQU1FPjxOQU1FPmRvbWluaXF1ZS10ZXN0czwvTkFNRT48UEVSTUlTU0lPTlM+PE9XTkVSX1U+MTwvT1dORVJfVT48T1dORVJfTT4xPC9PV05FUl9NPjxPV05FUl9BPjA8L09XTkVSX0E+PEdST1VQX1U+MDwvR1JPVVBfVT48R1JPVVBfTT4wPC9HUk9VUF9NPjxHUk9VUF9BPjA8L0dST1VQX0E+PE9USEVSX1U+MDwvT1RIRVJfVT48T1RIRVJfTT4wPC9PVEhFUl9NPjxPVEhFUl9BPjA8L09USEVSX0E+PC9QRVJNSVNTSU9OUz48TEFTVF9QT0xMPjE1MTA0MTAyNDQ8L0xBU1RfUE9MTD48U1RBVEU+MzwvU1RBVEU+PExDTV9TVEFURT4xNzwvTENNX1NUQVRFPjxQUkVWX1NUQVRFPjM8L1BSRVZfU1RBVEU+PFBSRVZfTENNX1NUQVRFPjE3PC9QUkVWX0xDTV9TVEFURT48UkVTQ0hFRD4wPC9SRVNDSEVEPjxTVElNRT4xNTEwNDA4MzA4PC9TVElNRT48RVRJTUU+MDwvRVRJTUU+PERFUExPWV9JRD5vbmUtMjE0MDQ8L0RFUExPWV9JRD48TU9OSVRPUklORz48Q1BVPjwhW0NEQVRBWzAuMF1dPjwvQ1BVPjxESVNLX1NJWkU+PElEPjwhW0NEQVRBWzFdXT48L0lEPjxTSVpFPjwhW0NEQVRBWzFdXT48L1NJWkU+PC9ESVNLX1NJWkU+PE1FTU9SWT48IVtDREFUQVsyMDk3MTUyXV0+PC9NRU1PUlk+PE5FVFJYPjwhW0NEQVRBWzIwMjkwNjVdXT48L05FVFJYPjxORVRUWD48IVtDREFUQVs0NDc0NV1dPjwvTkVUVFg+PFNUQVRFPjwhW0NEQVRBW2FdXT48L1NUQVRFPjwvTU9OSVRPUklORz48VEVNUExBVEU+PEFVVE9NQVRJQ19EU19SRVFVSVJFTUVOVFM+PCFbQ0RBVEFbIkNMVVNURVJTL0lEIiBAPiAwXV0+PC9BVVRPTUFUSUNfRFNfUkVRVUlSRU1FTlRTPjxBVVRPTUFUSUNfUkVRVUlSRU1FTlRTPjwhW0NEQVRBWyhDTFVTVEVSX0lEID0gMCkgJiAhKFBVQkxJQ19DTE9VRCA9IFlFUyldXT48L0FVVE9NQVRJQ19SRVFVSVJFTUVOVFM+PENPTlRFWFQ+PERJU0tfSUQ+PCFbQ0RBVEFbMV1dPjwvRElTS19JRD48RVRIMF9DT05URVhUX0ZPUkNFX0lQVjQ+PCFbQ0RBVEFbXV0+PC9FVEgwX0NPTlRFWFRfRk9SQ0VfSVBWND48RVRIMF9ETlM+PCFbQ0RBVEFbMmEwYTplNWMwOjA6Mjo6MV1dPjwvRVRIMF9ETlM+PEVUSDBfR0FURVdBWT48IVtDREFUQVtdXT48L0VUSDBfR0FURVdBWT48RVRIMF9HQVRFV0FZNj48IVtDREFUQVsyYTBhOmU1YzA6MDoyOjoxXV0+PC9FVEgwX0dBVEVXQVk2PjxFVEgwX0lQPjwhW0NEQVRBW11dPjwvRVRIMF9JUD48RVRIMF9JUDY+PCFbQ0RBVEFbMmEwYTplNWMwOjA6Mjo0MDA6YjNmZjpmZTM5Ojc5NjddXT48L0VUSDBfSVA2PjxFVEgwX0lQNl9QUkVGSVhfTEVOR1RIPjwhW0NEQVRBW11dPjwvRVRIMF9JUDZfUFJFRklYX0xFTkdUSD48RVRIMF9JUDZfVUxBPjwhW0NEQVRBW11dPjwvRVRIMF9JUDZfVUxBPjxFVEgwX01BQz48IVtDREFUQVswMjowMDpiMzozOTo3OTo2N11dPjwvRVRIMF9NQUM+PEVUSDBfTUFTSz48IVtDREFUQVtdXT48L0VUSDBfTUFTSz48RVRIMF9NVFU+PCFbQ0RBVEFbOTIwMF1dPjwvRVRIMF9NVFU+PEVUSDBfTkVUV09SSz48IVtDREFUQVtdXT48L0VUSDBfTkVUV09SSz48RVRIMF9TRUFSQ0hfRE9NQUlOPjwhW0NEQVRBW11dPjwvRVRIMF9TRUFSQ0hfRE9NQUlOPjxFVEgwX1ZMQU5fSUQ+PCFbQ0RBVEFbXV0+PC9FVEgwX1ZMQU5fSUQ+PEVUSDBfVlJPVVRFUl9JUD48IVtDREFUQVtdXT48L0VUSDBfVlJPVVRFUl9JUD48RVRIMF9WUk9VVEVSX0lQNj48IVtDREFUQVtdXT48L0VUSDBfVlJPVVRFUl9JUDY+PEVUSDBfVlJPVVRFUl9NQU5BR0VNRU5UPjwhW0NEQVRBW11dPjwvRVRIMF9WUk9VVEVSX01BTkFHRU1FTlQ+PEVUSDFfQ09OVEVYVF9GT1JDRV9JUFY0PjwhW0NEQVRBW11dPjwvRVRIMV9DT05URVhUX0ZPUkNFX0lQVjQ+PEVUSDFfRE5TPjwhW0NEQVRBWzE4NS4yMDMuMTEyLjFdXT48L0VUSDFfRE5TPjxFVEgxX0dBVEVXQVk+PCFbQ0RBVEFbMTg1LjIwMy4xMTIuMV1dPjwvRVRIMV9HQVRFV0FZPjxFVEgxX0dBVEVXQVk2PjwhW0NEQVRBW11dPjwvRVRIMV9HQVRFV0FZNj48RVRIMV9JUD48IVtDREFUQVsxODUuMjAzLjExMi4zN11dPjwvRVRIMV9JUD48RVRIMV9JUDY+PCFbQ0RBVEFbXV0+PC9FVEgxX0lQNj48RVRIMV9JUDZfUFJFRklYX0xFTkdUSD48IVtDREFUQVtdXT48L0VUSDFfSVA2X1BSRUZJWF9MRU5HVEg+PEVUSDFfSVA2X1VMQT48IVtDREFUQVtdXT48L0VUSDFfSVA2X1VMQT48RVRIMV9NQUM+PCFbQ0RBVEFbMDI6MDA6Yjk6Y2I6NzA6MjVdXT48L0VUSDFfTUFDPjxFVEgxX01BU0s+PCFbQ0RBVEFbMjU1LjI1NS4yNTUuMF1dPjwvRVRIMV9NQVNLPjxFVEgxX01UVT48IVtDREFUQVs5MjAwXV0+PC9FVEgxX01UVT48RVRIMV9ORVRXT1JLPjwhW0NEQVRBWzE4NS4yMDMuMTEyLjBdXT48L0VUSDFfTkVUV09SSz48RVRIMV9TRUFSQ0hfRE9NQUlOPjwhW0NEQVRBW11dPjwvRVRIMV9TRUFSQ0hfRE9NQUlOPjxFVEgxX1ZMQU5fSUQ+PCFbQ0RBVEFbXV0+PC9FVEgxX1ZMQU5fSUQ+PEVUSDFfVlJPVVRFUl9JUD48IVtDREFUQVtdXT48L0VUSDFfVlJPVVRFUl9JUD48RVRIMV9WUk9VVEVSX0lQNj48IVtDREFUQVtdXT48L0VUSDFfVlJPVVRFUl9JUDY+PEVUSDFfVlJPVVRFUl9NQU5BR0VNRU5UPjwhW0NEQVRBW11dPjwvRVRIMV9WUk9VVEVSX01BTkFHRU1FTlQ+PE5FVFdPUks+PCFbQ0RBVEFbWUVTXV0+PC9ORVRXT1JLPjxTU0hfUFVCTElDX0tFWT48IVtDREFUQVtzc2gtcnNhIEFBQUFCM056YUMxeWMyRUFBQUFEQVFBQkFBQUJBUUNvK2c3MXpaNFNjeHFqRDZFZEk5eWZzQXhJTnlvUmZrRWJ4clB6bUJTK0pMZ1J0Rk82c3owSCtkeVFkdEExY0ppSzZPRi85dGs0S3dYLytPTmU2MDFWckJINHV2KytPOHl5OVZieEJobkl1YVNQOFU2UzdGVURxNnVwYkNGbkI5U2pBWWhkU0dzWFZnY3U3cTYyTWJBQnV0U1lzRVpPT1d6YVpnWHpIV2F5by96U1l6MDExSVNVZjdaYnBobEpzclhwR3VwRGdDbWFicFljdjBIa2xab0JPSXZ4SDN1a2RuWjh2QzJLNHV3MTdQRHhlbGMrbzJqYy9ETlpTVmc0RDRzZDREeXpwSks1V0FsNFloWXIxbWNaRzB5NHZZYTFyZW94cFkyK1d4QWo2dUFrUHVMUXZqS3l3RVJ4eUZjbFJIWTFDZElwSHo1THdvYmN0RDdvSHVJYiByb3V4ZG9Acm91eC1hcmNoXV0+PC9TU0hfUFVCTElDX0tFWT48VEFSR0VUPjwhW0NEQVRBW2hkYV1dPjwvVEFSR0VUPjwvQ09OVEVYVD48Q1BVPjwhW0NEQVRBWzAuMV1dPjwvQ1BVPjxESVNLPjxDRVBIX0hPU1Q+PCFbQ0RBVEFbc2VydmVyMSBzZXJ2ZXIzIHNlcnZlcjVdXT48L0NFUEhfSE9TVD48Q0VQSF9TRUNSRVQ+PCFbQ0RBVEFbY2MyNWNmOGYtZmZmMi00M2JkLWI0YzQtZjM3OWUwMDRhMGNiXV0+PC9DRVBIX1NFQ1JFVD48Q0VQSF9VU0VSPjwhW0NEQVRBW2xpYnZpcnRdXT48L0NFUEhfVVNFUj48Q0xPTkU+PCFbQ0RBVEFbWUVTXV0+PC9DTE9ORT48Q0xPTkVfVEFSR0VUPjwhW0NEQVRBW1NFTEZdXT48L0NMT05FX1RBUkdFVD48Q0xVU1RFUl9JRD48IVtDREFUQVswXV0+PC9DTFVTVEVSX0lEPjxEQVRBU1RPUkU+PCFbQ0RBVEFbY2VwaF9oZGRfZHNdXT48L0RBVEFTVE9SRT48REFUQVNUT1JFX0lEPjwhW0NEQVRBWzEwM11dPjwvREFUQVNUT1JFX0lEPjxERVZfUFJFRklYPjwhW0NEQVRBW3ZkXV0+PC9ERVZfUFJFRklYPjxESVNLX0lEPjwhW0NEQVRBWzBdXT48L0RJU0tfSUQ+PERJU0tfU05BUFNIT1RfVE9UQUxfU0laRT48IVtDREFUQVswXV0+PC9ESVNLX1NOQVBTSE9UX1RPVEFMX1NJWkU+PERJU0tfVFlQRT48IVtDREFUQVtSQkRdXT48L0RJU0tfVFlQRT48RFJJVkVSPjwhW0NEQVRBW3Jhd11dPjwvRFJJVkVSPjxJTUFHRT48IVtDREFUQVtEZWJpYW45LWhkZF1dPjwvSU1BR0U+PElNQUdFX0lEPjwhW0NEQVRBWzExNl1dPjwvSU1BR0VfSUQ+PElNQUdFX1NUQVRFPjwhW0NEQVRBWzJdXT48L0lNQUdFX1NUQVRFPjxJTUFHRV9VTkFNRT48IVtDREFUQVtuaWNvLnNjaG90dGVsaXVzQHVuZ2xlaWNoLmNoXV0+PC9JTUFHRV9VTkFNRT48TE5fVEFSR0VUPjwhW0NEQVRBW05PTkVdXT48L0xOX1RBUkdFVD48T1JJR0lOQUxfU0laRT48IVtDREFUQVsyMDQ4XV0+PC9PUklHSU5BTF9TSVpFPjxQT09MX05BTUU+PCFbQ0RBVEFbb25lLWhkZF1dPjwvUE9PTF9OQU1FPjxSRUFET05MWT48IVtDREFUQVtOT11dPjwvUkVBRE9OTFk+PFNBVkU+PCFbQ0RBVEFbTk9dXT48L1NBVkU+PFNJWkU+PCFbQ0RBVEFbMjA0OF1dPjwvU0laRT48U09VUkNFPjwhW0NEQVRBW29uZS1oZGQvb25lLTExNl1dPjwvU09VUkNFPjxUQVJHRVQ+PCFbQ0RBVEFbdmRhXV0+PC9UQVJHRVQ+PFRNX01BRD48IVtDREFUQVtjZXBoXV0+PC9UTV9NQUQ+PFRZUEU+PCFbQ0RBVEFbUkJEXV0+PC9UWVBFPjwvRElTSz48RElTSz48QVRUQUNIPjwhW0NEQVRBW1lFU11dPjwvQVRUQUNIPjxDRVBIX0hPU1Q+PCFbQ0RBVEFbc2VydmVyMSBzZXJ2ZXIzIHNlcnZlcjVdXT48L0NFUEhfSE9TVD48Q0VQSF9TRUNSRVQ+PCFbQ0RBVEFbY2MyNWNmOGYtZmZmMi00M2JkLWI0YzQtZjM3OWUwMDRhMGNiXV0+PC9DRVBIX1NFQ1JFVD48Q0VQSF9VU0VSPjwhW0NEQVRBW2xpYnZpcnRdXT48L0NFUEhfVVNFUj48Q0xVU1RFUl9JRD48IVtDREFUQVswXV0+PC9DTFVTVEVSX0lEPjxEQVRBU1RPUkU+PCFbQ0RBVEFbY2VwaF9zeXN0ZW1dXT48L0RBVEFTVE9SRT48REFUQVNUT1JFX0lEPjwhW0NEQVRBWzEwMF1dPjwvREFUQVNUT1JFX0lEPjxERVZfUFJFRklYPjwhW0NEQVRBW3ZkXV0+PC9ERVZfUFJFRklYPjxESVNLX0lEPjwhW0NEQVRBWzJdXT48L0RJU0tfSUQ+PERJU0tfVFlQRT48IVtDREFUQVtGSUxFXV0+PC9ESVNLX1RZUEU+PEZPUk1BVD48IVtDREFUQVtyYXddXT48L0ZPUk1BVD48UE9PTF9OQU1FPjwhW0NEQVRBW29uZV1dPjwvUE9PTF9OQU1FPjxTSVpFPjwhW0NEQVRBWzEwMjRdXT48L1NJWkU+PFRBUkdFVD48IVtDREFUQVt2ZGJdXT48L1RBUkdFVD48VE1fTUFEPjwhW0NEQVRBW2NlcGhdXT48L1RNX01BRD48VFlQRT48IVtDREFUQVtmc11dPjwvVFlQRT48L0RJU0s+PEdSQVBISUNTPjxMSVNURU4+PCFbQ0RBVEFbOjpdXT48L0xJU1RFTj48UE9SVD48IVtDREFUQVsxMDAxMl1dPjwvUE9SVD48VFlQRT48IVtDREFUQVtWTkNdXT48L1RZUEU+PC9HUkFQSElDUz48TUVNT1JZPjwhW0NEQVRBWzIwNDhdXT48L01FTU9SWT48TklDPjxBUl9JRD48IVtDREFUQVswXV0+PC9BUl9JRD48QlJJREdFPjwhW0NEQVRBW2JyLXZtXV0+PC9CUklER0U+PENMVVNURVJfSUQ+PCFbQ0RBVEFbMF1dPjwvQ0xVU1RFUl9JRD48SVA2X0dMT0JBTD48IVtDREFUQVsyYTBhOmU1YzA6MDoyOjQwMDpiM2ZmOmZlMzk6Nzk2N11dPjwvSVA2X0dMT0JBTD48SVA2X0xJTks+PCFbQ0RBVEFbZmU4MDo6NDAwOmIzZmY6ZmUzOTo3OTY3XV0+PC9JUDZfTElOSz48TUFDPjwhW0NEQVRBWzAyOjAwOmIzOjM5Ojc5OjY3XV0+PC9NQUM+PE1PREVMPjwhW0NEQVRBW3ZpcnRpb11dPjwvTU9ERUw+PE1UVT48IVtDREFUQVs5MjAwXV0+PC9NVFU+PE5FVFdPUks+PCFbQ0RBVEFbcHVibGljLWlwdjZdXT48L05FVFdPUks+PE5FVFdPUktfSUQ+PCFbQ0RBVEFbNl1dPjwvTkVUV09SS19JRD48TkVUV09SS19VTkFNRT48IVtDREFUQVtvbmVhZG1pbl1dPjwvTkVUV09SS19VTkFNRT48TklDX0lEPjwhW0NEQVRBWzBdXT48L05JQ19JRD48U0VDVVJJVFlfR1JPVVBTPjwhW0NEQVRBWzBdXT48L1NFQ1VSSVRZX0dST1VQUz48VEFSR0VUPjwhW0NEQVRBW29uZS0yMTQwNC0wXV0+PC9UQVJHRVQ+PFZOX01BRD48IVtDREFUQVtkdW1teV1dPjwvVk5fTUFEPjwvTklDPjxOSUM+PEFSX0lEPjwhW0NEQVRBWzBdXT48L0FSX0lEPjxCUklER0U+PCFbQ0RBVEFbYnItdm1dXT48L0JSSURHRT48Q0xVU1RFUl9JRD48IVtDREFUQVswXV0+PC9DTFVTVEVSX0lEPjxJUD48IVtDREFUQVsxODUuMjAzLjExMi4zN11dPjwvSVA+PE1BQz48IVtDREFUQVswMjowMDpiOTpjYjo3MDoyNV1dPjwvTUFDPjxNT0RFTD48IVtDREFUQVt2aXJ0aW9dXT48L01PREVMPjxNVFU+PCFbQ0RBVEFbOTIwMF1dPjwvTVRVPjxORVRXT1JLPjwhW0NEQVRBW3B1YmxpYy1pcHY0XV0+PC9ORVRXT1JLPjxORVRXT1JLX0lEPjwhW0NEQVRBWzExXV0+PC9ORVRXT1JLX0lEPjxORVRXT1JLX1VOQU1FPjwhW0NEQVRBW29uZWFkbWluXV0+PC9ORVRXT1JLX1VOQU1FPjxOSUNfSUQ+PCFbQ0RBVEFbMV1dPjwvTklDX0lEPjxTRUNVUklUWV9HUk9VUFM+PCFbQ0RBVEFbMF1dPjwvU0VDVVJJVFlfR1JPVVBTPjxUQVJHRVQ+PCFbQ0RBVEFbb25lLTIxNDA0LTFdXT48L1RBUkdFVD48Vk5fTUFEPjwhW0NEQVRBW2R1bW15XV0+PC9WTl9NQUQ+PC9OSUM+PE5JQ19ERUZBVUxUPjxNT0RFTD48IVtDREFUQVt2aXJ0aW9dXT48L01PREVMPjwvTklDX0RFRkFVTFQ+PE9TPjxBUkNIPjwhW0NEQVRBW3g4Nl82NF1dPjwvQVJDSD48Qk9PVD48IVtDREFUQVtdXT48L0JPT1Q+PC9PUz48U0VDVVJJVFlfR1JPVVBfUlVMRT48UFJPVE9DT0w+PCFbQ0RBVEFbQUxMXV0+PC9QUk9UT0NPTD48UlVMRV9UWVBFPjwhW0NEQVRBW09VVEJPVU5EXV0+PC9SVUxFX1RZUEU+PFNFQ1VSSVRZX0dST1VQX0lEPjwhW0NEQVRBWzBdXT48L1NFQ1VSSVRZX0dST1VQX0lEPjxTRUNVUklUWV9HUk9VUF9OQU1FPjwhW0NEQVRBW2RlZmF1bHRdXT48L1NFQ1VSSVRZX0dST1VQX05BTUU+PC9TRUNVUklUWV9HUk9VUF9SVUxFPjxTRUNVUklUWV9HUk9VUF9SVUxFPjxQUk9UT0NPTD48IVtDREFUQVtBTExdXT48L1BST1RPQ09MPjxSVUxFX1RZUEU+PCFbQ0RBVEFbSU5CT1VORF1dPjwvUlVMRV9UWVBFPjxTRUNVUklUWV9HUk9VUF9JRD48IVtDREFUQVswXV0+PC9TRUNVUklUWV9HUk9VUF9JRD48U0VDVVJJVFlfR1JPVVBfTkFNRT48IVtDREFUQVtkZWZhdWx0XV0+PC9TRUNVUklUWV9HUk9VUF9OQU1FPjwvU0VDVVJJVFlfR1JPVVBfUlVMRT48VEVNUExBVEVfSUQ+PCFbQ0RBVEFbNDZdXT48L1RFTVBMQVRFX0lEPjxWQ1BVPjwhW0NEQVRBWzNdXT48L1ZDUFU+PFZNSUQ+PCFbQ0RBVEFbMjE0MDRdXT48L1ZNSUQ+PC9URU1QTEFURT48VVNFUl9URU1QTEFURT48RVJST1I+PCFbQ0RBVEFbU2F0IE5vdiAxMSAxNToxNzoxMiAyMDE3IDogRXJyb3IgYXR0YWNoaW5nIG5ldyBWTSBEaXNrOiBDb3VsZCBub3QgYXR0YWNoIHJiZCAodmRiKSB0byBvbmUtMjE0MDRdXT48L0VSUk9SPjxJTlBVVFNfT1JERVI+PCFbQ0RBVEFbXV0+PC9JTlBVVFNfT1JERVI+PExPR08+PCFbQ0RBVEFbaW1hZ2VzL2xvZ29zL2RlYmlhbi5wbmddXT48L0xPR08+PE1FTU9SWV9VTklUX0NPU1Q+PCFbQ0RBVEFbTUJdXT48L01FTU9SWV9VTklUX0NPU1Q+PFNVTlNUT05FPjxORVRXT1JLX1NFTEVDVD48IVtDREFUQVtOT11dPjwvTkVUV09SS19TRUxFQ1Q+PC9TVU5TVE9ORT48L1VTRVJfVEVNUExBVEU+PEhJU1RPUllfUkVDT1JEUz48SElTVE9SWT48T0lEPjIxNDA0PC9PSUQ+PFNFUT4xMDwvU0VRPjxIT1NUTkFNRT5zZXJ2ZXIzPC9IT1NUTkFNRT48SElEPjE1PC9ISUQ+PENJRD4wPC9DSUQ+PFNUSU1FPjE1MTA0MTAyODA8L1NUSU1FPjxFVElNRT4wPC9FVElNRT48Vk1fTUFEPjwhW0NEQVRBW2t2bV1dPjwvVk1fTUFEPjxUTV9NQUQ+PCFbQ0RBVEFbY2VwaF1dPjwvVE1fTUFEPjxEU19JRD4xMDA8L0RTX0lEPjxQU1RJTUU+MDwvUFNUSU1FPjxQRVRJTUU+MDwvUEVUSU1FPjxSU1RJTUU+MTUxMDQxMDI4MDwvUlNUSU1FPjxSRVRJTUU+MDwvUkVUSU1FPjxFU1RJTUU+MDwvRVNUSU1FPjxFRVRJTUU+MDwvRUVUSU1FPjxBQ1RJT04+MDwvQUNUSU9OPjxVSUQ+LTE8L1VJRD48R0lEPi0xPC9HSUQ+PFJFUVVFU1RfSUQ+LTE8L1JFUVVFU1RfSUQ+PC9ISVNUT1JZPjwvSElTVE9SWV9SRUNPUkRTPjwvVk0+PERBVEFTVE9SRT48SUQ+MTAwPC9JRD48VUlEPjA8L1VJRD48R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+Y2VwaF9zeXN0ZW08L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjE8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+PE9USEVSX00+MDwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PERTX01BRD48IVtDREFUQVstXV0+PC9EU19NQUQ+PFRNX01BRD48IVtDREFUQVtjZXBoXV0+PC9UTV9NQUQ+PEJBU0VfUEFUSD48IVtDREFUQVsvdmFyL2xpYi9vbmUvL2RhdGFzdG9yZXMvMTAwXV0+PC9CQVNFX1BBVEg+PFRZUEU+MTwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48U1RBVEU+MDwvU1RBVEU+PENMVVNURVJTPjxJRD4wPC9JRD48L0NMVVNURVJTPjxUT1RBTF9NQj4zMzkzNzk3PC9UT1RBTF9NQj48RlJFRV9NQj4xMzQyNDQzPC9GUkVFX01CPjxVU0VEX01CPjIwNTEzNTM8L1VTRURfTUI+PElNQUdFUz48L0lNQUdFUz48VEVNUExBVEU+PEJSSURHRV9MSVNUPjwhW0NEQVRBW3NlcnZlcjEgc2VydmVyMiBzZXJ2ZXIzIHNlcnZlcjQgc2VydmVyNV1dPjwvQlJJREdFX0xJU1Q+PENFUEhfSE9TVD48IVtDREFUQVtzZXJ2ZXIxIHNlcnZlcjMgc2VydmVyNV1dPjwvQ0VQSF9IT1NUPjxDRVBIX1NFQ1JFVD48IVtDREFUQVtjYzI1Y2Y4Zi1mZmYyLTQzYmQtYjRjNC1mMzc5ZTAwNGEwY2JdXT48L0NFUEhfU0VDUkVUPjxDRVBIX1VTRVI+PCFbQ0RBVEFbbGlidmlydF1dPjwvQ0VQSF9VU0VSPjxEU19NSUdSQVRFPjwhW0NEQVRBW05PXV0+PC9EU19NSUdSQVRFPjxOQU1FPjwhW0NEQVRBW2NlcGhfc3lzdGVtXV0+PC9OQU1FPjxQT09MX05BTUU+PCFbQ0RBVEFbb25lXV0+PC9QT09MX05BTUU+PFNIQVJFRD48IVtDREFUQVtZRVNdXT48L1NIQVJFRD48VE1fTUFEPjwhW0NEQVRBW2NlcGhdXT48L1RNX01BRD48VFlQRT48IVtDREFUQVtTWVNURU1fRFNdXT48L1RZUEU+PC9URU1QTEFURT48L0RBVEFTVE9SRT48L1ZNTV9EUklWRVJfQUNUSU9OX0RBVEE+' 21404 server3
Sat Nov 11 15:24:41 2017 [Z0][VMM][E]: attach_disk: Command "virsh --connect qemu:///system attach-device one-21404 /var/lib/one//datastores/100/21404/disk.2.attach" failed: error: Failed to attach device from /var/lib/one//datastores/100/21404/disk.2.attach
Sat Nov 11 15:24:41 2017 [Z0][VMM][I]: error: Cannot access storage file '/var/lib/one//datastores/100/21404/disk.2' (as uid:1001, gid:1001): No such file or directory
Sat Nov 11 15:24:41 2017 [Z0][VMM][E]: Could not attach /var/lib/one//datastores/100/21404/disk.2 (vdb) to one-21404
Sat Nov 11 15:24:41 2017 [Z0][VMM][I]: ExitCode: 1
Sat Nov 11 15:24:42 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_detach.
Sat Nov 11 15:24:42 2017 [Z0][VMM][I]: Failed to execute virtualization driver operation: attach_disk.
Sat Nov 11 15:24:42 2017 [Z0][VMM][E]: Error attaching new VM Disk: Could not attach /var/lib/one//datastores/100/21404/disk.2 (vdb) to one-21404
Sat Nov 11 15:24:42 2017 [Z0][VM][I]: New LCM state is RUNNING

Informations:

OpenNebula Version: 5.4.1
libvirt 1.2.9
Datastore 100 is a CEPH datastore
Images are in raw format

Thanks a lot for your help!

Kind regards

Dominique

UAnton · November 11, 2017, 5:08pm

Hello,
If you mean attach Volatile disk - change DISK_TYPE in datastore attributes. You need change FILE to RBD.

P.S. Thanks @heathen for help!

marcindulak · November 11, 2017, 7:07pm

Can you link to the post where @heathen provided the help?

UAnton · November 11, 2017, 7:08pm

I wrote the solution to the problem.

marcindulak · November 11, 2017, 7:10pm

I understand from your post that @heathen has discussed this particular problem already somewhere.

UAnton · November 11, 2017, 7:18pm

It does not matter. It was a private discussion. Stop flooding

heathen · November 11, 2017, 7:44pm

Hi, @marcindulak!

We have a private messages discussion: Anton has asked me about the same problem and I advised him to change DISK_TYPE property of the ceph system datastore from FILE to RBD. In this case it’s possible to have volatile disks on the rbd ceph pool.

BR

rouxdo · November 13, 2017, 10:04am

Hi @UAnton!

Thanks for your help.

The image datastore is already DISK_TYPE RBD
Do I have to set this attribute also in the system datastore?

UAnton · November 13, 2017, 10:37am

Hello,
Yes, you need chenge this attribute in the system datastore.

rouxdo · November 13, 2017, 12:50pm

hmm… @UAnton I still get the same error…

All used datastores now uses DISK_TYPE RBD

heathen · November 13, 2017, 7:51pm

Hi, Dominique!

Please, list all of your datastores with onedatastore list and then fire onedatastore show <ID> with each datastore ID you have and then paste here the output. You may want to remove host\secret information.

BR,
Vladimir

rouxdo · November 13, 2017, 9:05pm

onedatastore list:

 ID NAME                SIZE AVAIL CLUSTERS     IMAGES TYPE DS      TM      STAT
   0 system                 - -     0                 0 sys  -       ssh     off
   2 files              18.2G 26%   0                 0 fil  fs      ssh     on  
 100 ceph_system         5.8T 66%   0                 0 sys  -       ceph    on  
 101 cephds              5.8T 66%   0                40 img  ceph    ceph    on  
 103 ceph_hdd_ds        12.7T 99%   0                 6 img  ceph    ceph    on

onedatastore show 100

DATASTORE 100 INFORMATION                                                       
ID             : 100                 
NAME           : ceph_system         
USER           : USER            
GROUP          : GROUP            
CLUSTERS       : 0                   
TYPE           : SYSTEM              
DS_MAD         : -                   
TM_MAD         : ceph                
BASE PATH      : /var/lib/one//datastores/100
DISK_TYPE      : RBD                 
STATE          : READY               

DATASTORE CAPACITY                                                              
TOTAL:         : 5.8T                
FREE:          : 3.8T                
USED:          : 2T                  
LIMIT:         : -                   

PERMISSIONS                                                                     
OWNER          : um-                 
GROUP          : u--                 
OTHER          : ---                 

DATASTORE TEMPLATE                                                              
ALLOW_ORPHANS="NO"
BRIDGE_LIST="SERVERS"
CEPH_HOST="SERVERS"
CEPH_SECRET="SECRET"
CEPH_USER="libvirt"
DISK_TYPE="RBD"
DS_MIGRATE="NO"
NAME="ceph_system"
POOL_NAME="one"
SHARED="YES"
TM_MAD="ceph"
TYPE="SYSTEM_DS"

onedatastore show 101:

DATASTORE 101 INFORMATION                                                       
ID             : 101                 
NAME           : cephds              
USER           : USER            
GROUP          : GROUP
CLUSTERS       : 0                   
TYPE           : IMAGE               
DS_MAD         : ceph                
TM_MAD         : ceph                
BASE PATH      : /var/lib/one//datastores/101
DISK_TYPE      : RBD                 
STATE          : READY               

DATASTORE CAPACITY                                                              
TOTAL:         : 3.2T                
FREE:          : 1.3T                
USED:          : 2T                  
LIMIT:         : -                   

PERMISSIONS                                                                     
OWNER          : um-                 
GROUP          : u--                 
OTHER          : ---                 

DATASTORE TEMPLATE                                                              
BRIDGE_LIST="SERVERS"
CEPH_HOST="SERVERS"
CEPH_SECRET="SECRET"
CEPH_USER="libvirt"
CLONE_TARGET="SELF"
DISK_TYPE="RBD"
DRIVER="raw"
DS_MAD="ceph"
LN_TARGET="NONE"
NAME="cephds"
POOL_NAME="one"
STAGING_DIR="/var/tmp/one-staging/"
TM_MAD="ceph"
TYPE="IMAGE_DS"

onedatastore show 103

DATASTORE 103 INFORMATION                                                       
ID             : 103                 
NAME           : ceph_hdd_ds         
USER           : USER            
GROUP          : GROUP            
CLUSTERS       : 0                   
TYPE           : IMAGE               
DS_MAD         : ceph                
TM_MAD         : ceph                
BASE PATH      : /var/lib/one//datastores/103
DISK_TYPE      : RBD                 
STATE          : READY               

DATASTORE CAPACITY                                                              
TOTAL:         : 4.3T                
FREE:          : 4.2T                
USED:          : 110.4G              
LIMIT:         : -                   

PERMISSIONS                                                                     
OWNER          : um-                 
GROUP          : u--                 
OTHER          : ---                 

DATASTORE TEMPLATE                                                              
ALLOW_ORPHANS="NO"
BRIDGE_LIST="SERVERS"
CEPH_HOST="SERVERS"
CEPH_SECRET="SECRET"
CEPH_USER="libvirt"
CLONE_TARGET="SELF"
DISK_TYPE="RBD"
DRIVER="raw"
DS_MAD="ceph"
LN_TARGET="NONE"
POOL_NAME="one-hdd"
STAGGING_DIR="/var/tmp/one-staging"
TM_MAD="ceph"
TYPE="IMAGE_DS"

onedatastore show 2

DATASTORE 2 INFORMATION                                                         
ID             : 2                   
NAME           : files               
USER           : USER            
GROUP          : GROUP            
CLUSTERS       : 0                   
TYPE           : FILE                
DS_MAD         : fs                  
TM_MAD         : ssh                 
BASE PATH      : /var/lib/one//datastores/2
DISK_TYPE      : FILE                
STATE          : READY               

DATASTORE CAPACITY                                                              
TOTAL:         : 18.2G               
FREE:          : 4.8G                
USED:          : 12.5G               
LIMIT:         : -                   

PERMISSIONS                                                                     
OWNER          : um-                 
GROUP          : u--                 
OTHER          : ---                 

DATASTORE TEMPLATE                                                              
CLONE_TARGET="SYSTEM"
DS_MAD="fs"
LN_TARGET="SYSTEM"
RESTRICTED_DIRS="/"
SAFE_DIRS="/var/tmp"
TM_MAD="ssh"
TYPE="FILE_DS"

datastore 0 I left out since it is turned off

heathen · November 14, 2017, 5:57am

This is pretty weird. Would you mind to paste /var/lib/one//datastores/100/21404/disk.2.attach content as well?

By the way, if you’ve made a clean ONE 5.4 install oneadmin:onegroup should has uid\gid 9869 (I see that your’s is uid:1001, gid:1001). Please check ONE processes and /var/lib/one/datastores/100/21404/* permissions.

Is error the same after you changed DISK_TYPE to RBD? Did you restart opennebula service (it should work even ?

rouxdo · November 14, 2017, 10:16am

cat /var/lib/one//datastores/100/21404/disk.2.attach

<disk type='file' device='disk'>
  <driver name='qemu' type='raw'  />
  <source file='/var/lib/one//datastores/100/21404/disk.2' >
  
  </source>
  
  <target dev='vdb'/>
  
</disk>

User permissions are correct

Yes the same error as before.
No I didn’t restart the opennebula service => Will do this during this day.

Thank you very much!

heathen · November 14, 2017, 6:23pm

That’s pretty weird, it shouldn’t be like that. It should point to RBD image on the ceph pool if your disk type is RBD and storage driver is ceph.

I’ve made a test. I changed DISK_TYPE of my system ds to FILE and tried to attach a volatile FS (swap should be the same) disk. Got the same error as you (see below). Then I changed DISK_TYPE back to RBD and repeat attempt. This time successful. The only difference between your’s and my DS properties is ALLOW_ORPHANS (I’ve set it to YES), but it shouldn’t have any influence.

My log (failed the first and successful the second)

Tue Nov 14 22:44:30 2017 [Z0][VM][I]: New LCM state is HOTPLUG
Tue Nov 14 22:44:31 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_attach.
Tue Nov 14 22:44:31 2017 [Z0][VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/attach_disk 'one-21164' '/var/lib/one//datastores/0/64/disk.2' 'vdb' '1' 'PFZNTV9EUklWRVJfQUNU...'  21164 e002n02
Tue Nov 14 22:44:31 2017 [Z0][VMM][E]: attach_disk: Command "virsh --connect qemu:///system attach-device one-64 /var/lib/one//datastores/0/64/disk.2.attach" failed: error: Failed to attach device from /var/lib/one//datastores/0/64/disk.2.attach
Tue Nov 14 22:44:31 2017 [Z0][VMM][I]: error: Cannot access storage file '/var/lib/one//datastores/0/64/disk.2' (as uid:9869, gid:9869): No such file or directory
Tue Nov 14 22:44:32 2017 [Z0][VMM][E]: Could not attach /var/lib/one//datastores/0/64/disk.2 (vdb) to one-64
Tue Nov 14 22:44:32 2017 [Z0][VMM][I]: ExitCode: 1
Tue Nov 14 22:44:33 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_detach.
Tue Nov 14 22:44:33 2017 [Z0][VMM][I]: Failed to execute virtualization driver operation: attach_disk.
Tue Nov 14 22:44:33 2017 [Z0][VMM][E]: Error attaching new VM Disk: Could not attach /var/lib/one//datastores/0/64/disk.2 (vdb) to one-64
Tue Nov 14 22:44:33 2017 [Z0][VM][I]: New LCM state is RUNNING

Followed by

Tue Nov 14 22:45:50 2017 [Z0][VM][I]: New LCM state is HOTPLUG
Tue Nov 14 22:45:52 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_attach.
Tue Nov 14 22:45:52 2017 [Z0][VMM][I]: ExitCode: 0
Tue Nov 14 22:45:52 2017 [Z0][VMM][I]: Successfully execute virtualization driver operation: attach_disk.
Tue Nov 14 22:45:52 2017 [Z0][VMM][I]: VM Disk successfully attached.
Tue Nov 14 22:45:52 2017 [Z0][VM][I]: New LCM state is RUNNING

I didn’t even restart ONE.

I would strongly advice you to check again that the DS 100 DISK_TYPE value is RBD (without any hidden characters, spaces and so on).

rouxdo · November 15, 2017, 9:49pm

I managed to add a voltaile disk. But only if the VM was deployed on a specific server.
We currently have 5 servers with 2 different OS states (2 are newer than the other 3)

So probably it’s caused by this.
Also already created images couldn’t be attached. But there I assume it’s a Parameter problem…

=> I will dig into it

Thank you very much @heathen for your help!

rouxdo · December 9, 2017, 5:51pm

Sorry to “reopen” this issue
But I tried to add already created images, so which are already shown as one images, and I get the following error:

Sat Dec  9 18:07:18 2017 [Z0][VMM][D]: Message received: LOG E 22734 attach_disk: Command "virsh --connect qemu:///system attach-device one-22734 /var/lib/one//datastores/100/22734/disk.2.attach" failed: error: Failed to attach device from /var/lib/one//datastores/100/22734/disk.2.attach

Sat Dec  9 18:07:18 2017 [Z0][VMM][D]: Message received: LOG I 22734 error: internal error: unable to execute QEMU command 'device_add': Property 'virtio-blk-device.drive' can't find value 'drive-virtio-disk1'

Sat Dec  9 18:07:18 2017 [Z0][VMM][D]: Message received: LOG E 22734 Could not attach one/one-sys-22734-2 (vdb) to one-22734

It now is a different error, probably I’m missing something

Thanks for your help

Kind regards

rouxdo · December 14, 2017, 10:18pm

I’m still getting this error from qemu, which I’m not able to resolve

Any help?

Thanks a lot!

kiranranjane · December 23, 2017, 5:37pm

ONE - 5.4.1
OS - Ubuntu 16.04

sudo dpkg -l | grep qemu-block-extra
ii qemu-block-extra:amd64 1:2.5+dfsg-5ubuntu10.16 amd64 extra block
sudo dpkg -l | grep libvirt
ii libvirt-bin 1.3.1-1ubuntu10.15 amd64 programs for the libvirt
ii libvirt0:amd64 1.3.1-1ubuntu10.15 amd64 library for interfacing
ii python-libvirt 1.3.1-1ubuntu1.1 amd64 libvirt Python bindings

I am trying to hot plug virtio disk which was created in ONE and I am also getting the same error as above

sudo grep -r ‘drive-virtio-disk1’ *
one/15.log:Sat Dec 23 19:47:54 2017 [Z0][VMM][I]: error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value 'drive-virtio-disk1’
one/15.log:Sat Dec 23 19:48:59 2017 [Z0][VMM][I]: error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value 'drive-virtio-disk1’
one/15.log:Sat Dec 23 20:04:34 2017 [Z0][VMM][I]: error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value 'drive-virtio-disk1’
one/15.log:Sat Dec 23 20:52:40 2017 [Z0][VMM][I]: error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value 'drive-virtio-disk1’
one/oned.log:Sat Dec 23 19:47:54 2017 [Z0][VMM][D]: Message received: LOG I 15 error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value 'drive-virtio-disk1’
one/oned.log:Sat Dec 23 19:48:59 2017 [Z0][VMM][D]: Message received: LOG I 15 error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value 'drive-virtio-disk1’
one/oned.log:Sat Dec 23 20:04:34 2017 [Z0][VMM][D]: Message received: LOG I 15 error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value 'drive-virtio-disk1’
one/oned.log:Sat Dec 23 20:52:39 2017 [Z0][VMM][D]: Message received: LOG I 15 error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value ‘drive-virtio-disk1’

I found a bug but it seems to be related to rados block and it is quite old so not sure if this is still relevant - https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1495895

Any one having issues with Ubuntu16.04 + ONE while adding virtio disk?

Also if anyone could suggest if Centos7 KVM Packages are much stable or are they having such same issues?

Regards
Kiran R

heathen · December 26, 2017, 7:00am

Haven’t been here for a while…

You definitely have configuration issues. Please be sure you have the latest OpenNebula, and force driver sync between hosts with (from your ONE controller): onehost sync --force.

Topic		Replies	Views
CEPH cannot attach CDROM Community Support	13	2992	April 11, 2016
Can't create vm after ceph update Storage	4	912	November 3, 2020
Unknown driver format value 'save_as' Community Support	5	695	December 4, 2022
Deployment of the VM on CEPH problem Community Support	4	1876	March 9, 2016
Can not instantiate any KVM VM Community Support	10	3089	December 28, 2020

Not able to attach a disk to VM (CEPH)

Related topics