Hi Heathen,
I am using latest ONE - 5.4.1 and also I have an sync --force command on ONE server, Then restarted apparmor and libvirt service and tried again and still facing same issue.
I am using libvirt with tcp and everything works fine, I can spin up multiple virtual machine and host is monitored properly without any error from ONE server.
This is a fresh installation and not upgraded.
Regards
Kiran Ranjane
This is what I am getting while adding the disk when the VM is running, however same disk can be attached when the VM is powered off.
Tue Dec 26 17:37:24 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_attach.
Tue Dec 26 17:37:25 2017 [Z0][VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/attach_disk ‘one-26’ ‘/var/lib/one//datastores/101/26/disk.2’ ‘vdb’ ‘1’ ‘PFZNTV9EUklWRVJfQUNUSU9OX0RBVEE+PEhPU1Q+MTkyLjE2OC40LjIwMjwvSE9TVD48TUlHUl9IT1NULz48REVQTE9ZX0lEPm9uZS0yNjwvREVQTE9ZX0lEPjxMT0NBTF9ERVBMT1lNRU5UX0ZJTEUvPjxSRU1PVEVfREVQTE9ZTUVOVF9GSUxFLz48Q0hFQ0tQT0lOVF9GSUxFLz48VE1fQ09NTUFORD48IVtDREFUQVtDTE9ORSBxY293MiBtZnNtYXN0ZXI6L3Zhci9saWIvb25lLy9kYXRhc3RvcmVzLzEwMC84MjYyMDAwMTcwNGMyZjBjMWMzZGE0NmQxYjQxYWZiOSAxOTIuMTY4LjQuMjAyOi92YXIvbGliL29uZS8vZGF0YXN0b3Jlcy8xMDEvMjYvZGlzay4yIDI2IDEwMApdXT48L1RNX0NPTU1BTkQ+PFRNX0NPTU1BTkRfUk9MTEJBQ0s+PCFbQ0RBVEFbREVMRVRFIHFjb3cyIDE5Mi4xNjguNC4yMDI6L3Zhci9saWIvb25lLy9kYXRhc3RvcmVzLzEwMS8yNi9kaXNrLjIgMjYgMTAwCl1dPjwvVE1fQ09NTUFORF9ST0xMQkFDSz48RElTS19UQVJHRVRfUEFUSD4vdmFyL2xpYi9vbmUvL2RhdGFzdG9yZXMvMTAxLzI2L2Rpc2suMjwvRElTS19UQVJHRVRfUEFUSD48Vk0+PElEPjI2PC9JRD48VUlEPjA8L1VJRD48R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+VGVzdC0yMDEyPC9OQU1FPjxQRVJNSVNTSU9OUz48T1dORVJfVT4xPC9PV05FUl9VPjxPV05FUl9NPjE8L09XTkVSX00+PE9XTkVSX0E+MDwvT1dORVJfQT48R1JPVVBfVT4wPC9HUk9VUF9VPjxHUk9VUF9NPjA8L0dST1VQX00+PEdST1VQX0E+MDwvR1JPVVBfQT48T1RIRVJfVT4wPC9PVEhFUl9VPjxPVEhFUl9NPjA8L09USEVSX00+PE9USEVSX0E+MDwvT1RIRVJfQT48L1BFUk1JU1NJT05TPjxMQVNUX1BPTEw+MTUxNDI5MDA0MjwvTEFTVF9QT0xMPjxTVEFURT4zPC9TVEFURT48TENNX1NUQVRFPjE3PC9MQ01fU1RBVEU+PFBSRVZfU1RBVEU+MzwvUFJFVl9TVEFURT48UFJFVl9MQ01fU1RBVEU+MTc8L1BSRVZfTENNX1NUQVRFPjxSRVNDSEVEPjA8L1JFU0NIRUQ+PFNUSU1FPjE1MTQyODk3Mzc8L1NUSU1FPjxFVElNRT4wPC9FVElNRT48REVQTE9ZX0lEPm9uZS0yNjwvREVQTE9ZX0lEPjxNT05JVE9SSU5HPjxDUFU+PCFbQ0RBVEFbNy4wMl1dPjwvQ1BVPjxESVNLUkRCWVRFUz48IVtDREFUQVsxODI3OTI0NDgwXV0+PC9ESVNLUkRCWVRFUz48RElTS1JESU9QUz48IVtDREFUQVs2MTQ4Nl1dPjwvRElTS1JESU9QUz48RElTS1dSQllURVM+PCFbQ0RBVEFbNjM5ODYzODA4XV0+PC9ESVNLV1JCWVRFUz48RElTS1dSSU9QUz48IVtDREFUQVs5OTk4XV0+PC9ESVNLV1JJT1BTPjxNRU1PUlk+PCFbQ0RBVEFbNDI5NDc5Ml1dPjwvTUVNT1JZPjxTVEFURT48IVtDREFUQVthXV0+PC9TVEFURT48L01PTklUT1JJTkc+PFRFTVBMQVRFPjxBVVRPTUFUSUNfRFNfUkVRVUlSRU1FTlRTPjwhW0NEQVRBWyJDTFVTVEVSUy9JRCIgQD4gMF1dPjwvQVVUT01BVElDX0RTX1JFUVVJUkVNRU5UUz48QVVUT01BVElDX1JFUVVJUkVNRU5UUz48IVtDREFUQVsoQ0xVU1RFUl9JRCA9IDApICYgIShQVUJMSUNfQ0xPVUQgPSBZRVMpXV0+PC9BVVRPTUFUSUNfUkVRVUlSRU1FTlRTPjxDT05URVhUPjxESVNLX0lEPjwhW0NEQVRBWzFdXT48L0RJU0tfSUQ+PE5FVFdPUks+PCFbQ0RBVEFbWUVTXV0+PC9ORVRXT1JLPjxTU0hfUFVCTElDX0tFWT48IVtDREFUQVt0cl1dPjwvU1NIX1BVQkxJQ19LRVk+PFRBUkdFVD48IVtDREFUQVtoZGFdXT48L1RBUkdFVD48L0NPTlRFWFQ+PENQVT48IVtDREFUQVswLjNdXT48L0NQVT48RElTSz48QUxMT1dfT1JQSEFOUz48IVtDREFUQVtOT11dPjwvQUxMT1dfT1JQSEFOUz48Q0FDSEU+PCFbQ0RBVEFbbm9uZV1dPjwvQ0FDSEU+PENMT05FPjwhW0NEQVRBW1lFU11dPjwvQ0xPTkU+PENMT05FX1RBUkdFVD48IVtDREFUQVtTWVNURU1dXT48L0NMT05FX1RBUkdFVD48Q0xVU1RFUl9JRD48IVtDREFUQVswXV0+PC9DTFVTVEVSX0lEPjxEQVRBU1RPUkU+PCFbQ0RBVEFbSW1hZ2UtRGF0YXN0b3JlXV0+PC9EQVRBU1RPUkU+PERBVEFTVE9SRV9JRD48IVtDREFUQVsxMDBdXT48L0RBVEFTVE9SRV9JRD48REVWX1BSRUZJWD48IVtDREFUQVt2ZF1dPjwvREVWX1BSRUZJWD48RElTS19JRD48IVtDREFUQVswXV0+PC9ESVNLX0lEPjxESVNLX1NOQVBTSE9UX1RPVEFMX1NJWkU+PCFbQ0RBVEFbMF1dPjwvRElTS19TTkFQU0hPVF9UT1RBTF9TSVpFPjxESVNLX1RZUEU+PCFbQ0RBVEFbRklMRV1dPjwvRElTS19UWVBFPjxEUklWRVI+PCFbQ0RBVEFbcWNvdzJdXT48L0RSSVZFUj48SU1BR0U+PCFbQ0RBVEFbV2luZG93cy0yMDEyUjItU3RkU3J2LUJvb3REaXNrXV0+PC9JTUFHRT48SU1BR0VfSUQ+PCFbQ0RBVEFbMTldXT48L0lNQUdFX0lEPjxJTUFHRV9TVEFURT48IVtDREFUQVsyXV0+PC9JTUFHRV9TVEFURT48SU1BR0VfVU5BTUU+PCFbQ0RBVEFbb25lYWRtaW5dXT48L0lNQUdFX1VOQU1FPjxJTz48IVtDREFUQVt0aHJlYWRzXV0+PC9JTz48TE5fVEFSR0VUPjwhW0NEQVRBW05PTkVdXT48L0xOX1RBUkdFVD48T1JJR0lOQUxfU0laRT48IVtDREFUQVs1MTIwMF1dPjwvT1JJR0lOQUxfU0laRT48UkVBRE9OTFk+PCFbQ0RBVEFbTk9dXT48L1JFQURPTkxZPjxTQVZFPjwhW0NEQVRBW05PXV0+PC9TQVZFPjxTSVpFPjwhW0NEQVRBWzU2MzIwMF1dPjwvU0laRT48U09VUkNFPjwhW0NEQVRBWy92YXIvbGliL29uZS8vZGF0YXN0b3Jlcy8xMDAvY2Q1ZDBjYzZjNzc5M2I0ZjU3NzEzYjcxY2NiZTJkZDRdXT48L1NPVVJDRT48VEFSR0VUPjwhW0NEQVRBW3ZkYV1dPjwvVEFSR0VUPjxUTV9NQUQ+PCFbQ0RBVEFbcWNvdzJdXT48L1RNX01BRD48VFlQRT48IVtDREFUQVtGSUxFXV0+PC9UWVBFPjxWQ0VOVEVSX0FEQVBURVJfVFlQRT48IVtDREFUQVtsc2lMb2dpY11dPjwvVkNFTlRFUl9BREFQVEVSX1RZUEU+PFZDRU5URVJfRElTS19UWVBFPjwhW0NEQVRBW3RoaW5dXT48L1ZDRU5URVJfRElTS19UWVBFPjwvRElTSz48RElTSz48QUxMT1dfT1JQSEFOUz48IVtDREFUQVtOT11dPjwvQUxMT1dfT1JQSEFOUz48QVRUQUNIPjwhW0NEQVRBW1lFU11dPjwvQVRUQUNIPjxDTE9ORT48IVtDREFUQVtZRVNdXT48L0NMT05FPjxDTE9ORV9UQVJHRVQ+PCFbQ0RBVEFbU1lTVEVNXV0+PC9DTE9ORV9UQVJHRVQ+PENMVVNURVJfSUQ+PCFbQ0RBVEFbMF1dPjwvQ0xVU1RFUl9JRD48REFUQVNUT1JFPjwhW0NEQVRBW0ltYWdlLURhdGFzdG9yZV1dPjwvREFUQVNUT1JFPjxEQVRBU1RPUkVfSUQ+PCFbQ0RBVEFbMTAwXV0+PC9EQVRBU1RPUkVfSUQ+PERFVl9QUkVGSVg+PCFbQ0RBVEFbdmRdXT48L0RFVl9QUkVGSVg+PERJU0tfSUQ+PCFbQ0RBVEFbMl1dPjwvRElTS19JRD48RElTS19TTkFQU0hPVF9UT1RBTF9TSVpFPjwhW0NEQVRBWzBdXT48L0RJU0tfU05BUFNIT1RfVE9UQUxfU0laRT48RElTS19UWVBFPjwhW0NEQVRBW0ZJTEVdXT48L0RJU0tfVFlQRT48RFJJVkVSPjwhW0NEQVRBW3Fjb3cyXV0+PC9EUklWRVI+PElNQUdFPjwhW0NEQVRBW3ZpcnRpby1kaXNrLTAxXV0+PC9JTUFHRT48SU1BR0VfSUQ+PCFbQ0RBVEFbMzRdXT48L0lNQUdFX0lEPjxJTUFHRV9TVEFURT48IVtDREFUQVsyXV0+PC9JTUFHRV9TVEFURT48SU1BR0VfVU5BTUU+PCFbQ0RBVEFbb25lYWRtaW5dXT48L0lNQUdFX1VOQU1FPjxMTl9UQVJHRVQ+PCFbQ0RBVEFbTk9ORV1dPjwvTE5fVEFSR0VUPjxPUklHSU5BTF9TSVpFPjwhW0NEQVRBWzEwMjQwXV0+PC9PUklHSU5BTF9TSVpFPjxSRUFET05MWT48IVtDREFUQVtOT11dPjwvUkVBRE9OTFk+PFNBVkU+PCFbQ0RBVEFbTk9dXT48L1NBVkU+PFNJWkU+PCFbQ0RBVEFbMTAyNDBdXT48L1NJWkU+PFNPVVJDRT48IVtDREFUQVsvdmFyL2xpYi9vbmUvL2RhdGFzdG9yZXMvMTAwLzgyNjIwMDAxNzA0YzJmMGMxYzNkYTQ2ZDFiNDFhZmI5XV0+PC9TT1VSQ0U+PFRBUkdFVD48IVtDREFUQVt2ZGJdXT48L1RBUkdFVD48VE1fTUFEPjwhW0NEQVRBW3Fjb3cyXV0+PC9UTV9NQUQ+PFRZUEU+PCFbQ0RBVEFbRklMRV1dPjwvVFlQRT48L0RJU0s+PEZFQVRVUkVTPjxBQ1BJPjwhW0NEQVRBW3llc11dPjwvQUNQST48QVBJQz48IVtDREFUQVt5ZXNdXT48L0FQSUM+PEhZUEVSVj48IVtDREFUQVt5ZXNdXT48L0hZUEVSVj48TE9DQUxUSU1FPjwhW0NEQVRBW3llc11dPjwvTE9DQUxUSU1FPjwvRkVBVFVSRVM+PEdSQVBISUNTPjxMSVNURU4+PCFbQ0RBVEFbMC4wLjAuMF1dPjwvTElTVEVOPjxQT1JUPjwhW0NEQVRBWzU5MjZdXT48L1BPUlQ+PFRZUEU+PCFbQ0RBVEFbVk5DXV0+PC9UWVBFPjwvR1JBUEhJQ1M+PElOUFVUPjxCVVM+PCFbQ0RBVEFbdXNiXV0+PC9CVVM+PFRZUEU+PCFbQ0RBVEFbdGFibGV0XV0+PC9UWVBFPjwvSU5QVVQ+PE1FTU9SWT48IVtDREFUQVs0MDk2XV0+PC9NRU1PUlk+PE5JQ19ERUZBVUxUPjxNT0RFTD48IVtDREFUQVt2aXJ0aW9dXT48L01PREVMPjwvTklDX0RFRkFVTFQ+PE9TPjxBUkNIPjwhW0NEQVRBW3g4Nl82NF1dPjwvQVJDSD48Qk9PVD48IVtDREFUQVtdXT48L0JPT1Q+PC9PUz48UkFXPjxEQVRBPjwhW0NEQVRBWzxjcHUgbW9kZT0naG9zdC1wYXNzdGhyb3VnaCcvPl1dPjwvREFUQT48VFlQRT48IVtDREFUQVtrdm1dXT48L1RZUEU+PC9SQVc+PFRFTVBMQVRFX0lEPjwhW0NEQVRBWzE1XV0+PC9URU1QTEFURV9JRD48VkNQVT48IVtDREFUQVsyXV0+PC9WQ1BVPjxWTUlEPjwhW0NEQVRBWzI2XV0+PC9WTUlEPjwvVEVNUExBVEU+PFVTRVJfVEVNUExBVEU+PERFU0NSSVBUSU9OPjwhW0NEQVRBW1dpbmRvd3MtMjAwMTJSMi1TdGRTcnZdXT48L0RFU0NSSVBUSU9OPjxIWVBFUlZJU09SPjwhW0NEQVRBW2t2bV1dPjwvSFlQRVJWSVNPUj48SU5QVVRTX09SREVSPjwhW0NEQVRBW11dPjwvSU5QVVRTX09SREVSPjxMT0dPPjwhW0NEQVRBW2ltYWdlcy9sb2dvcy93aW5kb3dzOC5wbmddXT48L0xPR08+PE1FTU9SWV9VTklUX0NPU1Q+PCFbQ0RBVEFbR0JdXT48L01FTU9SWV9VTklUX0NPU1Q+PFNDSEVEX0RTX1JFUVVJUkVNRU5UUz48IVtDREFUQVtJRD0iMTAxIl1dPjwvU0NIRURfRFNfUkVRVUlSRU1FTlRTPjxTQ0hFRF9SRVFVSVJFTUVOVFM+PCFbQ0RBVEFbQ0xVU1RFUl9JRD0iMCJdXT48L1NDSEVEX1JFUVVJUkVNRU5UUz48VVNFUl9JTlBVVFM+PENQVT48IVtDREFUQVtPfGZpeGVkfHwgfDAuM11dPjwvQ1BVPjxNRU1PUlk+PCFbQ0RBVEFbTXxsaXN0fHwxMDI0LDIwNDgsNDA5Niw2MTQ0LDgxOTIsMTAyNDAsMTIyODgsMTQzMzYsMTYzODQsMjQ1NzYsMzI3NjgsNjU1MzYsMTMxMDcyfDQwOTZdXT48L01FTU9SWT48VkNQVT48IVtDREFUQVtPfGxpc3R8fDIsNCw2LDgsMTIsMTYsMzJ8Ml1dPjwvVkNQVT48L1VTRVJfSU5QVVRTPjwvVVNFUl9URU1QTEFURT48SElTVE9SWV9SRUNPUkRTPjxISVNUT1JZPjxPSUQ+MjY8L09JRD48U0VRPjE8L1NFUT48SE9TVE5BTUU+MTkyLjE2OC40LjIwMjwvSE9TVE5BTUU+PEhJRD4wPC9ISUQ+PENJRD4wPC9DSUQ+PFNUSU1FPjE1MTQyOTAwNDM8L1NUSU1FPjxFVElNRT4wPC9FVElNRT48Vk1fTUFEPjwhW0NEQVRBW2t2bV1dPjwvVk1fTUFEPjxUTV9NQUQ+PCFbQ0RBVEFbcWNvdzJdXT48L1RNX01BRD48RFNfSUQ+MTAxPC9EU19JRD48UFNUSU1FPjA8L1BTVElNRT48UEVUSU1FPjA8L1BFVElNRT48UlNUSU1FPjE1MTQyOTAwNDM8L1JTVElNRT48UkVUSU1FPjA8L1JFVElNRT48RVNUSU1FPjA8L0VTVElNRT48RUVUSU1FPjA8L0VFVElNRT48QUNUSU9OPjA8L0FDVElPTj48VUlEPi0xPC9VSUQ+PEdJRD4tMTwvR0lEPjxSRVFVRVNUX0lEPi0xPC9SRVFVRVNUX0lEPjwvSElTVE9SWT48L0hJU1RPUllfUkVDT1JEUz48L1ZNPjxEQVRBU1RPUkU+PElEPjEwMTwvSUQ+PFVJRD4wPC9VSUQ+PEdJRD4wPC9HSUQ+PFVOQU1FPm9uZWFkbWluPC9VTkFNRT48R05BTUU+b25lYWRtaW48L0dOQU1FPjxOQU1FPlByaW1hcnktRGF0YXN0b3JlPC9OQU1FPjxQRVJNSVNTSU9OUz48T1dORVJfVT4xPC9PV05FUl9VPjxPV05FUl9NPjE8L09XTkVSX00+PE9XTkVSX0E+MDwvT1dORVJfQT48R1JPVVBfVT4xPC9HUk9VUF9VPjxHUk9VUF9NPjA8L0dST1VQX00+PEdST1VQX0E+MDwvR1JPVVBfQT48T1RIRVJfVT4xPC9PVEhFUl9VPjxPVEhFUl9NPjA8L09USEVSX00+PE9USEVSX0E+MDwvT1RIRVJfQT48L1BFUk1JU1NJT05TPjxEU19NQUQ+PCFbQ0RBVEFbLV1dPjwvRFNfTUFEPjxUTV9NQUQ+PCFbQ0RBVEFbcWNvdzJdXT48L1RNX01BRD48QkFTRV9QQVRIPjwhW0NEQVRBWy92YXIvbGliL29uZS8vZGF0YXN0b3Jlcy8xMDFdXT48L0JBU0VfUEFUSD48VFlQRT4xPC9UWVBFPjxESVNLX1RZUEU+MDwvRElTS19UWVBFPjxTVEFURT4wPC9TVEFURT48Q0xVU1RFUlM+PElEPjA8L0lEPjwvQ0xVU1RFUlM+PFRPVEFMX01CPjEyMzkwNzkxPC9UT1RBTF9NQj48RlJFRV9NQj4xMDgyNDMyODwvRlJFRV9NQj48VVNFRF9NQj4xNTY2NDY0PC9VU0VEX01CPjxJTUFHRVM+PC9JTUFHRVM+PFRFTVBMQVRFPjxBTExPV19PUlBIQU5TPjwhW0NEQVRBW05PXV0+PC9BTExPV19PUlBIQU5TPjxEQVRBU1RPUkVfQ0FQQUNJVFlfQ0hFQ0s+PCFbQ0RBVEFbWUVTXV0+PC9EQVRBU1RPUkVfQ0FQQUNJVFlfQ0hFQ0s+PERJU0tfVFlQRT48IVtDREFUQVtGSUxFXV0+PC9ESVNLX1RZUEU+PERTX01JR1JBVEU+PCFbQ0RBVEFbWUVTXV0+PC9EU19NSUdSQVRFPjxSRVNUUklDVEVEX0RJUlM+PCFbQ0RBVEFbL11dPjwvUkVTVFJJQ1RFRF9ESVJTPjxTQUZFX0RJUlM+PCFbQ0RBVEFbL3Zhci90bXBdXT48L1NBRkVfRElSUz48U0hBUkVEPjwhW0NEQVRBW1lFU11dPjwvU0hBUkVEPjxUTV9NQUQ+PCFbQ0RBVEFbcWNvdzJdXT48L1RNX01BRD48VFlQRT48IVtDREFUQVtTWVNURU1fRFNdXT48L1RZUEU+PC9URU1QTEFURT48L0RBVEFTVE9SRT48L1ZNTV9EUklWRVJfQUNUSU9OX0RBVEE+’ 26 192.168.4.202
Tue Dec 26 17:37:25 2017 [Z0][VMM][E]: attach_disk: Command “virsh --connect qemu+tcp://localhost/system attach-device one-26 /var/lib/one//datastores/101/26/disk.2.attach” failed: error: Failed to attach device from /var/lib/one//datastores/101/26/disk.2.attach
Tue Dec 26 17:37:25 2017 [Z0][VMM][I]: error: internal error: unable to execute QEMU command ‘device_add’: Property ‘virtio-blk-device.drive’ can’t find value 'drive-virtio-disk1’
Tue Dec 26 17:37:25 2017 [Z0][VMM][E]: Could not attach /var/lib/one//datastores/101/26/disk.2 (vdb) to one-26
Tue Dec 26 17:37:25 2017 [Z0][VMM][I]: ExitCode: 1
Tue Dec 26 17:37:26 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_detach.
Tue Dec 26 17:37:26 2017 [Z0][VMM][I]: Failed to execute virtualization driver operation: attach_disk.
Tue Dec 26 17:37:26 2017 [Z0][VMM][E]: Error attaching new VM Disk: Could not attach /var/lib/one//datastores/101/26/disk.2 (vdb) to one-26
Tue Dec 26 17:37:26 2017 [Z0][VM][I]: New LCM state is RUNNING
Do you have ceph as a storage backend?
If so have you also set system DS DISK_TYPE property?
I am using qcow2 mode shared datastore on NFS and disk type = file
I synced the driver, but yet still the same error…