Luis
April 22, 2021, 1:01am
1
Hello community!
I am currently trying Open Nebula 6 and when setting up HA for VM I am running into some problems.
I have added the hook by running onehook create <my hook>:
ARGUMENTS = "$TEMPLATE -m -p 5"
COMMAND = "/var/tmp/one/hooks/ft/host_error.rb"
Preformatted text`NAME = "host_error"
STATE = "ERROR"
REMOTE = "no"
RESOURCE = HOST
TYPE = state
When my host gives error I can see that the hook gets activated by reading /var/log/one/onehm.log
Wed Apr 21 20:31:09 2021 [I]: Executing hook 2 for HOST/ERROR/
Wed Apr 21 20:31:11 2021 [E]: Failure executing hook 2 for HOST/ERROR/
Upon further investigation I ran the command onehook show <hook id> -e 0
HOOK 2 INFORMATION
ID : 2
NAME : host_error
TYPE : state
LOCK : None
ERROR: Invalid predicate: //HOOK_EXECUTION_RECORD[EXECUTION_ID=0cd]
oneadmin@one-sunstone:/home/onedmin$ ^C
oneadmin@one-sunstone:/home/onedmin$ onehook show 2 -e 0
HOOK 2 INFORMATION
ID : 2
NAME : host_error
TYPE : state
LOCK : None
HOOK EXECUTION RECORD
EXECUTION ID : 0
TIMESTAMP : 04/21 20:31:11
COMMAND : /var/tmp/one/hooks/ft/host_error.rb PEhPU1Q+CiAgPElEPjE8L0lEPgogIDxOQU1FPjE3Mi4xNi4xMDAuNTI8L05BTUU+CiAgPFNUQVRFPjM8L1NUQVRFPgogIDxQUkVWX1NUQVRFPjI8L1BSRVZfU1RBVEU+CiAgPElNX01BRD48IVtDREFUQVtrdm1dXT48L0lNX01BRD4KICA8Vk1fTUFEPjwhW0NEQVRBW2t2bV1dPjwvVk1fTUFEPgogIDxDTFVTVEVSX0lEPjA8L0NMVVNURVJfSUQ+CiAgPENMVVNURVI+ZGVmYXVsdDwvQ0xVU1RFUj4KICA8SE9TVF9TSEFSRT4KICAgIDxNRU1fVVNBR0U+MTMxMDcyPC9NRU1fVVNBR0U+CiAgICA8Q1BVX1VTQUdFPjEwMDwvQ1BVX1VTQUdFPgogICAgPFRPVEFMX01FTT4xNjM5ODAxNjwvVE9UQUxfTUVNPgogICAgPFRPVEFMX0NQVT40MDA8L1RPVEFMX0NQVT4KICAgIDxNQVhfTUVNPjE2Mzk4MDE2PC9NQVhfTUVNPgogICAgPE1BWF9DUFU+NDAwPC9NQVhfQ1BVPgogICAgPFJVTk5JTkdfVk1TPjE8L1JVTk5JTkdfVk1TPgogICAgPFZNU19USFJFQUQ+MTwvVk1TX1RIUkVBRD4KICAgIDxEQVRBU1RPUkVTPgogICAgICA8RElTS19VU0FHRT48IVtDREFUQVswXV0+PC9ESVNLX1VTQUdFPgogICAgICA8RFM+CiAgICAgICAgPEZSRUVfTUI+PCFbQ0RBVEFbMzk5ODNdXT48L0ZSRUVfTUI+CiAgICAgICAgPElEPjwhW0NEQVRBWzBdXT48L0lEPgogICAgICAgIDxUT1RBTF9NQj48IVtDREFUQVs0OTYzN11dPjwvVE9UQUxfTUI+CiAgICAgICAgPFVTRURfTUI+PCFbQ0RBVEFbNzEwNV1dPjwvVVNFRF9NQj4KICAgICAgPC9EUz4KICAgICAgPEZSRUVfRElTSz48IVtDREFUQVszOTk4M11dPjwvRlJFRV9ESVNLPgogICAgICA8TUFYX0RJU0s+PCFbQ0RBVEFbNDk2MzddXT48L01BWF9ESVNLPgogICAgICA8VVNFRF9ESVNLPjwhW0NEQVRBWzcxMDVdXT48L1VTRURfRElTSz4KICAgIDwvREFUQVNUT1JFUz4KICAgIDxQQ0lfREVWSUNFUy8+CiAgICA8TlVNQV9OT0RFUz4KICAgICAgPE5PREU+CiAgICAgICAgPENPUkU+CiAgICAgICAgICA8Q1BVUz48IVtDREFUQVszOi0xXV0+PC9DUFVTPgogICAgICAgICAgPERFRElDQVRFRD48IVtDREFUQVtOT11dPjwvREVESUNBVEVEPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMV1dPjwvRlJFRT4KICAgICAgICAgIDxJRD48IVtDREFUQVswXV0+PC9JRD4KICAgICAgICA8L0NPUkU+CiAgICAgICAgPEhVR0VQQUdFPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMF1dPjwvRlJFRT4KICAgICAgICAgIDxQQUdFUz48IVtDREFUQVswXV0+PC9QQUdFUz4KICAgICAgICAgIDxTSVpFPjwhW0NEQVRBWzIwNDhdXT48L1NJWkU+CiAgICAgICAgICA8VVNBR0U+PCFbQ0RBVEFbMF1dPjwvVVNBR0U+CiAgICAgICAgPC9IVUdFUEFHRT4KICAgICAgICA8TUVNT1JZPgogICAgICAgICAgPERJU1RBTkNFPjwhW0NEQVRBWzBdXT48L0RJU1RBTkNFPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMF1dPjwvRlJFRT4KICAgICAgICAgIDxUT1RBTD48IVtDREFUQVsxNjM5ODAxNl1dPjwvVE9UQUw+CiAgICAgICAgICA8VVNBR0U+PCFbQ0RBVEFbMF1dPjwvVVNBR0U+CiAgICAgICAgICA8VVNFRD48IVtDREFUQVswXV0+PC9VU0VEPgogICAgICAgIDwvTUVNT1JZPgogICAgICAgIDxOT0RFX0lEPjwhW0NEQVRBWzBdXT48L05PREVfSUQ+CiAgICAgIDwvTk9ERT4KICAgIDwvTlVNQV9OT0RFUz4KICA8L0hPU1RfU0hBUkU+CiAgPFZNUz4KICAgIDxJRD45PC9JRD4KICA8L1ZNUz4KICA8VEVNUExBVEU+CiAgICA8QVJDSD48IVtDREFUQVt4ODZfNjRdXT48L0FSQ0g+CiAgICA8Q0xVU1RFUl9JRD48IVtDREFUQVswXV0+PC9DTFVTVEVSX0lEPgogICAgPENQVVNQRUVEPjwhW0NEQVRBWzIzOTRdXT48L0NQVVNQRUVEPgogICAgPEVSUk9SPjwhW0NEQVRBW1dlZCBBcHIgMjEgMjA6MzE6MDkgMjAyMSA6IEVycm9yIG1vbml0b3JpbmcgSG9zdCAxNzIuMTYuMTAwLjUyICgxKTogXV0+PC9FUlJPUj4KICAgIDxIT1NUTkFNRT48IVtDREFUQVtvbmUta3ZtMl1dPjwvSE9TVE5BTUU+CiAgICA8SFlQRVJWSVNPUj48IVtDREFUQVtrdm1dXT48L0hZUEVSVklTT1I+CiAgICA8SU1fTUFEPjwhW0NEQVRBW2t2bV1dPjwvSU1fTUFEPgogICAgPEtWTV9DUFVfTU9ERUw+PCFbQ0RBVEFbV2VzdG1lcmVdXT48L0tWTV9DUFVfTU9ERUw+CiAgICA8S1ZNX0NQVV9NT0RFTFM+PCFbQ0RBVEFbNDg2IHBlbnRpdW0gcGVudGl1bTIgcGVudGl1bTMgcGVudGl1bXBybyBjb3JlZHVvIG4yNzAgY29yZTJkdW8gcWVtdTMyIGt2bTMyIGNwdTY0LXJoZWw1IGNwdTY0LXJoZWw2IHFlbXU2NCBrdm02NCBDb25yb2UgUGVucnluIE5laGFsZW0gTmVoYWxlbS1JQlJTIFdlc3RtZXJlIFdlc3RtZXJlLUlCUlMgU2FuZHlCcmlkZ2UgU2FuZHlCcmlkZ2UtSUJSUyBJdnlCcmlkZ2UgSXZ5QnJpZGdlLUlCUlMgSGFzd2VsbC1ub1RTWCBIYXN3ZWxsLW5vVFNYLUlCUlMgSGFzd2VsbCBIYXN3ZWxsLUlCUlMgQnJvYWR3ZWxsLW5vVFNYIEJyb2Fkd2VsbC1ub1RTWC1JQlJTIEJyb2Fkd2VsbCBCcm9hZHdlbGwtSUJSUyBTa3lsYWtlLUNsaWVudCBTa3lsYWtlLUNsaWVudC1JQlJTIFNreWxha2UtQ2xpZW50LW5vVFNYLUlCUlMgU2t5bGFrZS1TZXJ2ZXIgU2t5bGFrZS1TZXJ2ZXItSUJSUyBTa3lsYWtlLVNlcnZlci1ub1RTWC1JQlJTIENhc2NhZGVsYWtlLVNlcnZlciBDYXNjYWRlbGFrZS1TZXJ2ZXItbm9UU1ggSWNlbGFrZS1DbGllbnQgSWNlbGFrZS1DbGllbnQtbm9UU1ggSWNlbGFrZS1TZXJ2ZXIgSWNlbGFrZS1TZXJ2ZXItbm9UU1ggYXRobG9uIHBoZW5vbSBPcHRlcm9uX0cxIE9wdGVyb25fRzIgT3B0ZXJvbl9HMyBPcHRlcm9uX0c0IE9wdGVyb25fRzUgRVBZQyBFUFlDLUlCUEIgRVBZQy1Sb21lIERoeWFuYV1dPjwvS1ZNX0NQVV9NT0RFTFM+CiAgICA8S1ZNX01BQ0hJTkVTPjwhW0NEQVRBW3BjLWk0NDBmeC1mb2NhbCB1YnVudHUgcGMtMC4xNSBwYy1pNDQwZngtMi4xMiBwYy1pNDQwZngtMi4wIHBjLWk0NDBmeC14ZW5pYWwgcGMtcTM1LTQuMiBxMzUgcGMtaTQ0MGZ4LTIuNSBwYy1pNDQwZngtNC4yIHBjIHBjLXEzNS14ZW5pYWwgcGMtaTQ0MGZ4LTEuNSBwYy0wLjEyIHBjLXEzNS0yLjcgcGMtcTM1LWVvYW4taHBiIHBjLWk0NDBmeC1kaXNjby1ocGIgcGMtaTQ0MGZ4LXplc3R5IHBjLXEzNS1hcnRmdWwgcGMtaTQ0MGZ4LXRydXN0eSBwYy1pNDQwZngtMi4yIHBjLWk0NDBmeC1lb2FuLWhwYiBwYy1xMzUtZm9jYWwtaHBiIHBjLTEuMSBwYy1xMzUtYmlvbmljLWhwYiBwYy1pNDQwZngtYXJ0ZnVsIHBjLWk0NDBmeC0yLjcgcGMtaTQ0MGZ4LXlha2tldHkgcGMtcTM1LTIuNCBwYy1xMzUtY29zbWljLWhwYiBwYy1xMzUtMi4xMCBwYy1pNDQwZngtMS43IHBjLTAuMTQgcGMtcTM1LTIuOSBwYy1pNDQwZngtMi4xMSBwYy1xMzUtMy4xIHBjLXEzNS00LjEgcGMtaTQ0MGZ4LTIuNCBwYy0xLjMgcGMtaTQ0MGZ4LTQuMSBwYy1xMzUtZW9hbiBwYy1pNDQwZngtMi45IHBjLWk0NDBmeC1iaW9uaWMtaHBiIGlzYXBjIHBjLWk0NDBmeC0xLjQgcGMtcTM1LWNvc21pYyBwYy1xMzUtMi42IHBjLWk0NDBmeC0zLjEgcGMtcTM1LWJpb25pYyBwYy1xMzUtZGlzY28taHBiIHBjLWk0NDBmeC1jb3NtaWMgcGMtcTM1LTIuMTIgcGMtaTQ0MGZ4LWJpb25pYyBwYy1xMzUtZGlzY28gcGMtaTQ0MGZ4LWNvc21pYy1ocGIgcGMtaTQ0MGZ4LTIuMSBwYy0xLjAgcGMtaTQ0MGZ4LXdpbHkgcGMtaTQ0MGZ4LTIuNiBwYy1xMzUtNC4wLjEgcGMtaTQ0MGZ4LTEuNiBwYy0wLjEzIHBjLXEzNS0yLjggcGMtaTQ0MGZ4LTIuMTAgcGMtcTM1LTMuMCBwYy1xMzUtemVzdHkgcGMtcTM1LTQuMCBtaWNyb3ZtIHBjLWk0NDBmeC0yLjMgcGMtcTM1LWZvY2FsIHVidW50dS1xMzUgcGMtaTQ0MGZ4LWRpc2NvIHBjLTEuMiBwYy1pNDQwZngtNC4wIHBjLWk0NDBmeC1mb2NhbC1ocGIgcGMtaTQ0MGZ4LTIuOCBwYy1pNDQwZngtZW9hbiBwYy1xMzUtMi41IHBjLWk0NDBmeC0zLjAgcGMtcTM1LXlha2tldHkgcGMtcTM1LTIuMTFdXT48L0tWTV9NQUNISU5FUz4KICAgIDxNT0RFTE5BTUU+PCFbQ0RBVEFbSW50ZWwoUikgWGVvbihSKSBDUFUgRTctIDQ4NzAgIEAgMi40MEdIel1dPjwvTU9ERUxOQU1FPgogICAgPE5BTUU+PCFbQ0RBVEFbMTcyLjE2LjEwMC41Ml1dPjwvTkFNRT4KICAgIDxSRVNFUlZFRF9DUFU+PCFbQ0RBVEFbXV0+PC9SRVNFUlZFRF9DUFU+CiAgICA8UkVTRVJWRURfTUVNPjwhW0NEQVRBW11dPjwvUkVTRVJWRURfTUVNPgogICAgPFZFUlNJT04+PCFbQ0RBVEFbNi4wLjBdXT48L1ZFUlNJT04+CiAgICA8Vk1fTUFEPjwhW0NEQVRBW2t2bV1dPjwvVk1fTUFEPgogIDwvVEVNUExBVEU+CiAgPE1PTklUT1JJTkcvPgo8L0hPU1Q+ -m -p 5
ARGUMENTS : <HOST>
<ID>1</ID>
<NAME>172.16.100.52</NAME>
<STATE>3</STATE>
<PREV_STATE>2</PREV_STATE>
<IM_MAD><![CDATA[kvm]]></IM_MAD>
<VM_MAD><![CDATA[kvm]]></VM_MAD>
<CLUSTER_ID>0</CLUSTER_ID>
<CLUSTER>default</CLUSTER>
<HOST_SHARE>
<MEM_USAGE>131072</MEM_USAGE>
<CPU_USAGE>100</CPU_USAGE>
<TOTAL_MEM>16398016</TOTAL_MEM>
<TOTAL_CPU>400</TOTAL_CPU>
<MAX_MEM>16398016</MAX_MEM>
<MAX_CPU>400</MAX_CPU>
<RUNNING_VMS>1</RUNNING_VMS>
<VMS_THREAD>1</VMS_THREAD>
<DATASTORES>
<DISK_USAGE><![CDATA[0]]></DISK_USAGE>
<DS>
<FREE_MB><![CDATA[39983]]></FREE_MB>
<ID><![CDATA[0]]></ID>
<TOTAL_MB><![CDATA[49637]]></TOTAL_MB>
<USED_MB><![CDATA[7105]]></USED_MB>
</DS>
<FREE_DISK><![CDATA[39983]]></FREE_DISK>
<MAX_DISK><![CDATA[49637]]></MAX_DISK>
<USED_DISK><![CDATA[7105]]></USED_DISK>
</DATASTORES>
<PCI_DEVICES/>
<NUMA_NODES>
<NODE>
<CORE>
<CPUS><![CDATA[3:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[1]]></FREE>
<ID><![CDATA[0]]></ID>
</CORE>
<HUGEPAGE>
<FREE><![CDATA[0]]></FREE>
<PAGES><![CDATA[0]]></PAGES>
<SIZE><![CDATA[2048]]></SIZE>
<USAGE><![CDATA[0]]></USAGE>
</HUGEPAGE>
<MEMORY>
<DISTANCE><![CDATA[0]]></DISTANCE>
<FREE><![CDATA[0]]></FREE>
<TOTAL><![CDATA[16398016]]></TOTAL>
<USAGE><![CDATA[0]]></USAGE>
<USED><![CDATA[0]]></USED>
</MEMORY>
<NODE_ID><![CDATA[0]]></NODE_ID>
</NODE>
</NUMA_NODES>
</HOST_SHARE>
<VMS>
<ID>9</ID>
</VMS>
<TEMPLATE>
<ARCH><![CDATA[x86_64]]></ARCH>
<CLUSTER_ID><![CDATA[0]]></CLUSTER_ID>
<CPUSPEED><![CDATA[2394]]></CPUSPEED>
<ERROR><![CDATA[Wed Apr 21 20:31:09 2021 : Error monitoring Host 172.16.100.52 (1): ]]></ERROR>
<HOSTNAME><![CDATA[one-kvm2]]></HOSTNAME>
<HYPERVISOR><![CDATA[kvm]]></HYPERVISOR>
<IM_MAD><![CDATA[kvm]]></IM_MAD>
<KVM_CPU_MODEL><![CDATA[Westmere]]></KVM_CPU_MODEL>
<KVM_CPU_MODELS><![CDATA[486 pentium pentium2 pentium3 pentiumpro coreduo n270 core2duo qemu32 kvm32 cpu64-rhel5 cpu64-rhel6 qemu64 kvm64 Conroe Penryn Nehalem Nehalem-IBRS Westmere Westmere-IBRS SandyBridge SandyBridge-IBRS IvyBridge IvyBridge-IBRS Haswell-noTSX Haswell-noTSX-IBRS Haswell Haswell-IBRS Broadwell-noTSX Broadwell-noTSX-IBRS Broadwell Broadwell-IBRS Skylake-Client Skylake-Client-IBRS Skylake-Client-noTSX-IBRS Skylake-Server Skylake-Server-IBRS Skylake-Server-noTSX-IBRS Cascadelake-Server Cascadelake-Server-noTSX Icelake-Client Icelake-Client-noTSX Icelake-Server Icelake-Server-noTSX athlon phenom Opteron_G1 Opteron_G2 Opteron_G3 Opteron_G4 Opteron_G5 EPYC EPYC-IBPB EPYC-Rome Dhyana]]></KVM_CPU_MODELS>
<KVM_MACHINES><![CDATA[pc-i440fx-focal ubuntu pc-0.15 pc-i440fx-2.12 pc-i440fx-2.0 pc-i440fx-xenial pc-q35-4.2 q35 pc-i440fx-2.5 pc-i440fx-4.2 pc pc-q35-xenial pc-i440fx-1.5 pc-0.12 pc-q35-2.7 pc-q35-eoan-hpb pc-i440fx-disco-hpb pc-i440fx-zesty pc-q35-artful pc-i440fx-trusty pc-i440fx-2.2 pc-i440fx-eoan-hpb pc-q35-focal-hpb pc-1.1 pc-q35-bionic-hpb pc-i440fx-artful pc-i440fx-2.7 pc-i440fx-yakkety pc-q35-2.4 pc-q35-cosmic-hpb pc-q35-2.10 pc-i440fx-1.7 pc-0.14 pc-q35-2.9 pc-i440fx-2.11 pc-q35-3.1 pc-q35-4.1 pc-i440fx-2.4 pc-1.3 pc-i440fx-4.1 pc-q35-eoan pc-i440fx-2.9 pc-i440fx-bionic-hpb isapc pc-i440fx-1.4 pc-q35-cosmic pc-q35-2.6 pc-i440fx-3.1 pc-q35-bionic pc-q35-disco-hpb pc-i440fx-cosmic pc-q35-2.12 pc-i440fx-bionic pc-q35-disco pc-i440fx-cosmic-hpb pc-i440fx-2.1 pc-1.0 pc-i440fx-wily pc-i440fx-2.6 pc-q35-4.0.1 pc-i440fx-1.6 pc-0.13 pc-q35-2.8 pc-i440fx-2.10 pc-q35-3.0 pc-q35-zesty pc-q35-4.0 microvm pc-i440fx-2.3 pc-q35-focal ubuntu-q35 pc-i440fx-disco pc-1.2 pc-i440fx-4.0 pc-i440fx-focal-hpb pc-i440fx-2.8 pc-i440fx-eoan pc-q35-2.5 pc-i440fx-3.0 pc-q35-yakkety pc-q35-2.11]]></KVM_MACHINES>
<MODELNAME><![CDATA[Intel(R) Xeon(R) CPU E7- 4870 @ 2.40GHz]]></MODELNAME>
<NAME><![CDATA[172.16.100.52]]></NAME>
<RESERVED_CPU><![CDATA[]]></RESERVED_CPU>
<RESERVED_MEM><![CDATA[]]></RESERVED_MEM>
<VERSION><![CDATA[6.0.0]]></VERSION>
<VM_MAD><![CDATA[kvm]]></VM_MAD>
</TEMPLATE>
<MONITORING/>
</HOST> -m -p 5
EXIT CODE : 1
EXECUTION STDOUT
EXECUTION STDERR
/usr/lib/ruby/2.7.0/base64.rb:59:in `decode64': undefined method `unpack1' for nil:NilClass (NoMethodError)
from /var/tmp/one/hooks/ft/host_error.rb:78:in `<main>
I am genuinely lost in this, and any help would be really helpful.
feldsam
April 22, 2021, 8:07am
2
Hi, looks like there is a problem with arguments. The host_error.rb is excepting base64 encoded data passed via stdin, but hook passes it as a normal argument.
You can try to remove lines 75 and 76 from this file https://github.com/OpenNebula/one/blob/master/share/hooks/ft/host_error.rb
UPDATE:ARGUMENTS_STDIN = yes
You need to use it when creating hook, so base64 encoded argument will be passed via stdin
So your hook template should looks like this
ARGUMENTS = "$TEMPLATE -m -p 5"
ARGUMENTS_STDIN = yes
COMMAND = "/var/tmp/one/hooks/ft/host_error.rb"
NAME = "host_error"
STATE = "ERROR"
REMOTE = "no"
RESOURCE = HOST
TYPE = state
Luis
April 22, 2021, 3:06pm
3
Hello Kristian,
Thanks for your suggestion. Now I have the meaning of the error clearer. So I follow up with what you shared, first I added ARGUMENTS_STDIN = yes to my hook template. Sadly when I tested the hook I received the following in /var/log/one/onehem.log
Thu Apr 22 14:51:02 2021 [E]: Failure executing hook 3 for HOST/ERROR/
Thu Apr 22 15:00:32 2021 [I]: Executing hook 3 for HOST/ERROR/
Thu Apr 22 15:00:34 2021 [E]: Failure executing hook 3 for HOST/ERROR/
After this I ran onehook show 3 -e 0 and got the following
HOOK 3 INFORMATION
ID : 3
NAME : host_error
TYPE : state
LOCK : None
HOOK EXECUTION RECORD
EXECUTION ID : 0
TIMESTAMP : 04/22 14:51:02
COMMAND : /var/tmp/one/hooks/ft/host_error.rb
ARGUMENTS : <HOST>
<ID>0</ID>
<NAME>172.16.100.51</NAME>
<STATE>3</STATE>
<PREV_STATE>2</PREV_STATE>
<IM_MAD><![CDATA[kvm]]></IM_MAD>
<VM_MAD><![CDATA[kvm]]></VM_MAD>
<CLUSTER_ID>0</CLUSTER_ID>
<CLUSTER>default</CLUSTER>
<HOST_SHARE>
<MEM_USAGE>131072</MEM_USAGE>
<CPU_USAGE>100</CPU_USAGE>
<TOTAL_MEM>16398032</TOTAL_MEM>
<TOTAL_CPU>400</TOTAL_CPU>
<MAX_MEM>16398032</MAX_MEM>
<MAX_CPU>400</MAX_CPU>
<RUNNING_VMS>1</RUNNING_VMS>
<VMS_THREAD>1</VMS_THREAD>
<DATASTORES>
<DISK_USAGE><![CDATA[0]]></DISK_USAGE>
<DS>
<FREE_MB><![CDATA[38780]]></FREE_MB>
<ID><![CDATA[0]]></ID>
<TOTAL_MB><![CDATA[49637]]></TOTAL_MB>
<USED_MB><![CDATA[8308]]></USED_MB>
</DS>
<FREE_DISK><![CDATA[40032]]></FREE_DISK>
<MAX_DISK><![CDATA[49637]]></MAX_DISK>
<USED_DISK><![CDATA[7055]]></USED_DISK>
</DATASTORES>
<PCI_DEVICES/>
<NUMA_NODES>
<NODE>
<CORE>
<CPUS><![CDATA[3:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[1]]></FREE>
<ID><![CDATA[0]]></ID>
</CORE>
<HUGEPAGE>
<FREE><![CDATA[0]]></FREE>
<PAGES><![CDATA[0]]></PAGES>
<SIZE><![CDATA[2048]]></SIZE>
<USAGE><![CDATA[0]]></USAGE>
</HUGEPAGE>
<MEMORY>
<DISTANCE><![CDATA[0]]></DISTANCE>
<FREE><![CDATA[0]]></FREE>
<TOTAL><![CDATA[16398032]]></TOTAL>
<USAGE><![CDATA[0]]></USAGE>
<USED><![CDATA[0]]></USED>
</MEMORY>
<NODE_ID><![CDATA[0]]></NODE_ID>
</NODE>
</NUMA_NODES>
</HOST_SHARE>
<VMS>
<ID>9</ID>
</VMS>
<TEMPLATE>
<ARCH><![CDATA[x86_64]]></ARCH>
<CLUSTER_ID><![CDATA[0]]></CLUSTER_ID>
<CPUSPEED><![CDATA[2394]]></CPUSPEED>
<ERROR><![CDATA[Thu Apr 22 14:46:01 2021 : Error monitoring Host 172.16.100.51 (0): ]]></ERROR>
<HOSTNAME><![CDATA[one-kvm1]]></HOSTNAME>
<HYPERVISOR><![CDATA[kvm]]></HYPERVISOR>
<IM_MAD><![CDATA[kvm]]></IM_MAD>
<KVM_CPU_MODEL><![CDATA[Westmere]]></KVM_CPU_MODEL>
<KVM_CPU_MODELS><![CDATA[486 pentium pentium2 pentium3 pentiumpro coreduo n270 core2duo qemu32 kvm32 cpu64-rhel5 cpu64-rhel6 qemu64 kvm64 Conroe Penryn Nehalem Nehalem-IBRS Westmere Westmere-IBRS SandyBridge SandyBridge-IBRS IvyBridge IvyBridge-IBRS Haswell-noTSX Haswell-noTSX-IBRS Haswell Haswell-IBRS Broadwell-noTSX Broadwell-noTSX-IBRS Broadwell Broadwell-IBRS Skylake-Client Skylake-Client-IBRS Skylake-Client-noTSX-IBRS Skylake-Server Skylake-Server-IBRS Skylake-Server-noTSX-IBRS Cascadelake-Server Cascadelake-Server-noTSX Icelake-Client Icelake-Client-noTSX Icelake-Server Icelake-Server-noTSX athlon phenom Opteron_G1 Opteron_G2 Opteron_G3 Opteron_G4 Opteron_G5 EPYC EPYC-IBPB EPYC-Rome Dhyana]]></KVM_CPU_MODELS>
<KVM_MACHINES><![CDATA[pc-i440fx-focal ubuntu pc-0.15 pc-i440fx-2.12 pc-i440fx-2.0 pc-i440fx-xenial pc-q35-4.2 q35 pc-i440fx-2.5 pc-i440fx-4.2 pc pc-q35-xenial pc-i440fx-1.5 pc-0.12 pc-q35-2.7 pc-q35-eoan-hpb pc-i440fx-disco-hpb pc-i440fx-zesty pc-q35-artful pc-i440fx-trusty pc-i440fx-2.2 pc-i440fx-eoan-hpb pc-q35-focal-hpb pc-1.1 pc-q35-bionic-hpb pc-i440fx-artful pc-i440fx-2.7 pc-i440fx-yakkety pc-q35-2.4 pc-q35-cosmic-hpb pc-q35-2.10 pc-i440fx-1.7 pc-0.14 pc-q35-2.9 pc-i440fx-2.11 pc-q35-3.1 pc-q35-4.1 pc-i440fx-2.4 pc-1.3 pc-i440fx-4.1 pc-q35-eoan pc-i440fx-2.9 pc-i440fx-bionic-hpb isapc pc-i440fx-1.4 pc-q35-cosmic pc-q35-2.6 pc-i440fx-3.1 pc-q35-bionic pc-q35-disco-hpb pc-i440fx-cosmic pc-q35-2.12 pc-i440fx-bionic pc-q35-disco pc-i440fx-cosmic-hpb pc-i440fx-2.1 pc-1.0 pc-i440fx-wily pc-i440fx-2.6 pc-q35-4.0.1 pc-i440fx-1.6 pc-0.13 pc-q35-2.8 pc-i440fx-2.10 pc-q35-3.0 pc-q35-zesty pc-q35-4.0 microvm pc-i440fx-2.3 pc-q35-focal ubuntu-q35 pc-i440fx-disco pc-1.2 pc-i440fx-4.0 pc-i440fx-focal-hpb pc-i440fx-2.8 pc-i440fx-eoan pc-q35-2.5 pc-i440fx-3.0 pc-q35-yakkety pc-q35-2.11]]></KVM_MACHINES>
<MODELNAME><![CDATA[Intel(R) Xeon(R) CPU E7- 4870 @ 2.40GHz]]></MODELNAME>
<NAME><![CDATA[172.16.100.51]]></NAME>
<RESERVED_CPU><![CDATA[]]></RESERVED_CPU>
<RESERVED_MEM><![CDATA[]]></RESERVED_MEM>
<TOTAL_ZOMBIES><![CDATA[1]]></TOTAL_ZOMBIES>
<VERSION><![CDATA[6.0.0]]></VERSION>
<VM_MAD><![CDATA[kvm]]></VM_MAD>
<ZOMBIES><![CDATA[8]]></ZOMBIES>
</TEMPLATE>
<MONITORING/>
</HOST> -m -p 5
EXIT CODE : 255
EXECUTION STDOUT
EXECUTION STDERR
Now it does not return anything. I’m genuinely quite lost, I do not know if I am the one looking for the information in the wrong side of the doc, of if the doc is a little bit hard to find.
rdiaz
April 26, 2021, 6:58am
4
Hello @Luis ,
First of all, I recommend you to use a relative path in COMMAND, this way OpenNebula will search in /var/lib/one/remotes/hooks.
If you take a look at file /var/lib/one/remotes/hooks/ft/host_error.rb, you’ll see that the script fence_host.sh in the same subfolder is called. And if you take a look at /var/lib/one/remotes/hooks/ft/host_error.rb, you’ll see this disclaimer: This script needs to be modified to enable fencing of the host. By default it will fail, as the first line is 'exit 1'. You will need to remove it. Therefore, you need to adapt it depending on the fencing tool you are going to use.
In your case, it is failing because you probably don’t have the /var/tmp/one/hooks/ft/fence_host.sh script and therefore the exit code is 255 instead of 1.
To properly configure host_error hook follow the steps below:
Make a copy of the of ft folder (to avoid overwriting your modifications by opennebula packages): cp -rp /var/lib/one/remotes/hooks/ft /var/lib/one/remotes/hooks/myft (myft or whatever name you want).
Customize the /var/lib/one/remotes/hooks/myft/fence_host.sh script.
Create a hook template similar to this (host_error.tmpl):
ARGUMENTS = "$TEMPLATE -m -p 5"
ARGUMENTS_STDIN = yes
COMMAND = "myft/host_error.rb"
NAME = "host_error"
STATE = "ERROR"
REMOTE = "no"
RESOURCE = HOST
TYPE = state
Register the hook: onehook create hook_error.tmpl.
Cheers.
kamilkobak
September 13, 2021, 10:47am
5
I have the same problem on OpenNebula 6.0.3 and CentOS 7/8
[root@node1 ~]# onezone show 0
ZONE 0 INFORMATION
ID : 0
NAME : OpenNebula
ZONE SERVERS
ID NAME ENDPOINT
2 server-0 http://node1.nebula.lab:2633/RPC2
3 server-1 http://node3.nebula.lab:2633/RPC2
4 server-10 http://node10.nebula.lab:2633/RPC2
HA & FEDERATION SYNC STATUS
ID NAME STATE TERM INDEX COMMIT VOTE FED_INDEX
2 server-0 follower 2147 49605 49605 3 -1
3 server-1 leader 2147 49605 49605 3 -1
4 server-10 follower 2147 49605 49605 -1 -1
ZONE TEMPLATE
ENDPOINT="http://localhost:2633/RPC2"
and hooks:
[root@node1 ~]# onehook show 1 -e 21
HOOK 1 INFORMATION
ID : 1
NAME : host_error
TYPE : state
LOCK : None
HOOK EXECUTION RECORD
EXECUTION ID : 21
TIMESTAMP : 09/10 18:05:58
COMMAND : /var/lib/one/remotes/hooks/ft/host_error.rb PEhPU1Q+CiAgPElEPjEyPC9JRD4KICA8TkFNRT5ub2RlMTAubmVidWxhLmxhYjwvTkFNRT4KICA8U1RBVEU+MzwvU1RBVEU+CiAgPFBSRVZfU1RBVEU+MjwvUFJFVl9TVEFURT4KICA8SU1fTUFEPjwhW0NEQVRBW2t2bV1dPjwvSU1fTUFEPgogIDxWTV9NQUQ+PCFbQ0RBVEFba3ZtXV0+PC9WTV9NQUQ+CiAgPENMVVNURVJfSUQ+MDwvQ0xVU1RFUl9JRD4KICA8Q0xVU1RFUj5kZWZhdWx0PC9DTFVTVEVSPgogIDxIT1NUX1NIQVJFPgogICAgPE1FTV9VU0FHRT43ODY0MzI8L01FTV9VU0FHRT4KICAgIDxDUFVfVVNBR0U+MTAwPC9DUFVfVVNBR0U+CiAgICA8VE9UQUxfTUVNPjI2Mzg0NzA3MjwvVE9UQUxfTUVNPgogICAgPFRPVEFMX0NQVT41NjAwPC9UT1RBTF9DUFU+CiAgICA8TUFYX01FTT4yNjM4NDcwNzI8L01BWF9NRU0+CiAgICA8TUFYX0NQVT41NjAwPC9NQVhfQ1BVPgogICAgPFJVTk5JTkdfVk1TPjE8L1JVTk5JTkdfVk1TPgogICAgPFZNU19USFJFQUQ+MTwvVk1TX1RIUkVBRD4KICAgIDxEQVRBU1RPUkVTPgogICAgICA8RElTS19VU0FHRT48IVtDREFUQVswXV0+PC9ESVNLX1VTQUdFPgogICAgICA8RlJFRV9ESVNLPjwhW0NEQVRBWzQ2NTYxXV0+PC9GUkVFX0RJU0s+CiAgICAgIDxNQVhfRElTSz48IVtDREFUQVs1MTE3NV1dPjwvTUFYX0RJU0s+CiAgICAgIDxVU0VEX0RJU0s+PCFbQ0RBVEFbNDYxNV1dPjwvVVNFRF9ESVNLPgogICAgPC9EQVRBU1RPUkVTPgogICAgPFBDSV9ERVZJQ0VTLz4KICAgIDxOVU1BX05PREVTPgogICAgICA8Tk9ERT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzA6LTEsMjg6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzBdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzE6LTEsMjk6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzFdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzI6LTEsMzA6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzJdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzM6LTEsMzE6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzNdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzQ6LTEsMzI6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzRdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzU6LTEsMzM6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzVdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzY6LTEsMzQ6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzZdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzc6LTEsMzU6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzhdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzg6LTEsMzY6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzldXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzk6LTEsMzc6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzEwXV0+PC9JRD4KICAgICAgICA8L0NPUkU+CiAgICAgICAgPENPUkU+CiAgICAgICAgICA8Q1BVUz48IVtDREFUQVsxMDotMSwzODotMV1dPjwvQ1BVUz4KICAgICAgICAgIDxERURJQ0FURUQ+PCFbQ0RBVEFbTk9dXT48L0RFRElDQVRFRD4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzJdXT48L0ZSRUU+CiAgICAgICAgICA8SUQ+PCFbQ0RBVEFbMTFdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzExOi0xLDM5Oi0xXV0+PC9DUFVTPgogICAgICAgICAgPERFRElDQVRFRD48IVtDREFUQVtOT11dPjwvREVESUNBVEVEPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMl1dPjwvRlJFRT4KICAgICAgICAgIDxJRD48IVtDREFUQVsxMl1dPjwvSUQ+CiAgICAgICAgPC9DT1JFPgogICAgICAgIDxDT1JFPgogICAgICAgICAgPENQVVM+PCFbQ0RBVEFbMTI6LTEsNDA6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzEzXV0+PC9JRD4KICAgICAgICA8L0NPUkU+CiAgICAgICAgPENPUkU+CiAgICAgICAgICA8Q1BVUz48IVtDREFUQVsxMzotMSw0MTotMV1dPjwvQ1BVUz4KICAgICAgICAgIDxERURJQ0FURUQ+PCFbQ0RBVEFbTk9dXT48L0RFRElDQVRFRD4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzJdXT48L0ZSRUU+CiAgICAgICAgICA8SUQ+PCFbQ0RBVEFbMTRdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8SFVHRVBBR0U+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVswXV0+PC9GUkVFPgogICAgICAgICAgPFBBR0VTPjwhW0NEQVRBWzBdXT48L1BBR0VTPgogICAgICAgICAgPFNJWkU+PCFbQ0RBVEFbMTA0ODU3Nl1dPjwvU0laRT4KICAgICAgICAgIDxVU0FHRT48IVtDREFUQVswXV0+PC9VU0FHRT4KICAgICAgICA8L0hVR0VQQUdFPgogICAgICAgIDxIVUdFUEFHRT4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzBdXT48L0ZSRUU+CiAgICAgICAgICA8UEFHRVM+PCFbQ0RBVEFbMF1dPjwvUEFHRVM+CiAgICAgICAgICA8U0laRT48IVtDREFUQVsyMDQ4XV0+PC9TSVpFPgogICAgICAgICAgPFVTQUdFPjwhW0NEQVRBWzBdXT48L1VTQUdFPgogICAgICAgIDwvSFVHRVBBR0U+CiAgICAgICAgPE1FTU9SWT4KICAgICAgICAgIDxESVNUQU5DRT48IVtDREFUQVswIDFdXT48L0RJU1RBTkNFPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMF1dPjwvRlJFRT4KICAgICAgICAgIDxUT1RBTD48IVtDREFUQVsxMzE3MzE1MTZdXT48L1RPVEFMPgogICAgICAgICAgPFVTQUdFPjwhW0NEQVRBWzBdXT48L1VTQUdFPgogICAgICAgICAgPFVTRUQ+PCFbQ0RBVEFbMF1dPjwvVVNFRD4KICAgICAgICA8L01FTU9SWT4KICAgICAgICA8Tk9ERV9JRD48IVtDREFUQVswXV0+PC9OT0RFX0lEPgogICAgICA8L05PREU+CiAgICAgIDxOT0RFPgogICAgICAgIDxDT1JFPgogICAgICAgICAgPENQVVM+PCFbQ0RBVEFbMTQ6LTEsNDI6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzBdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzE1Oi0xLDQzOi0xXV0+PC9DUFVTPgogICAgICAgICAgPERFRElDQVRFRD48IVtDREFUQVtOT11dPjwvREVESUNBVEVEPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMl1dPjwvRlJFRT4KICAgICAgICAgIDxJRD48IVtDREFUQVsxXV0+PC9JRD4KICAgICAgICA8L0NPUkU+CiAgICAgICAgPENPUkU+CiAgICAgICAgICA8Q1BVUz48IVtDREFUQVsxNjotMSw0NDotMV1dPjwvQ1BVUz4KICAgICAgICAgIDxERURJQ0FURUQ+PCFbQ0RBVEFbTk9dXT48L0RFRElDQVRFRD4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzJdXT48L0ZSRUU+CiAgICAgICAgICA8SUQ+PCFbQ0RBVEFbMl1dPjwvSUQ+CiAgICAgICAgPC9DT1JFPgogICAgICAgIDxDT1JFPgogICAgICAgICAgPENQVVM+PCFbQ0RBVEFbMTc6LTEsNDU6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzNdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzE4Oi0xLDQ2Oi0xXV0+PC9DUFVTPgogICAgICAgICAgPERFRElDQVRFRD48IVtDREFUQVtOT11dPjwvREVESUNBVEVEPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMl1dPjwvRlJFRT4KICAgICAgICAgIDxJRD48IVtDREFUQVs0XV0+PC9JRD4KICAgICAgICA8L0NPUkU+CiAgICAgICAgPENPUkU+CiAgICAgICAgICA8Q1BVUz48IVtDREFUQVsxOTotMSw0NzotMV1dPjwvQ1BVUz4KICAgICAgICAgIDxERURJQ0FURUQ+PCFbQ0RBVEFbTk9dXT48L0RFRElDQVRFRD4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzJdXT48L0ZSRUU+CiAgICAgICAgICA8SUQ+PCFbQ0RBVEFbNV1dPjwvSUQ+CiAgICAgICAgPC9DT1JFPgogICAgICAgIDxDT1JFPgogICAgICAgICAgPENQVVM+PCFbQ0RBVEFbMjA6LTEsNDg6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzZdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzIxOi0xLDQ5Oi0xXV0+PC9DUFVTPgogICAgICAgICAgPERFRElDQVRFRD48IVtDREFUQVtOT11dPjwvREVESUNBVEVEPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMl1dPjwvRlJFRT4KICAgICAgICAgIDxJRD48IVtDREFUQVs4XV0+PC9JRD4KICAgICAgICA8L0NPUkU+CiAgICAgICAgPENPUkU+CiAgICAgICAgICA8Q1BVUz48IVtDREFUQVsyMjotMSw1MDotMV1dPjwvQ1BVUz4KICAgICAgICAgIDxERURJQ0FURUQ+PCFbQ0RBVEFbTk9dXT48L0RFRElDQVRFRD4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzJdXT48L0ZSRUU+CiAgICAgICAgICA8SUQ+PCFbQ0RBVEFbOV1dPjwvSUQ+CiAgICAgICAgPC9DT1JFPgogICAgICAgIDxDT1JFPgogICAgICAgICAgPENQVVM+PCFbQ0RBVEFbMjM6LTEsNTE6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzEwXV0+PC9JRD4KICAgICAgICA8L0NPUkU+CiAgICAgICAgPENPUkU+CiAgICAgICAgICA8Q1BVUz48IVtDREFUQVsyNDotMSw1MjotMV1dPjwvQ1BVUz4KICAgICAgICAgIDxERURJQ0FURUQ+PCFbQ0RBVEFbTk9dXT48L0RFRElDQVRFRD4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzJdXT48L0ZSRUU+CiAgICAgICAgICA8SUQ+PCFbQ0RBVEFbMTFdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8Q09SRT4KICAgICAgICAgIDxDUFVTPjwhW0NEQVRBWzI1Oi0xLDUzOi0xXV0+PC9DUFVTPgogICAgICAgICAgPERFRElDQVRFRD48IVtDREFUQVtOT11dPjwvREVESUNBVEVEPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMl1dPjwvRlJFRT4KICAgICAgICAgIDxJRD48IVtDREFUQVsxMl1dPjwvSUQ+CiAgICAgICAgPC9DT1JFPgogICAgICAgIDxDT1JFPgogICAgICAgICAgPENQVVM+PCFbQ0RBVEFbMjY6LTEsNTQ6LTFdXT48L0NQVVM+CiAgICAgICAgICA8REVESUNBVEVEPjwhW0NEQVRBW05PXV0+PC9ERURJQ0FURUQ+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVsyXV0+PC9GUkVFPgogICAgICAgICAgPElEPjwhW0NEQVRBWzEzXV0+PC9JRD4KICAgICAgICA8L0NPUkU+CiAgICAgICAgPENPUkU+CiAgICAgICAgICA8Q1BVUz48IVtDREFUQVsyNzotMSw1NTotMV1dPjwvQ1BVUz4KICAgICAgICAgIDxERURJQ0FURUQ+PCFbQ0RBVEFbTk9dXT48L0RFRElDQVRFRD4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzJdXT48L0ZSRUU+CiAgICAgICAgICA8SUQ+PCFbQ0RBVEFbMTRdXT48L0lEPgogICAgICAgIDwvQ09SRT4KICAgICAgICA8SFVHRVBBR0U+CiAgICAgICAgICA8RlJFRT48IVtDREFUQVswXV0+PC9GUkVFPgogICAgICAgICAgPFBBR0VTPjwhW0NEQVRBWzBdXT48L1BBR0VTPgogICAgICAgICAgPFNJWkU+PCFbQ0RBVEFbMTA0ODU3Nl1dPjwvU0laRT4KICAgICAgICAgIDxVU0FHRT48IVtDREFUQVswXV0+PC9VU0FHRT4KICAgICAgICA8L0hVR0VQQUdFPgogICAgICAgIDxIVUdFUEFHRT4KICAgICAgICAgIDxGUkVFPjwhW0NEQVRBWzBdXT48L0ZSRUU+CiAgICAgICAgICA8UEFHRVM+PCFbQ0RBVEFbMF1dPjwvUEFHRVM+CiAgICAgICAgICA8U0laRT48IVtDREFUQVsyMDQ4XV0+PC9TSVpFPgogICAgICAgICAgPFVTQUdFPjwhW0NEQVRBWzBdXT48L1VTQUdFPgogICAgICAgIDwvSFVHRVBBR0U+CiAgICAgICAgPE1FTU9SWT4KICAgICAgICAgIDxESVNUQU5DRT48IVtDREFUQVsxIDBdXT48L0RJU1RBTkNFPgogICAgICAgICAgPEZSRUU+PCFbQ0RBVEFbMF1dPjwvRlJFRT4KICAgICAgICAgIDxUT1RBTD48IVtDREFUQVsxMzIxMTU1NTZdXT48L1RPVEFMPgogICAgICAgICAgPFVTQUdFPjwhW0NEQVRBWzBdXT48L1VTQUdFPgogICAgICAgICAgPFVTRUQ+PCFbQ0RBVEFbMF1dPjwvVVNFRD4KICAgICAgICA8L01FTU9SWT4KICAgICAgICA8Tk9ERV9JRD48IVtDREFUQVsxXV0+PC9OT0RFX0lEPgogICAgICA8L05PREU+CiAgICA8L05VTUFfTk9ERVM+CiAgPC9IT1NUX1NIQVJFPgogIDxWTVM+CiAgICA8SUQ+OTwvSUQ+CiAgPC9WTVM+CiAgPFRFTVBMQVRFPgogICAgPEFSQ0g+PCFbQ0RBVEFbeDg2XzY0XV0+PC9BUkNIPgogICAgPENMVVNURVJfSUQ+PCFbQ0RBVEFbMF1dPjwvQ0xVU1RFUl9JRD4KICAgIDxDUFVTUEVFRD48IVtDREFUQVsxMjAwXV0+PC9DUFVTUEVFRD4KICAgIDxFUlJPUj48IVtDREFUQVtGcmkgU2VwIDEwIDE4OjA1OjU4IDIwMjEgOiBFcnJvciBtb25pdG9yaW5nIEhvc3Qgbm9kZTEwLm5lYnVsYS5sYWIgKDEyKTogXV0+PC9FUlJPUj4KICAgIDxIT1NUTkFNRT48IVtDREFUQVtub2RlMTAubmVidWxhLmxhYl1dPjwvSE9TVE5BTUU+CiAgICA8SFlQRVJWSVNPUj48IVtDREFUQVtrdm1dXT48L0hZUEVSVklTT1I+CiAgICA8SU1fTUFEPjwhW0NEQVRBW2t2bV1dPjwvSU1fTUFEPgogICAgPEtWTV9DUFVfTU9ERUw+PCFbQ0RBVEFbQnJvYWR3ZWxsLUlCUlNdXT48L0tWTV9DUFVfTU9ERUw+CiAgICA8S1ZNX0NQVV9NT0RFTFM+PCFbQ0RBVEFbNDg2IHBlbnRpdW0gcGVudGl1bTIgcGVudGl1bTMgcGVudGl1bXBybyBjb3JlZHVvIG4yNzAgY29yZTJkdW8gcWVtdTMyIGt2bTMyIGNwdTY0LXJoZWw1IGNwdTY0LXJoZWw2IGt2bTY0IHFlbXU2NCBDb25yb2UgUGVucnluIE5laGFsZW0gTmVoYWxlbS1JQlJTIFdlc3RtZXJlIFdlc3RtZXJlLUlCUlMgU2FuZHlCcmlkZ2UgU2FuZHlCcmlkZ2UtSUJSUyBJdnlCcmlkZ2UgSXZ5QnJpZGdlLUlCUlMgSGFzd2VsbC1ub1RTWCBIYXN3ZWxsLW5vVFNYLUlCUlMgSGFzd2VsbCBIYXN3ZWxsLUlCUlMgQnJvYWR3ZWxsLW5vVFNYIEJyb2Fkd2VsbC1ub1RTWC1JQlJTIEJyb2Fkd2VsbCBCcm9hZHdlbGwtSUJSUyBTa3lsYWtlLUNsaWVudCBTa3lsYWtlLUNsaWVudC1JQlJTIFNreWxha2UtU2VydmVyIFNreWxha2UtU2VydmVyLUlCUlMgSWNlbGFrZS1DbGllbnQgSWNlbGFrZS1TZXJ2ZXIgYXRobG9uIHBoZW5vbSBPcHRlcm9uX0cxIE9wdGVyb25fRzIgT3B0ZXJvbl9HMyBPcHRlcm9uX0c0IE9wdGVyb25fRzUgRVBZQyBFUFlDLUlCUEJdXT48L0tWTV9DUFVfTU9ERUxTPgogICAgPEtWTV9NQUNISU5FUz48IVtDREFUQVtwYy1pNDQwZngtcmhlbDcuMC4wIHBjIHJoZWw2LjAuMCByaGVsNi4xLjAgcmhlbDYuMi4wIHJoZWw2LjMuMCByaGVsNi40LjAgcmhlbDYuNS4wIHJoZWw2LjYuMF1dPjwvS1ZNX01BQ0hJTkVTPgogICAgPE1PREVMTkFNRT48IVtDREFUQVtJbnRlbChSKSBYZW9uKFIpIENQVSBFNS0yNjgwIHY0IEAgMi40MEdIel1dPjwvTU9ERUxOQU1FPgogICAgPE5BTUU+PCFbQ0RBVEFbbm9kZTEwLm5lYnVsYS5sYWJdXT48L05BTUU+CiAgICA8UkVTRVJWRURfQ1BVPjwhW0NEQVRBW11dPjwvUkVTRVJWRURfQ1BVPgogICAgPFJFU0VSVkVEX01FTT48IVtDREFUQVtdXT48L1JFU0VSVkVEX01FTT4KICAgIDxWRVJTSU9OPjwhW0NEQVRBWzYuMC4wLjJdXT48L1ZFUlNJT04+CiAgICA8Vk1fTUFEPjwhW0NEQVRBW2t2bV1dPjwvVk1fTUFEPgogIDwvVEVNUExBVEU+CiAgPE1PTklUT1JJTkcvPgo8L0hPU1Q+ -m -p 5 -u
ARGUMENTS : <HOST>
<ID>12</ID>
<NAME>node10.nebula.lab</NAME>
<STATE>3</STATE>
<PREV_STATE>2</PREV_STATE>
<IM_MAD><![CDATA[kvm]]></IM_MAD>
<VM_MAD><![CDATA[kvm]]></VM_MAD>
<CLUSTER_ID>0</CLUSTER_ID>
<CLUSTER>default</CLUSTER>
<HOST_SHARE>
<MEM_USAGE>786432</MEM_USAGE>
<CPU_USAGE>100</CPU_USAGE>
<TOTAL_MEM>263847072</TOTAL_MEM>
<TOTAL_CPU>5600</TOTAL_CPU>
<MAX_MEM>263847072</MAX_MEM>
<MAX_CPU>5600</MAX_CPU>
<RUNNING_VMS>1</RUNNING_VMS>
<VMS_THREAD>1</VMS_THREAD>
<DATASTORES>
<DISK_USAGE><![CDATA[0]]></DISK_USAGE>
<FREE_DISK><![CDATA[46561]]></FREE_DISK>
<MAX_DISK><![CDATA[51175]]></MAX_DISK>
<USED_DISK><![CDATA[4615]]></USED_DISK>
</DATASTORES>
<PCI_DEVICES/>
<NUMA_NODES>
<NODE>
<CORE>
<CPUS><![CDATA[0:-1,28:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[0]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[1:-1,29:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[1]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[2:-1,30:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[2]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[3:-1,31:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[3]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[4:-1,32:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[4]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[5:-1,33:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[5]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[6:-1,34:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[6]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[7:-1,35:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[8]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[8:-1,36:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[9]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[9:-1,37:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[10]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[10:-1,38:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[11]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[11:-1,39:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[12]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[12:-1,40:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[13]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[13:-1,41:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[14]]></ID>
</CORE>
<HUGEPAGE>
<FREE><![CDATA[0]]></FREE>
<PAGES><![CDATA[0]]></PAGES>
<SIZE><![CDATA[1048576]]></SIZE>
<USAGE><![CDATA[0]]></USAGE>
</HUGEPAGE>
<HUGEPAGE>
<FREE><![CDATA[0]]></FREE>
<PAGES><![CDATA[0]]></PAGES>
<SIZE><![CDATA[2048]]></SIZE>
<USAGE><![CDATA[0]]></USAGE>
</HUGEPAGE>
<MEMORY>
<DISTANCE><![CDATA[0 1]]></DISTANCE>
<FREE><![CDATA[0]]></FREE>
<TOTAL><![CDATA[131731516]]></TOTAL>
<USAGE><![CDATA[0]]></USAGE>
<USED><![CDATA[0]]></USED>
</MEMORY>
<NODE_ID><![CDATA[0]]></NODE_ID>
</NODE>
<NODE>
<CORE>
<CPUS><![CDATA[14:-1,42:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[0]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[15:-1,43:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[1]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[16:-1,44:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[2]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[17:-1,45:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[3]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[18:-1,46:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[4]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[19:-1,47:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[5]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[20:-1,48:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[6]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[21:-1,49:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[8]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[22:-1,50:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[9]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[23:-1,51:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[10]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[24:-1,52:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[11]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[25:-1,53:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[12]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[26:-1,54:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[13]]></ID>
</CORE>
<CORE>
<CPUS><![CDATA[27:-1,55:-1]]></CPUS>
<DEDICATED><![CDATA[NO]]></DEDICATED>
<FREE><![CDATA[2]]></FREE>
<ID><![CDATA[14]]></ID>
</CORE>
<HUGEPAGE>
<FREE><![CDATA[0]]></FREE>
<PAGES><![CDATA[0]]></PAGES>
<SIZE><![CDATA[1048576]]></SIZE>
<USAGE><![CDATA[0]]></USAGE>
</HUGEPAGE>
<HUGEPAGE>
<FREE><![CDATA[0]]></FREE>
<PAGES><![CDATA[0]]></PAGES>
<SIZE><![CDATA[2048]]></SIZE>
<USAGE><![CDATA[0]]></USAGE>
</HUGEPAGE>
<MEMORY>
<DISTANCE><![CDATA[1 0]]></DISTANCE>
<FREE><![CDATA[0]]></FREE>
<TOTAL><![CDATA[132115556]]></TOTAL>
<USAGE><![CDATA[0]]></USAGE>
<USED><![CDATA[0]]></USED>
</MEMORY>
<NODE_ID><![CDATA[1]]></NODE_ID>
</NODE>
</NUMA_NODES>
</HOST_SHARE>
<VMS>
<ID>9</ID>
</VMS>
<TEMPLATE>
<ARCH><![CDATA[x86_64]]></ARCH>
<CLUSTER_ID><![CDATA[0]]></CLUSTER_ID>
<CPUSPEED><![CDATA[1200]]></CPUSPEED>
<ERROR><![CDATA[Fri Sep 10 18:05:58 2021 : Error monitoring Host node10.nebula.lab (12): ]]></ERROR>
<HOSTNAME><![CDATA[node10.nebula.lab]]></HOSTNAME>
<HYPERVISOR><![CDATA[kvm]]></HYPERVISOR>
<IM_MAD><![CDATA[kvm]]></IM_MAD>
<KVM_CPU_MODEL><![CDATA[Broadwell-IBRS]]></KVM_CPU_MODEL>
<KVM_CPU_MODELS><![CDATA[486 pentium pentium2 pentium3 pentiumpro coreduo n270 core2duo qemu32 kvm32 cpu64-rhel5 cpu64-rhel6 kvm64 qemu64 Conroe Penryn Nehalem Nehalem-IBRS Westmere Westmere-IBRS SandyBridge SandyBridge-IBRS IvyBridge IvyBridge-IBRS Haswell-noTSX Haswell-noTSX-IBRS Haswell Haswell-IBRS Broadwell-noTSX Broadwell-noTSX-IBRS Broadwell Broadwell-IBRS Skylake-Client Skylake-Client-IBRS Skylake-Server Skylake-Server-IBRS Icelake-Client Icelake-Server athlon phenom Opteron_G1 Opteron_G2 Opteron_G3 Opteron_G4 Opteron_G5 EPYC EPYC-IBPB]]></KVM_CPU_MODELS>
<KVM_MACHINES><![CDATA[pc-i440fx-rhel7.0.0 pc rhel6.0.0 rhel6.1.0 rhel6.2.0 rhel6.3.0 rhel6.4.0 rhel6.5.0 rhel6.6.0]]></KVM_MACHINES>
<MODELNAME><![CDATA[Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz]]></MODELNAME>
<NAME><![CDATA[node10.nebula.lab]]></NAME>
<RESERVED_CPU><![CDATA[]]></RESERVED_CPU>
<RESERVED_MEM><![CDATA[]]></RESERVED_MEM>
<VERSION><![CDATA[6.0.0.2]]></VERSION>
<VM_MAD><![CDATA[kvm]]></VM_MAD>
</TEMPLATE>
<MONITORING/>
</HOST> -m -p 5 -u
EXIT CODE : 1
EXECUTION STDOUT
EXECUTION STDERR
/usr/share/ruby/base64.rb:58:in `decode64': undefined method `unpack' for nil:NilClass (NoMethodError)
from /var/lib/one/remotes/hooks/ft/host_error.rb:89:in `<main>'
I checked everything and I have no idea what is wrong. What is this error?
EXECUTION STDERR
/usr/share/ruby/base64.rb:58:in `decode64': undefined method `unpack' for nil:NilClass (NoMethodError)
from /var/lib/one/remotes/hooks/ft/host_error.rb:89:in `<main>'
rdiaz
September 15, 2021, 8:44am
6
Hi @kamilkobak ,
Are you using ARGUMENTS_STDIN = yes in the hook configuration?
Cheers.
kamilkobak
September 15, 2021, 9:19am
7
rdiaz:
ARGUMENTS_STDIN = yes
yes
[root@node1 ~]# cat /usr/share/one/examples/host_hooks/error_hook
ARGUMENTS = "$TEMPLATE -m -p 5 -u"
ARGUMENTS_STDIN = yes
COMMAND = "ft/host_error.rb"
NAME = "host_error"
STATE = "ERROR"
REMOTE = "no"
RESOURCE = HOST
TYPE = state
Hello @rdiaz ,
I followed the above-mentioned steps described by you and configured the hook but the hook is not getting triggered when a host goes into ERROR state.
Here is my hook configuration,
root@frontend:~# onehook show 0
HOOK TEMPLATE
Here is fence_host.sh fence_host.sh (4.3 KB)
Here is my host list,
root@frontend:~# onehost list
Following is the log of openneula-onehem.service ,
root@frontend:~# tail -100 /var/log/one/onehem.log
rdiaz
September 22, 2021, 9:24am
9
Hi @Nikhil_Kumar ,
Can you share the output of onehook show -x 0?
Hello @rdiaz ,
Here is the output of onehook show -x 0 :
> root@frontend:~# onehook show -x 0
> <HOOK>
> <ID>0</ID>
> <NAME>host_error</NAME>
> <TYPE>state</TYPE>
> <TEMPLATE>
> <ARGUMENTS><![CDATA[$TEMPLATE -m -p 5]]></ARGUMENTS>
> <ARGUMENTS_STDIN><![CDATA[yes]]></ARGUMENTS_STDIN>
> <COMMAND><![CDATA[myft/host_error.rb]]></COMMAND>
> <REMOTE><![CDATA[NO]]></REMOTE>
> <RESOURCE><![CDATA[HOST]]></RESOURCE>ARGUMENTS_STDIN>
> <STATE><![CDATA[ERROR]]></STATE>
> </TEMPLATE>
> <HOOKLOG/>
> </HOOK>
rdiaz
September 27, 2021, 9:35am
11
Did you copypaste that output correctly? Note that the XML output seems not to be correct.
Hello @rdiaz ,
I think I did it wrong. Attaching original output.
rdiaz
October 6, 2021, 10:08am
13
Hi @Nikhil_Kumar ,
Does the /var/lib/one/remotes/hooks/myft/host_error.rb file path exist?
Cheers.
Hello @rdiaz ,
It does exist.
root@frontend:~# ls -la /var/lib/one/remotes/hooks/myft/host_error.rb
rdiaz
October 7, 2021, 12:26pm
15
Could you try running /var/lib/one/remotes/hooks/myft/host_error.rb as oneadmin?
Amit_Setia
December 29, 2021, 2:27pm
16
I have configured a SAN LVM storage.VM creation and live migration working properly. Hooks are executing successfully but VM are not getting migrated to other hosts.I stop the one host on which VM is scheduled and It stuck in "PROLOG_MIGRATE_UNKNOWN_FAILURE " state until that down host gets back online.
[root@opennebula ~]# oned -v
OpenNebula 6.2.0 (c84c3303)
Command execution failed (exit code: 255): /var/lib/one/remotes/tm/fs_lvm_ssh/mv opennebula01:/var/lib/one//datastores/104/11/disk.0 opennebula02:/var/lib/one//datastores/104/11/disk.0 11 106
Tue Dec 28 13:14:10 2021 [Z0][TrM][E]: mv: Command " set -ex -o pipefail
Tue Dec 28 13:14:10 2021 [Z0][TrM][I]: if [ -b "/dev/vg-one-104/lv-one-11-0" ]; then
Tue Dec 28 13:14:10 2021 [Z0][TrM][I]: sync
Tue Dec 28 13:14:10 2021 [Z0][TrM][I]: sudo -n lvscan
Tue Dec 28 13:14:10 2021 [Z0][TrM][I]: sudo -n lvchange -an "/dev/vg-one-104/lv-one-11-0"
Tue Dec 28 13:14:10 2021 [Z0][TrM][I]: fi
Tue Dec 28 13:14:10 2021 [Z0][TrM][I]:
Tue Dec 28 13:14:10 2021 [Z0][TrM][I]: rm -f "/var/lib/one//datastores/104/11/.host" || :" failed: ssh: connect to host opennebula01 port 22: No route to host
Tue Dec 28 13:14:10 2021 [Z0][TrM][I]: Error deactivating disk /var/lib/one//datastores/104/11/disk.0
Tue Dec 28 13:14:10 2021 [Z0][TrM][E]: Error executing image transfer script: ERROR: mv: Command " set -ex -o pipefail if [ -b "/dev/vg-one-104/lv-one-11-0" ]; then sync sudo -n lvscan sudo -n lvchange -an "/dev/vg-one-104/lv-one-11-0" fi rm -f "/var/lib/one//datastores/104/11/.host" || :" failed: ssh: connect to host opennebula01 port 22: No route to host Error deactivating disk /var/lib/one//datastores/104/11/disk.0
Tue Dec 28 13:14:10 2021 [Z0][VM][I]: New LCM state is PROLOG_MIGRATE_UNKNOWN_FAILURE
I don’t understand why it is trying to connect to node1 when it is gone away.
My question: Does SAN LVM support VM migration in host failover scenario? If yes then do i need to made any changes anywhere?
ruben
January 18, 2022, 10:18am
17
Thanks for the feedback.
You are right this specific condition was not considered in the fs_lvm_ssh driver. The fix is already in master for next release.
committed 10:09AM - 18 Jan 22 UTC
(cherry picked from commit 7fdb46a650555bc58e57f30803d5d95d09c148b4)
(cherry pic… ked from commit ce95cdf655c159ee60412f47852b23207f5c4ea4)
It is rather simple and can be applied to /var/lib/one/remotes (and after that propagate changes with onehost sync -f).
Cheers
Amit_Setia
January 29, 2022, 4:14pm
18
@ruben Thanks for your response.
Sat Jan 29 22:02:54 2022 [Z0][IPM][D]: Message received: DEPLOY FAILURE 11 error: Failed to create domain from /var/lib/one//datastores/104/11/deployment.11 error: Cannot access storage file '/var/lib/one//datastores/104/11/disk.0': No such file or directory Could not create domain from /var/lib/one//datastores/104/11/deployment.11 ExitCode: 255
Sat Jan 29 22:03:08 2022 [Z0][IPM][D]: Message received: DEPLOY FAILURE 13 error: Failed to create domain from /var/lib/one//datastores/104/13/deployment.4 error: Cannot access storage file '/var/lib/one//datastores/104/13/disk.0': No such file or directory Could not create domain from /var/lib/one//datastores/104/13/deployment.4 ExitCode: 255
Where it went wrong at this time? Will update this when i have more info.
lvchange -ay /dev/vg-one-104/lv-one-11-0
