Not sure if the right place for this is support or development, but I guess it can be moved.
I’m running 5.2 with vsphere 6 backend. All working fine, but two machines(that were created through sunstone).
This is the error that I get on getting their status:
Ignoring monitoring information, error:syntax error, unexpected $end, expecting EQUAL or EQUAL_EMPTY at line 1, columns 1:15. Monitor information was: Cloud
I have a correct id in DEPLOY_ID.
Has anyone seen a problem like this before ?
Hi!
This error is caused by a syntax error. There could be an empty field ore something similar. If you have access to the ONE frontend try to execute the ruby script and check the information values.
/var/lib/one/remotes/im/vcenter.d/vcenter.rb [host_id] [host_id] [host_id] [host_id] [host_id]
In [host_id] put the id number for that one vcenter host.
Hi!
as acolominas has suggested you, let’s gather some info in order to check what may be wrong for those VMs. As the oneadmin user could you run the following commands and post the output (removing any sensitive information that you may not want to share)?:
$ /var/lib/one/remotes/im/run_probes vcenter x x x x VCENTER_CLUSTER_NAME
$ onevm show vid_machine1
$ onevm show vid_machine2
where:
Cheers!
Below is the output from probes and onevm
/var/lib/one/remotes/im/run_probes vcenter 160 161 CloudCustomers
ERROR MESSAGE --8<------
Error executing vcenter.rb
ERROR MESSAGE ------>8--
onevm show 160
VIRTUAL MACHINE 160 INFORMATION
ID : 160
NAME : daddy1
USER : sysadmin
GROUP : asdasd
STATE : ACTIVE
LCM_STATE : UNKNOWN
RESCHED : No
HOST : CloudCustomers
CLUSTER ID : 0
CLUSTER : default
START TIME : 09/01 18:52:04
END TIME : -
DEPLOY ID : one-160
VIRTUAL MACHINE MONITORING
PERMISSIONS
OWNER : um-
GROUP : ---
OTHER : ---
VM DISKS
ID DATASTORE TARGET IMAGE SIZE TYPE SAVE
0 - hda CONTEXT -/- - -
VM NICS
ID NETWORK BRIDGE IP MAC PCI_ID
0 Public WAN Public DPort 122.27.64.142 01:01:c0:43:a4:8e
SECURITY
NIC_ID NETWORK SECURITY_GROUPS
0 Public WAN 0
SECURITY GROUP TYPE PROTOCOL NETWORK RANGE
ID NAME VNET START SIZE
0 default OUTBOUND ALL
0 default INBOUND ALL
VIRTUAL MACHINE HISTORY
SEQ HOST ACTION DS START TIME PROLOG
0 CloudCustomers nic-attach -1 09/01 18:52:33 10d 17h58m 0h00m00s
1 CloudCustomers nic-attach -1 09/12 12:51:19 0d 00h03m 0h00m00s
2 CloudCustomers none -1 09/12 12:55:14 66d 23h14m 0h00m00s
USER TEMPLATE
DESCRIPTION="Windows 2012 Server R2 x64"
HYPERVISOR="vcenter"
KEEP_DISKS_ON_DONE="NO"
LABELS="Windows"
LOGO="images/logos/windows8.png"
PASSWORD=""
PUBLIC_CLOUD=[
TYPE="vcenter",
VM_TEMPLATE="420d5483-a201-52a6-b877-49e0ccac4806" ]
USERNAME="Administrator"
USER_INPUTS=[
CPU="O|fixed|| |0.1",
MEMORY="M|list||1024,2048,4096,8192,16384,32768,65536|1024",
PASSWORD="M|text|Password",
USERNAME="M|list|Username|Administrator|Administrator",
VCPU="O|list||1,2,4,8,16,32|1" ]
VIRTUAL MACHINE TEMPLATE
AUTOMATIC_DS_REQUIREMENTS="\"CLUSTERS/ID\" = 0"
AUTOMATIC_REQUIREMENTS="(CLUSTER_ID = 0) & !(PUBLIC_CLOUD = YES) | (PUBLIC_CLOUD = YES & (HYPERVISOR = vcenter))"
CONTEXT=[
DISK_ID="0",
ETH0_CONTEXT_FORCE_IPV4="",
ETH0_DNS="8.8.8.8",
ETH0_GATEWAY="2.62.164.1",
ETH0_GATEWAY6="",
ETH0_IP="192.61.222.142",
ETH0_IP6="",
ETH0_IP6_ULA="",
ETH0_MAC="01:32:c0:43:a4:8e",
ETH0_MASK="255.255.255.0",
ETH0_MTU="",
ETH0_NETWORK="",
ETH0_SEARCH_DOMAIN="",
ETH0_VROUTER_IP="",
ETH0_VROUTER_IP6="",
ETH0_VROUTER_MANAGEMENT="",
NETWORK="YES",
PASSWORD="asdas",
TARGET="hda",
USERNAME="Administrator" ]
CPU="0.1"
GRAPHICS=[
LISTEN="0.0.0.0",
PORT="6060",
TYPE="VNC" ]
MEMORY="16384"
TEMPLATE_ID="10"
VCPU="8"
VMID="160"
Second vm
onevm show 161
VIRTUAL MACHINE 161 INFORMATION
ID : 161
NAME : daddy2
USER : sysadmin
GROUP : asdasd
STATE : POWEROFF
LCM_STATE : LCM_INIT
RESCHED : No
HOST : CloudCustomers
CLUSTER ID : 0
CLUSTER : default
START TIME : 09/01 18:52:26
END TIME : -
DEPLOY ID : 420d9cc9-9cf4-b1ab-d0ee-73823a0f0800
VIRTUAL MACHINE MONITORING
CPU : 0.0
MEMORY : 0K
PERMISSIONS
OWNER : um-
GROUP : ---
OTHER : ---
VM DISKS
ID DATASTORE TARGET IMAGE SIZE TYPE SAVE
0 - hda CONTEXT -/- - -
VM NICS
ID NETWORK BRIDGE IP MAC PCI_ID
0 Public WAN Public DPort 192.168.1.143 02:00:c0:43:a3:2f
SECURITY
NIC_ID NETWORK SECURITY_GROUPS
0 Public WAN 0
SECURITY GROUP TYPE PROTOCOL NETWORK RANGE
ID NAME VNET START SIZE
0 default OUTBOUND ALL
0 default INBOUND ALL
VIRTUAL MACHINE HISTORY
SEQ HOST ACTION DS START TIME PROLOG
0 CloudCustomers nic-attach -1 09/01 18:53:03 10d 17h57m 0h00m00s
1 CloudCustomers nic-attach -1 09/12 12:50:57 0d 00h04m 0h00m00s
2 CloudCustomers none -1 09/12 12:55:48 11d 03h51m 0h00m00s
3 CloudCustomers resume -1 10/12 17:24:22 0d 00h01m 0h00m00s
USER TEMPLATE
DESCRIPTION="Windows 2012 Server R2 x64"
ERROR="Fri Sep 23 23:45:44 2016 : Ignoring monitoring information, error:syntax error, unexpected $end, expecting EQUAL or EQUAL_EMPTY at line 1, columns 1:15. Monitor information was: CloudCustomers"
HYPERVISOR="vcenter"
KEEP_DISKS_ON_DONE="NO"
LABELS="Windows"
LOGO="images/logos/windows8.png"
PASSWORD="dsa"
PUBLIC_CLOUD=[
TYPE="vcenter",
VM_TEMPLATE="420d5483-a201-52a6-b877-49e0ccac4806" ]
USERNAME="Administrator"
USER_INPUTS=[
CPU="O|fixed|| |0.1",
MEMORY="M|list||1024,2048,4096,8192,16384,32768,65536|1024",
PASSWORD="M|text|Password",
USERNAME="M|list|Username|Administrator|Administrator",
VCPU="O|list||1,2,4,8,16,32|1" ]
VIRTUAL MACHINE TEMPLATE
AUTOMATIC_DS_REQUIREMENTS="\"CLUSTERS/ID\" = 0"
AUTOMATIC_REQUIREMENTS="(CLUSTER_ID = 0) & !(PUBLIC_CLOUD = YES) | (PUBLIC_CLOUD = YES & (HYPERVISOR = vcenter))"
CONTEXT=[
DISK_ID="0",
ETH0_CONTEXT_FORCE_IPV4="",
ETH0_DNS="8.8.8.8",
ETH0_GATEWAY="192.168.1.1",
ETH0_GATEWAY6="",
ETH0_IP="192.168.1.143",
ETH0_IP6="",
ETH0_IP6_ULA="",
ETH0_MAC="02:00:c3:34:a4:8f",
ETH0_MASK="255.255.255.0",
ETH0_MTU="",
ETH0_NETWORK="",
ETH0_SEARCH_DOMAIN="",
ETH0_VROUTER_IP="",
ETH0_VROUTER_IP6="",
ETH0_VROUTER_MANAGEMENT="",
NETWORK="YES",
PASSWORD="",
TARGET="hda",
USERNAME="Administrator" ]
CPU="0.1"
GRAPHICS=[
LISTEN="0.0.0.0",
PORT="6061",
TYPE="VNC" ]
MEMORY="16384"
TEMPLATE_ID="10"
VCPU="8"
VMID="161"
This output is from ‘/var/lib/one/remotes/im/vcenter.d/vcenter.rb’ Interesting thing is that the 160 and 161 ids of the hosts that have problems aren’t listed there.
/usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/type_loader.rb:66: warning: already initialized constant RbVmomi::VIM::Datastore
/usr/lib/one/ruby/vcenter_driver.rb:50: warning: previous definition of Datastore was here
HYPERVISOR=vcenter
PUBLIC_CLOUD=YES
TOTALHOST=5
AVAILHOST=3
CPUSPEED=3139.846153846154
TOTALCPU=5200.0
USEDCPU=2458.81
FREECPU=2741.19
TOTALMEMORY=469695588
FREEMEMORY=328794112
USEDMEMORY=140901476
HOST=[STATE=on,HOSTNAME="1.1.1.30",MODELNAME="Intel(R) Xeon(R) CPU X5680 @ 3.33GHz",CPUSPEED=3324,MAX_CPU=1200,USED_CPU=286.76,FREE_CPU=913.24,MAX_MEM=100650004,USED_MEM=45246464,FREE_MEM=55403540]
HOST=[STATE=on,HOSTNAME="1.1.1.32",MODELNAME="Intel(R) Xeon(R) CPU X5680 @ 3.33GHz",CPUSPEED=3324,MAX_CPU=1200,USED_CPU=245.7,FREE_CPU=954.3,MAX_MEM=100650004,USED_MEM=59496448,FREE_MEM=41153556]
HOST=[STATE=on,HOSTNAME="1.1.1.33",MODELNAME="Intel(R) Xeon(R) CPU E5640 @ 2.67GHz",CPUSPEED=2659,MAX_CPU=800,USED_CPU=71.15,FREE_CPU=728.85,MAX_MEM=150981652,USED_MEM=64228352,FREE_MEM=86753300]
HOST=[STATE=on,HOSTNAME="1.1.1.76",MODELNAME="Intel(R) Xeon(R) CPU X5680 @ 3.33GHz",CPUSPEED=3324,MAX_CPU=1200,USED_CPU=1.59,FREE_CPU=1198.41,MAX_MEM=50318356,USED_MEM=2612224,FREE_MEM=47706132]
HOST=[STATE=on,HOSTNAME="172.16.0.4",MODELNAME="Intel(R) Xeon(R) CPU X5560 @ 2.80GHz",CPUSPEED=2792,MAX_CPU=800,USED_CPU=4.08,FREE_CPU=795.92,MAX_MEM=67095572,USED_MEM=2742272,FREE_MEM=64353300]
VM_POLL=YES
VM = [ID=219,DEPLOY_ID="420dd694-2562-595d-433e-75a2ca3f04f2",VM_NAME="one-219-asd-stage - CloudCustomers",POLL="GUEST_IP=192.168.1.144 GUEST_IP_ADDRESSES=\"192.168.1.144,fe80::c0ff:fe43:a490\" STATE=a CPU=0.00 MEMORY=1071104 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=218,DEPLOY_ID="420d03d4-eed1-b2fb-c457-8832f0af8560",VM_NAME="one-218-asd-mage2-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.141 GUEST_IP_ADDRESSES=\"192.168.1.141,fe80::c0ff:fe43:a48d\" STATE=a CPU=0.00 MEMORY=2937856 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=215,DEPLOY_ID="420d46a3-7b65-0aa7-dfa9-8c4b69c5939f",VM_NAME="one-215-asd-test - CloudCustomers",POLL="GUEST_IP=192.168.1.140 GUEST_IP_ADDRESSES=\"192.168.1.140,fe80::c0ff:fe43:a48c\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=214,DEPLOY_ID="420dd914-e52b-2bd6-2a1f-01a89cf0b9ea",VM_NAME="one-214-asd-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.136 GUEST_IP_ADDRESSES=\"192.168.1.136,fe80::c0ff:fe43:a488\" STATE=a CPU=0.00 MEMORY=4229120 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=213,DEPLOY_ID="420d5aa6-57b0-960e-8832-8bc97aa45fbb",VM_NAME="one-213-ha_mysql3 - CloudCustomers",POLL="GUEST_IP=192.168.1.135 GUEST_IP_ADDRESSES=\"192.168.1.135,fe80::c0ff:fe43:a487,2.0.20.114,fe80::aff:fe00:1472\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=59,DEPLOY_ID="420d8c83-dec7-a893-8b65-e95e49ff996d",VM_NAME="one-59-rabbitmq1 - CloudCustomers",POLL="GUEST_IP=192.168.1.122 GUEST_IP_ADDRESSES=\"192.168.1.122,fe80::c0ff:fe43:a47a\" STATE=a CPU=0.00 MEMORY=1070080 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=55,DEPLOY_ID="420dbbe2-14cc-5783-dfaf-54350d87a44b",VM_NAME="one-55-memcache2 - CloudCustomers",POLL="GUEST_IP=2.0.20.101 GUEST_IP_ADDRESSES=\"2.0.20.101,fe80::aff:fe00:1465\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=54,DEPLOY_ID="420db4f9-ad6e-bc0d-b3b6-b8bbf924a99e",VM_NAME="one-54-memcache1 - CloudCustomers",POLL="STATE=a CPU=0.00 MEMORY=1062912 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=205,DEPLOY_ID="420d0a0d-c143-4afa-c28a-dae45e8a0a23",VM_NAME="one-205-ha-app1 - CloudCustomers",POLL="GUEST_IP=192.168.1.126 GUEST_IP_ADDRESSES=\"192.168.1.126,fe80::c0ff:fe43:a47e,2.0.20.107,fe80::aff:fe00:146b\" STATE=a CPU=11.97 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420d74ff-5763-10da-e991-9153423b5490",VM_NAME="CentOs-7 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gIkNlbnRPcy03IC0gQ2xvdWRDdXN0b21lcnMiCkNQVSAgICA9ICIxIgp2Q1BVICAgPSAiMSIKTUVNT1JZID0gIjIwNDgiCkhZUEVSVklTT1IgPSAidmNlbnRlciIKUFVCTElDX0NMT1VEID0gWwogIFRZUEUgICAgICAgID0idmNlbnRlciIsCiAgVk1fVEVNUExBVEUgPSI0MjBkNzRmZi01NzYzLTEwZGEtZTk5MS05MTUzNDIzYjU0OTAiLAogIEhPU1QgICAgICAgID0iQ2xvdWRDdXN0b21lcnMiCl0KSU1QT1JUX1ZNX0lEICAgID0gIjQyMGQ3NGZmLTU3NjMtMTBkYS1lOTkxLTkxNTM0MjNiNTQ5MCIKSU1QT1JUX1NUQVRFICAgPSAiUE9XRVJPRkYiClNDSEVEX1JFUVVJUkVNRU5UUz0iTkFNRT1cIkNsb3VkQ3VzdG9tZXJzXCIiCkRFU0NSSVBUSU9OID0gInZDZW50ZXIgVmlydHVhbCBNYWNoaW5lIGltcG9ydGVkIGJ5IE9wZW5OZWJ1bGEgZnJvbSBDbHVzdGVyIENsb3VkQ3VzdG9tZXJzIgo=",POLL="STATE=d"]
VM = [ID=-1,DEPLOY_ID="4227a899-3531-30f9-da6e-d4ef07a69e31",VM_NAME="hha_asd008 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gImhoYV9oYW5kYmlkMDA4IC0gQ2xvdWRDdXN0b21lcnMiCkNQVSAgICA9ICIxIgp2Q1BVICAgPSAiMSIKTUVNT1JZID0gIjEwMjQiCkhZUEVSVklTT1IgPSAidmNlbnRlciIKUFVCTElDX0NMT1VEID0gWwogIFRZUEUgICAgICAgID0idmNlbnRlciIsCiAgVk1fVEVNUExBVEUgPSI0MjI3YTg5OS0zNTMxLTMwZjktZGE2ZS1kNGVmMDdhNjllMzEiLAogIEhPU1QgICAgICAgID0iQ2xvdWRDdXN0b21lcnMiCl0KSU1QT1JUX1ZNX0lEICAgID0gIjQyMjdhODk5LTM1MzEtMzBmOS1kYTZlLWQ0ZWYwN2E2OWUzMSIKSU1QT1JUX1NUQVRFICAgPSAiUlVOTklORyIKU0NIRURfUkVRVUlSRU1FTlRTPSJOQU1FPVwiQ2xvdWRDdXN0b21lcnNcIiIKREVTQ1JJUFRJT04gPSAidkNlbnRlciBWaXJ0dWFsIE1hY2hpbmUgaW1wb3J0ZWQgYnkgT3Blbk5lYnVsYSBmcm9tIENsdXN0ZXIgQ2xvdWRDdXN0b21lcnMiCkxPR089aW1hZ2VzL2xvZ29zL3VidW50dS5wbmc=",POLL="GUEST_IP=192.168.1.109 GUEST_IP_ADDRESSES=\"2.0.20.11,fe80::aff:fe00:146a,192.168.1.109,fe80::250:56ff:fea7:4cb8\" STATE=a CPU=0.00 MEMORY=1071104 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=202,DEPLOY_ID="564dc1d6-c6fb-6004-6f57-871c9b248c8b",VM_NAME="hha_asd006 - CloudCustomers",POLL="GUEST_IP=192.168.1.108 GUEST_IP_ADDRESSES=\"2.0.20.10,fe80::250:56ff:fea7:4efd,192.168.1.108,fe80::250:56ff:fea7:5e2b\" STATE=a CPU=0.98 MEMORY=1065984 NETRX=40960 NETTX=0 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=189,DEPLOY_ID="420d1829-8bbd-c617-6378-f80c10684810",VM_NAME="one-189-asd - CloudCustomers",POLL="GUEST_IP=2002:c043:a489::c043:a489 GUEST_IP_ADDRESSES=\"fe80::d7c:6e4b:2217:bae2,192.168.1.137\" STATE=a CPU=1.99 MEMORY=8450048 NETRX=163840 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9541 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=183,DEPLOY_ID="420ddfdb-121b-94a4-6c6e-b5ec077ce29d",VM_NAME="one-183-dev2 asd - CloudCustomers",POLL="GUEST_IP=192.168.1.134 GUEST_IP_ADDRESSES=\"192.168.1.134,fe80::c0ff:fe43:a486\" STATE=a CPU=0.98 MEMORY=1064960 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=167,DEPLOY_ID="420d61bb-ce9a-8aa5-5d91-b2c3f500a30e",VM_NAME="one-167-asd test rest deploy - CloudCustomers",POLL="GUEST_IP=192.168.1.148 GUEST_IP_ADDRESSES=\"192.168.1.148,fe80::c0ff:fe43:a494\" STATE=a CPU=0.00 MEMORY=1063936 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=207,DEPLOY_ID="420d2566-5399-f946-1e81-1ad2329d6321",VM_NAME="one-207-puppet-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.127 GUEST_IP_ADDRESSES=\"192.168.1.127,fe80::c0ff:fe43:a47f,2.0.20.109,fe80::aff:fe00:146d\" STATE=a CPU=0.00 MEMORY=2581504 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420dfcf3-62cb-fc7a-bac6-721de5f37643",VM_NAME="centOs-6.5 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gImNlbnRPcy02LjUgLSBDbG91ZEN1c3RvbWVycyIKQ1BVICAgID0gIjEiCnZDUFUgICA9ICIxIgpNRU1PUlkgPSAiMTAyNCIKSFlQRVJWSVNPUiA9ICJ2Y2VudGVyIgpQVUJMSUNfQ0xPVUQgPSBbCiAgVFlQRSAgICAgICAgPSJ2Y2VudGVyIiwKICBWTV9URU1QTEFURSA9IjQyMGRmY2YzLTYyY2ItZmM3YS1iYWM2LTcyMWRlNWYzNzY0MyIsCiAgSE9TVCAgICAgICAgPSJDbG91ZEN1c3RvbWVycyIKXQpJTVBPUlRfVk1fSUQgICAgPSAiNDIwZGZjZjMtNjJjYi1mYzdhLWJhYzYtNzIxZGU1ZjM3NjQzIgpJTVBPUlRfU1RBVEUgICA9ICJQT1dFUk9GRiIKU0NIRURfUkVRVUlSRU1FTlRTPSJOQU1FPVwiQ2xvdWRDdXN0b21lcnNcIiIKREVTQ1JJUFRJT04gPSAidkNlbnRlciBWaXJ0dWFsIE1hY2hpbmUgaW1wb3J0ZWQgYnkgT3Blbk5lYnVsYSBmcm9tIENsdXN0ZXIgQ2xvdWRDdXN0b21lcnMiCkxPR089aW1hZ2VzL2xvZ29zL2NlbnRvcy5wbmc=",POLL="STATE=d"]
VM = [ID=165,DEPLOY_ID="420dea5e-177d-cf89-d2c7-344bfdcd2a7d",VM_NAME="one-165-asd-jenkins - CloudCustomers",POLL="GUEST_IP=192.168.1.146 GUEST_IP_ADDRESSES=\"192.168.1.146,fe80::c0ff:fe43:a492,2.0.20.105,fe80::aff:fe00:1469\" STATE=a CPU=0.98 MEMORY=2116608 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420dbb2c-cbb9-1362-41dc-2e699503cabf",VM_NAME="Sky-6.2.0. - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gIlNreS02LjIuMCAtIENsb3VkQ3VzdG9tZXJzIgpDUFUgICAgPSAiMiIKdkNQVSAgID0gIjIiCk1FTU9SWSA9ICIxMDI0MCIKSFlQRVJWSVNPUiA9ICJ2Y2VudGVyIgpQVUJMSUNfQ0xPVUQgPSBbCiAgVFlQRSAgICAgICAgPSJ2Y2VudGVyIiwKICBWTV9URU1QTEFURSA9IjQyMGRiYjJjLWNiYjktMTM2Mi00MWRjLTJlNjk5NTAzY2FiZiIsCiAgSE9TVCAgICAgICAgPSJDbG91ZEN1c3RvbWVycyIKXQpJTVBPUlRfVk1fSUQgICAgPSAiNDIwZGJiMmMtY2JiOS0xMzYyLTQxZGMtMmU2OTk1MDNjYWJmIgpJTVBPUlRfU1RBVEUgICA9ICJSVU5OSU5HIgpTQ0hFRF9SRVFVSVJFTUVOVFM9Ik5BTUU9XCJDbG91ZEN1c3RvbWVyc1wiIgpERVNDUklQVElPTiA9ICJBY3RpZmlvIFNreSIKTE9HTz1pbWFnZXMvbG9nb3MvY2VudG9zLnBuZw==",POLL="GUEST_IP=192.168.1.230 GUEST_IP_ADDRESSES=\"192.168.1.230\" STATE=a CPU=0.98 MEMORY=10304512 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9216 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420d4b9e-6290-0828-e9b3-0841bbc6ecfe",VM_NAME="ttylinux - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gInR0eWxpbnV4IC0gQ2xvdWRDdXN0b21lcnMiCkNQVSAgICA9ICIxIgp2Q1BVICAgPSAiMSIKTUVNT1JZID0gIjIwNDgiCkhZUEVSVklTT1IgPSAidmNlbnRlciIKUFVCTElDX0NMT1VEID0gWwogIFRZUEUgICAgICAgID0idmNlbnRlciIsCiAgVk1fVEVNUExBVEUgPSI0MjBkNGI5ZS02MjkwLTA4MjgtZTliMy0wODQxYmJjNmVjZmUiLAogIEhPU1QgICAgICAgID0iQ2xvdWRDdXN0b21lcnMiCl0KSU1QT1JUX1ZNX0lEICAgID0gIjQyMGQ0YjllLTYyOTAtMDgyOC1lOWIzLTA4NDFiYmM2ZWNmZSIKSU1QT1JUX1NUQVRFICAgPSAiUE9XRVJPRkYiClNDSEVEX1JFUVVJUkVNRU5UUz0iTkFNRT1cIkNsb3VkQ3VzdG9tZXJzXCIiCkRFU0NSSVBUSU9OID0gInZDZW50ZXIgVmlydHVhbCBNYWNoaW5lIGltcG9ydGVkIGJ5IE9wZW5OZWJ1bGEgZnJvbSBDbHVzdGVyIENsb3VkQ3VzdG9tZXJzIgpMT0dPPWltYWdlcy9sb2dvcy9jZW50b3MucG5n",POLL="STATE=d"]
VM = [ID=177,DEPLOY_ID="420d2f9c-b499-7e00-a3c0-80312ac954fa",VM_NAME="one-177-dev portal - CloudCustomers",POLL="GUEST_IP=192.168.1.128 GUEST_IP_ADDRESSES=\"192.168.1.128,fe80::c0ff:fe43:a480\" STATE=a CPU=0.00 MEMORY=1065984 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=190,DEPLOY_ID="420dafff-1f05-4f2a-e2f3-334d2f18341a",VM_NAME="one-190-Ubuntu 14.04-190 - CloudCustomers",POLL="STATE=a CPU=0.00 MEMORY=849920 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420d8617-b699-c63e-fad2-730e1476b5ec",VM_NAME="win12r2stdx64_mssql16entx64 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gIndpbjEycjJzdGR4NjRfbXNzcWwxNmVudHg2NCAtIENsb3VkQ3VzdG9tZXJzIgpDUFUgICAgPSAiMSIKdkNQVSAgID0gIjEiCk1FTU9SWSA9ICIyMDQ4IgpIWVBFUlZJU09SID0gInZjZW50ZXIiClBVQkxJQ19DTE9VRCA9IFsKICBUWVBFICAgICAgICA9InZjZW50ZXIiLAogIFZNX1RFTVBMQVRFID0iNDIwZDg2MTctYjY5OS1jNjNlLWZhZDItNzMwZTE0NzZiNWVjIiwKICBIT1NUICAgICAgICA9IkNsb3VkQ3VzdG9tZXJzIgpdCklNUE9SVF9WTV9JRCAgICA9ICI0MjBkODYxNy1iNjk5LWM2M2UtZmFkMi03MzBlMTQ3NmI1ZWMiCklNUE9SVF9TVEFURSAgID0gIlBPV0VST0ZGIgpTQ0hFRF9SRVFVSVJFTUVOVFM9Ik5BTUU9XCJDbG91ZEN1c3RvbWVyc1wiIgpERVNDUklQVElPTiA9ICJ2Q2VudGVyIFZpcnR1YWwgTWFjaGluZSBpbXBvcnRlZCBieSBPcGVuTmVidWxhIGZyb20gQ2x1c3RlciBDbG91ZEN1c3RvbWVycyIKTE9HTz1pbWFnZXMvbG9nb3Mvd2luZG93czgucG5n",POLL="STATE=d"]
VM = [ID=203,DEPLOY_ID="420d2b5b-834a-a97c-1e56-8b6ceb86f37e",VM_NAME="one-203-asd.asd.bid - CloudCustomers",POLL="GUEST_IP=192.168.1.125 GUEST_IP_ADDRESSES=\"192.168.1.125,fe80::c0ff:fe43:a47d\" STATE=a CPU=4.96 MEMORY=1065984 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=148,DEPLOY_ID="420d7796-1faf-064b-15a1-e4404a8dfcad",VM_NAME="one-148-Win 2012 R2 Std-148 - CloudCustomers",POLL="GUEST_IP=2002:c043:a48a::c043:a48a GUEST_IP_ADDRESSES=\"fe80::6db5:21b2:24f3:29a7,192.168.1.138\" STATE=a CPU=209.00 MEMORY=8423424 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9541 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=173,DEPLOY_ID="420de057-5957-2af7-98b3-403edb700fad",VM_NAME="one-173-dev rest asd - CloudCustomers",POLL="GUEST_IP=192.168.1.124 GUEST_IP_ADDRESSES=\"192.168.1.124,fe80::c0ff:fe43:a47c\" STATE=a CPU=0.99 MEMORY=1070080 NETRX=20480 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=209,DEPLOY_ID="420d15d3-a28e-326d-1f73-a6132f884731",VM_NAME="one-209-ha-app2 - CloudCustomers",POLL="GUEST_IP=192.168.1.130 GUEST_IP_ADDRESSES=\"192.168.1.130,fe80::c0ff:fe43:a482,2.0.20.111,fe80::aff:fe00:146f\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=133,DEPLOY_ID="420d0079-ad9f-addc-1cf4-9b05ae56599e",VM_NAME="one-133-asdstack - CloudCustomers",POLL="GUEST_IP=192.168.1.119 GUEST_IP_ADDRESSES=\"fe80::a1a6:2ba5:c597:c49e,192.168.1.119\" STATE=a CPU=7.00 MEMORY=8429568 NETRX=0 NETTX=20480 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=10246 VMWARETOOLS_VERSION_STATUS=guestToolsCurrent RESOURCE_POOL=\"Resources\" "]
VM = [ID=179,DEPLOY_ID="420da02f-e2d9-7b58-b89a-6af4398fed7c",VM_NAME="one-179-vr-asd Load Balancer-0 - CloudCustomers",POLL="GUEST_IP=192.168.1.133 GUEST_IP_ADDRESSES=\"2.0.15.11,fe80::aff:fe00:190b,192.168.1.133,fe80::c0ff:fe43:a485\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=208,DEPLOY_ID="420d30bc-5626-ac6c-7e79-c5963a2e5e80",VM_NAME="one-208-lb-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.129 GUEST_IP_ADDRESSES=\"192.168.1.129,fe80::c0ff:fe43:a481,2.0.20.110,fe80::aff:fe00:146e\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=44,DEPLOY_ID="420d183a-65c8-352d-1dbf-58235a805728",VM_NAME="one-44-vr-asd LB0-0 - CloudCustomers",POLL="GUEST_IP=192.168.1.113 GUEST_IP_ADDRESSES=\"2.0.20.102,fe80::aff:fe00:1466,192.168.1.113,fe80::c0ff:fe43:a471\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=163,DEPLOY_ID="420dfb49-741b-61e0-dc01-5c245e62f234",VM_NAME="one-163-asd-crm-sql - CloudCustomers",POLL="GUEST_IP=2.0.21.16 GUEST_IP_ADDRESSES=\"fe80::8486:b9cb:6bde:88f7,2.0.21.16,fe80::999e:31f8:7287:4d15,192.168.1.145\" STATE=a CPU=260.98 MEMORY=33692672 NETRX=532480 NETTX=552960 ESX_HOST=\"1.1.1.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9541 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=196,DEPLOY_ID="420db75c-ccd3-9e64-7183-364357e8412e",VM_NAME="one-196-asd-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.115 GUEST_IP_ADDRESSES=\"192.168.1.115,fe80::c0ff:fe43:a473\" STATE=a CPU=0.00 MEMORY=4022272 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=60,DEPLOY_ID="420d53d5-9379-04b6-6eab-7f81bd5bcb28",VM_NAME="one-60-rabbitmq2 - CloudCustomers",POLL="GUEST_IP=2.0.20.104 GUEST_IP_ADDRESSES=\"2.0.20.104,fe80::aff:fe00:1468\" STATE=a CPU=0.00 MEMORY=1067008 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=67,DEPLOY_ID="420d88be-ae9c-ca86-ff50-40ead483c782",VM_NAME="one-67-asd server - CloudCustomers",POLL="GUEST_IP=192.168.1.112 GUEST_IP_ADDRESSES=\"fe80::a10f:bc2b:7096:d90d,192.168.1.112,fe80::99f6:bcac:8863:116d,2.0.21.10\" STATE=a CPU=40.99 MEMORY=16860160 NETRX=0 NETTX=1413120 ESX_HOST=\"1.1.1.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9541 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420d04b9-cb7e-f4b6-090c-60c0b5b42356",VM_NAME="Win2012R2Std_x64_MSSQLStd_x64 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gIldpbjIwMTJSMlN0ZF94NjRfTVNTUUxTdGRfeDY0IC0gQ2xvdWRDdXN0b21lcnMiCkNQVSAgICA9ICIxIgp2Q1BVICAgPSAiMSIKTUVNT1JZID0gIjIwNDgiCkhZUEVSVklTT1IgPSAidmNlbnRlciIKUFVCTElDX0NMT1VEID0gWwogIFRZUEUgICAgICAgID0idmNlbnRlciIsCiAgVk1fVEVNUExBVEUgPSI0MjBkMDRiOS1jYjdlLWY0YjYtMDkwYy02MGMwYjViNDIzNTYiLAogIEhPU1QgICAgICAgID0iQ2xvdWRDdXN0b21lcnMiCl0KSU1QT1JUX1ZNX0lEICAgID0gIjQyMGQwNGI5LWNiN2UtZjRiNi0wOTBjLTYwYzBiNWI0MjM1NiIKSU1QT1JUX1NUQVRFICAgPSAiUlVOTklORyIKU0NIRURfUkVRVUlSRU1FTlRTPSJOQU1FPVwiQ2xvdWRDdXN0b21lcnNcIiIKREVTQ1JJUFRJT04gPSAidkNlbnRlciBWaXJ0dWFsIE1hY2hpbmUgaW1wb3J0ZWQgYnkgT3Blbk5lYnVsYSBmcm9tIENsdXN0ZXIgQ2xvdWRDdXN0b21lcnMiCkxPR089aW1hZ2VzL2xvZ29zL3dpbmRvd3M4LnBuZw==",POLL="STATE=a CPU=1.99 MEMORY=1980416 NETRX=0 NETTX=0 ESX_HOST=\"1.1.1.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=10246 VMWARETOOLS_VERSION_STATUS=guestToolsCurrent RESOURCE_POOL=\"Resources\" "]
CUSTOMIZATION = [ NAME = "ubuntu_14.04", TYPE = "Linux" ]
VCENTER_DATASTORE="Backup Target"
VCENTER_DATASTORE="Horizon Premium Customer Storage 1"
VCENTER_DATASTORE="acme_Internal_sas"
VCENTER_DATASTORE="OpenStackGlance"
VCENTER_DATASTORE="OpenStackNova"
VCENTER_DATASTORE="asdStorage"
VCENTER_DATASTORE="Sas1"
VCENTER_DATASTORE="Sas2"
VCENTER_DATASTORE="Sas3"
VCENTER_DATASTORE="datastore1 (1)"
VCENTER_DATASTORE="datastore1 (2)"
VCENTER_DATASTORE="datastore1 (3)"
VCENTER_DATASTORE="datastore1 (4)"
VCENTER_DATASTORE="datastore1 (5)"
VCENTER_DATASTORE="datastore1 (6)"
VCENTER_DATASTORE="datastore1 (7)"
VCENTER_DATASTORE="datastore1"
VCENTER_DATASTORE="vRealize Appliance Storage"
VCENTER_DATASTORE="vRealize Premium Customer Storage 1"Hi!,
could you run the following command:
/var/lib/one/remotes/im/run_probes vcenter x x x x CloudCustomers
just for double-check the output.
Also could you run a onetemplate show 10 -x (I think 10 is the ID of the VM template you’ve used with the failing VMs) so I can have a look on the template?
Though it could be a bug, we must discard other possible situations. Examining your output… I can’t see what datastore should be using the failing VMs.
Could you check if the current limitation would not be the cause? Datastore names cannot contain spaces I see many spaces in the VCENTER_DATASTORES like VCENTER_DATASTORE=“Backup Target”, were those VM supposed to use a datastore with spaces in the name? You can compare those VMs with the VMs that are being monitored fine… I’d like to check that as well.
Cheers!
Here is the output of the first command:
[root@nebula52-prod ~]# /var/lib/one/remotes/im/run_probes vcenter x x x x CloudCustomers
/usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/type_loader.rb:66: warning: already initialized constant RbVmomi::VIM::Datastore
/usr/lib/one/ruby/vcenter_driver.rb:50: warning: previous definition of Datastore was here
HYPERVISOR=vcenter
PUBLIC_CLOUD=YES
TOTALHOST=4
AVAILHOST=3
CPUSPEED=3084.6
TOTALCPU=4000.0
USEDCPU=1209.72
FREECPU=2790.28
TOTALMEMORY=419377232
FREEMEMORY=328792064
USEDMEMORY=90585168
HOST=[STATE=on,HOSTNAME="1.1.10.30",MODELNAME="Intel(R) Xeon(R) CPU X5680 @ 3.33GHz",CPUSPEED=3324,MAX_CPU=1200,USED_CPU=301.77,FREE_CPU=898.23,MAX_MEM=100650004,USED_MEM=62183424,FREE_MEM=38466580]
HOST=[STATE=on,HOSTNAME="1.1.10.32",MODELNAME="Intel(R) Xeon(R) CPU X5680 @ 3.33GHz",CPUSPEED=3324,MAX_CPU=1200,USED_CPU=35.86,FREE_CPU=1164.14,MAX_MEM=100650004,USED_MEM=52657152,FREE_MEM=47992852]
HOST=[STATE=on,HOSTNAME="1.1.10.33",MODELNAME="Intel(R) Xeon(R) CPU E5640 @ 2.67GHz",CPUSPEED=2659,MAX_CPU=800,USED_CPU=190.52,FREE_CPU=609.48,MAX_MEM=150981652,USED_MEM=47302656,FREE_MEM=103678996]
HOST=[STATE=on,HOSTNAME="1.1.0.4",MODELNAME="Intel(R) Xeon(R) CPU X5560 @ 2.80GHz",CPUSPEED=2792,MAX_CPU=800,USED_CPU=1.36,FREE_CPU=798.64,MAX_MEM=67095572,USED_MEM=2745344,FREE_MEM=64350228]
VM_POLL=YES
VM = [ID=219,DEPLOY_ID="420dd694-2562-595d-433e-75a2ca3f04f2",VM_NAME="one-219-acme-stage - CloudCustomers",POLL="GUEST_IP=192.168.1.144 GUEST_IP_ADDRESSES=\"192.168.1.144,fe80::c0ff:fe43:a490\" STATE=a CPU=0.00 MEMORY=1089536 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=218,DEPLOY_ID="420d03d4-eed1-b2fb-c457-8832f0af8560",VM_NAME="one-218-acme-mage2-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.141 GUEST_IP_ADDRESSES=\"192.168.1.141,fe80::c0ff:fe43:a48d\" STATE=a CPU=0.00 MEMORY=3853312 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=215,DEPLOY_ID="420d46a3-7b65-0aa7-dfa9-8c4b69c5939f",VM_NAME="one-215-acme-test - CloudCustomers",POLL="GUEST_IP=192.168.1.140 GUEST_IP_ADDRESSES=\"192.168.1.140,fe80::c0ff:fe43:a48c\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=214,DEPLOY_ID="420dd914-e52b-2bd6-2a1f-01a89cf0b9ea",VM_NAME="one-214-mwe-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.136 GUEST_IP_ADDRESSES=\"192.168.1.136,fe80::c0ff:fe43:a488\" STATE=a CPU=0.00 MEMORY=3974144 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=213,DEPLOY_ID="420d5aa6-57b0-960e-8832-8bc97aa45fbb",VM_NAME="one-213-ha_mysql3 - CloudCustomers",POLL="GUEST_IP=192.168.1.135 GUEST_IP_ADDRESSES=\"10.0.20.114,fe80::aff:fe00:1472,192.168.1.135,fe80::c0ff:fe43:a487\" STATE=a CPU=0.00 MEMORY=1073152 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=59,DEPLOY_ID="420d8c83-dec7-a893-8b65-e95e49ff996d",VM_NAME="one-59-rabbitmq1 - CloudCustomers",POLL="GUEST_IP=192.168.1.122 GUEST_IP_ADDRESSES=\"192.168.1.122,fe80::c0ff:fe43:a47a\" STATE=a CPU=0.00 MEMORY=1069056 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=55,DEPLOY_ID="420dbbe2-14cc-5783-dfaf-54350d87a44b",VM_NAME="one-55-memcache2 - CloudCustomers",POLL="GUEST_IP=10.0.20.101 GUEST_IP_ADDRESSES=\"10.0.20.101,fe80::aff:fe00:1465\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=54,DEPLOY_ID="420db4f9-ad6e-bc0d-b3b6-b8bbf924a99e",VM_NAME="one-54-memcache1 - CloudCustomers",POLL="STATE=a CPU=0.00 MEMORY=1062912 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=205,DEPLOY_ID="420d0a0d-c143-4afa-c28a-dae45e8a0a23",VM_NAME="one-205-ha-app1 - CloudCustomers",POLL="GUEST_IP=192.168.1.126 GUEST_IP_ADDRESSES=\"192.168.1.126,fe80::c0ff:fe43:a47e,10.0.20.107,fe80::aff:fe00:146b\" STATE=a CPU=10.98 MEMORY=1073152 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420d74ff-5763-10da-e991-9153423b5490",VM_NAME="CentOs-7 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gIkNlbnRPcy03IC0gQ2xvdWRDdXN0b21lcnMiCkNQVSAgICA9ICIxIgp2Q1BVICAgPSAiMSIKTUVNT1JZID0gIjIwNDgiCkhZUEVSVklTT1IgPSAidmNlbnRlciIKUFVCTElDX0NMT1VEID0gWwogIFRZUEUgICAgICAgID0idmNlbnRlciIsCiAgVk1fVEVNUExBVEUgPSI0MjBkNzRmZi01NzYzLTEwZGEtZTk5MS05MTUzNDIzYjU0OTAiLAogIEhPU1QgICAgICAgID0iQ2xvdWRDdXN0b21lcnMiCl0KSU1QT1JUX1ZNX0lEICAgID0gIjQyMGQ3NGZmLTU3NjMtMTBkYS1lOTkxLTkxNTM0MjNiNTQ5MCIKSU1QT1JUX1NUQVRFICAgPSAiUE9XRVJPRkYiClNDSEVEX1JFUVVJUkVNRU5UUz0iTkFNRT1cIkNsb3VkQ3VzdG9tZXJzXCIiCkRFU0NSSVBUSU9OID0gInZDZW50ZXIgVmlydHVhbCBNYWNoaW5lIGltcG9ydGVkIGJ5IE9wZW5OZWJ1bGEgZnJvbSBDbHVzdGVyIENsb3VkQ3VzdG9tZXJzIgo=",POLL="STATE=d"]
VM = [ID=-1,DEPLOY_ID="4227a899-3531-30f9-da6e-d4ef07a69e31",VM_NAME="hha_acme008 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gImhoYV9oYW5kYmlkMDA4IC0gQ2xvdWRDdXN0b21lcnMiCkNQVSAgICA9ICIxIgp2Q1BVICAgPSAiMSIKTUVNT1JZID0gIjEwMjQiCkhZUEVSVklTT1IgPSAidmNlbnRlciIKUFVCTElDX0NMT1VEID0gWwogIFRZUEUgICAgICAgID0idmNlbnRlciIsCiAgVk1fVEVNUExBVEUgPSI0MjI3YTg5OS0zNTMxLTMwZjktZGE2ZS1kNGVmMDdhNjllMzEiLAogIEhPU1QgICAgICAgID0iQ2xvdWRDdXN0b21lcnMiCl0KSU1QT1JUX1ZNX0lEICAgID0gIjQyMjdhODk5LTM1MzEtMzBmOS1kYTZlLWQ0ZWYwN2E2OWUzMSIKSU1QT1JUX1NUQVRFICAgPSAiUlVOTklORyIKU0NIRURfUkVRVUlSRU1FTlRTPSJOQU1FPVwiQ2xvdWRDdXN0b21lcnNcIiIKREVTQ1JJUFRJT04gPSAidkNlbnRlciBWaXJ0dWFsIE1hY2hpbmUgaW1wb3J0ZWQgYnkgT3Blbk5lYnVsYSBmcm9tIENsdXN0ZXIgQ2xvdWRDdXN0b21lcnMiCkxPR089aW1hZ2VzL2xvZ29zL3VidW50dS5wbmc=",POLL="GUEST_IP=192.168.1.109 GUEST_IP_ADDRESSES=\"10.0.20.11,fe80::aff:fe00:146a,192.168.1.109,fe80::250:56ff:fea7:4cb8\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=202,DEPLOY_ID="564dc1d6-c6fb-6004-6f57-871c9b248c8b",VM_NAME="hha_acme006 - CloudCustomers",POLL="GUEST_IP=192.168.1.108 GUEST_IP_ADDRESSES=\"10.0.20.10,fe80::250:56ff:fea7:4efd,192.168.1.108,fe80::250:56ff:fea7:5e2b\" STATE=a CPU=0.00 MEMORY=1065984 NETRX=40960 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=189,DEPLOY_ID="420d1829-8bbd-c617-6378-f80c10684810",VM_NAME="one-189-acmes2 - CloudCustomers",POLL="GUEST_IP=2002:c043:a489::c043:a489 GUEST_IP_ADDRESSES=\"fe80::d7c:6e4b:2217:bae2,192.168.1.137\" STATE=a CPU=4.99 MEMORY=5500928 NETRX=184320 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9541 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=183,DEPLOY_ID="420ddfdb-121b-94a4-6c6e-b5ec077ce29d",VM_NAME="one-183-dev2 acme - CloudCustomers",POLL="GUEST_IP=192.168.1.134 GUEST_IP_ADDRESSES=\"192.168.1.134,fe80::c0ff:fe43:a486\" STATE=a CPU=0.98 MEMORY=1063936 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=167,DEPLOY_ID="420d61bb-ce9a-8aa5-5d91-b2c3f500a30e",VM_NAME="one-167-acme test rest deploy - CloudCustomers",POLL="GUEST_IP=192.168.1.148 GUEST_IP_ADDRESSES=\"192.168.1.148,fe80::c0ff:fe43:a494\" STATE=a CPU=0.00 MEMORY=1063936 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=207,DEPLOY_ID="420d2566-5399-f946-1e81-1ad2329d6321",VM_NAME="one-207-puppet-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.127 GUEST_IP_ADDRESSES=\"192.168.1.127,fe80::c0ff:fe43:a47f,10.0.20.109,fe80::aff:fe00:146d\" STATE=a CPU=0.00 MEMORY=2981888 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420dfcf3-62cb-fc7a-bac6-721de5f37643",VM_NAME="centOs-6.5 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gImNlbnRPcy02LjUgLSBDbG91ZEN1c3RvbWVycyIKQ1BVICAgID0gIjEiCnZDUFUgICA9ICIxIgpNRU1PUlkgPSAiMTAyNCIKSFlQRVJWSVNPUiA9ICJ2Y2VudGVyIgpQVUJMSUNfQ0xPVUQgPSBbCiAgVFlQRSAgICAgICAgPSJ2Y2VudGVyIiwKICBWTV9URU1QTEFURSA9IjQyMGRmY2YzLTYyY2ItZmM3YS1iYWM2LTcyMWRlNWYzNzY0MyIsCiAgSE9TVCAgICAgICAgPSJDbG91ZEN1c3RvbWVycyIKXQpJTVBPUlRfVk1fSUQgICAgPSAiNDIwZGZjZjMtNjJjYi1mYzdhLWJhYzYtNzIxZGU1ZjM3NjQzIgpJTVBPUlRfU1RBVEUgICA9ICJQT1dFUk9GRiIKU0NIRURfUkVRVUlSRU1FTlRTPSJOQU1FPVwiQ2xvdWRDdXN0b21lcnNcIiIKREVTQ1JJUFRJT04gPSAidkNlbnRlciBWaXJ0dWFsIE1hY2hpbmUgaW1wb3J0ZWQgYnkgT3Blbk5lYnVsYSBmcm9tIENsdXN0ZXIgQ2xvdWRDdXN0b21lcnMiCkxPR089aW1hZ2VzL2xvZ29zL2NlbnRvcy5wbmc=",POLL="STATE=d"]
VM = [ID=165,DEPLOY_ID="420dea5e-177d-cf89-d2c7-344bfdcd2a7d",VM_NAME="one-165-acme-jenkins - CloudCustomers",POLL="GUEST_IP=192.168.1.146 GUEST_IP_ADDRESSES=\"192.168.1.146,fe80::c0ff:fe43:a492,10.0.20.105,fe80::aff:fe00:1469\" STATE=a CPU=0.00 MEMORY=2116608 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420dbb2c-cbb9-1362-41dc-2e699503cabf",VM_NAME="Sky-6.2.0 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gIlNreS02LjIuMCAtIENsb3VkQ3VzdG9tZXJzIgpDUFUgICAgPSAiMiIKdkNQVSAgID0gIjIiCk1FTU9SWSA9ICIxMDI0MCIKSFlQRVJWSVNPUiA9ICJ2Y2VudGVyIgpQVUJMSUNfQ0xPVUQgPSBbCiAgVFlQRSAgICAgICAgPSJ2Y2VudGVyIiwKICBWTV9URU1QTEFURSA9IjQyMGRiYjJjLWNiYjktMTM2Mi00MWRjLTJlNjk5NTAzY2FiZiIsCiAgSE9TVCAgICAgICAgPSJDbG91ZEN1c3RvbWVycyIKXQpJTVBPUlRfVk1fSUQgICAgPSAiNDIwZGJiMmMtY2JiOS0xMzYyLTQxZGMtMmU2OTk1MDNjYWJmIgpJTVBPUlRfU1RBVEUgICA9ICJSVU5OSU5HIgpTQ0hFRF9SRVFVSVJFTUVOVFM9Ik5BTUU9XCJDbG91ZEN1c3RvbWVyc1wiIgpERVNDUklQVElPTiA9ICJBY3RpZmlvIFNreSIKTE9HTz1pbWFnZXMvbG9nb3MvY2VudG9zLnBuZw==",POLL="GUEST_IP=192.168.1.230 GUEST_IP_ADDRESSES=\"192.168.1.230\" STATE=a CPU=0.98 MEMORY=10303488 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9216 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420d4b9e-6290-0828-e9b3-0841bbc6ecfe",VM_NAME="ttylinux - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gInR0eWxpbnV4IC0gQ2xvdWRDdXN0b21lcnMiCkNQVSAgICA9ICIxIgp2Q1BVICAgPSAiMSIKTUVNT1JZID0gIjIwNDgiCkhZUEVSVklTT1IgPSAidmNlbnRlciIKUFVCTElDX0NMT1VEID0gWwogIFRZUEUgICAgICAgID0idmNlbnRlciIsCiAgVk1fVEVNUExBVEUgPSI0MjBkNGI5ZS02MjkwLTA4MjgtZTliMy0wODQxYmJjNmVjZmUiLAogIEhPU1QgICAgICAgID0iQ2xvdWRDdXN0b21lcnMiCl0KSU1QT1JUX1ZNX0lEICAgID0gIjQyMGQ0YjllLTYyOTAtMDgyOC1lOWIzLTA4NDFiYmM2ZWNmZSIKSU1QT1JUX1NUQVRFICAgPSAiUE9XRVJPRkYiClNDSEVEX1JFUVVJUkVNRU5UUz0iTkFNRT1cIkNsb3VkQ3VzdG9tZXJzXCIiCkRFU0NSSVBUSU9OID0gInZDZW50ZXIgVmlydHVhbCBNYWNoaW5lIGltcG9ydGVkIGJ5IE9wZW5OZWJ1bGEgZnJvbSBDbHVzdGVyIENsb3VkQ3VzdG9tZXJzIgpMT0dPPWltYWdlcy9sb2dvcy9jZW50b3MucG5n",POLL="STATE=d"]
VM = [ID=177,DEPLOY_ID="420d2f9c-b499-7e00-a3c0-80312ac954fa",VM_NAME="one-177-dev portal - CloudCustomers",POLL="GUEST_IP=192.168.1.128 GUEST_IP_ADDRESSES=\"192.168.1.128,fe80::c0ff:fe43:a480\" STATE=a CPU=0.00 MEMORY=1065984 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=190,DEPLOY_ID="420dafff-1f05-4f2a-e2f3-334d2f18341a",VM_NAME="one-190-Ubuntu 14.04-190 - CloudCustomers",POLL="STATE=a CPU=0.00 MEMORY=849920 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420d8617-b699-c63e-fad2-730e1476b5ec",VM_NAME="win12r2stdx64_mssql16entx64 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gIndpbjEycjJzdGR4NjRfbXNzcWwxNmVudHg2NCAtIENsb3VkQ3VzdG9tZXJzIgpDUFUgICAgPSAiMSIKdkNQVSAgID0gIjEiCk1FTU9SWSA9ICIyMDQ4IgpIWVBFUlZJU09SID0gInZjZW50ZXIiClBVQkxJQ19DTE9VRCA9IFsKICBUWVBFICAgICAgICA9InZjZW50ZXIiLAogIFZNX1RFTVBMQVRFID0iNDIwZDg2MTctYjY5OS1jNjNlLWZhZDItNzMwZTE0NzZiNWVjIiwKICBIT1NUICAgICAgICA9IkNsb3VkQ3VzdG9tZXJzIgpdCklNUE9SVF9WTV9JRCAgICA9ICI0MjBkODYxNy1iNjk5LWM2M2UtZmFkMi03MzBlMTQ3NmI1ZWMiCklNUE9SVF9TVEFURSAgID0gIlBPV0VST0ZGIgpTQ0hFRF9SRVFVSVJFTUVOVFM9Ik5BTUU9XCJDbG91ZEN1c3RvbWVyc1wiIgpERVNDUklQVElPTiA9ICJ2Q2VudGVyIFZpcnR1YWwgTWFjaGluZSBpbXBvcnRlZCBieSBPcGVuTmVidWxhIGZyb20gQ2x1c3RlciBDbG91ZEN1c3RvbWVycyIKTE9HTz1pbWFnZXMvbG9nb3Mvd2luZG93czgucG5n",POLL="STATE=d"]
VM = [ID=203,DEPLOY_ID="420d2b5b-834a-a97c-1e56-8b6ceb86f37e",VM_NAME="one-203-qa-manager.acme.asd - CloudCustomers",POLL="GUEST_IP=192.168.1.125 GUEST_IP_ADDRESSES=\"192.168.1.125,fe80::c0ff:fe43:a47d\" STATE=a CPU=5.98 MEMORY=1065984 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=148,DEPLOY_ID="420d7796-1faf-064b-15a1-e4404a8dfcad",VM_NAME="one-148-Win 2012 R2 Std-148 - CloudCustomers",POLL="GUEST_IP=2002:c043:a48a::c043:a48a GUEST_IP_ADDRESSES=\"fe80::6db5:21b2:24f3:29a7,192.168.1.138\" STATE=a CPU=2.98 MEMORY=8387584 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9541 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=173,DEPLOY_ID="420de057-5957-2af7-98b3-403edb700fad",VM_NAME="one-173-dev rest acme - CloudCustomers",POLL="GUEST_IP=192.168.1.124 GUEST_IP_ADDRESSES=\"192.168.1.124,fe80::c0ff:fe43:a47c\" STATE=a CPU=0.99 MEMORY=1070080 NETRX=20480 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=209,DEPLOY_ID="420d15d3-a28e-326d-1f73-a6132f884731",VM_NAME="one-209-ha-app2 - CloudCustomers",POLL="GUEST_IP=192.168.1.130 GUEST_IP_ADDRESSES=\"192.168.1.130,fe80::c0ff:fe43:a482,10.0.20.111,fe80::aff:fe00:146f\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=133,DEPLOY_ID="420d0079-ad9f-addc-1cf4-9b05ae56599e",VM_NAME="one-133-asdstack - CloudCustomers",POLL="GUEST_IP=192.168.1.119 GUEST_IP_ADDRESSES=\"fe80::a1a6:2ba5:c597:c49e,192.168.1.119\" STATE=a CPU=4.96 MEMORY=8429568 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=10246 VMWARETOOLS_VERSION_STATUS=guestToolsCurrent RESOURCE_POOL=\"Resources\" "]
VM = [ID=179,DEPLOY_ID="420da02f-e2d9-7b58-b89a-6af4398fed7c",VM_NAME="one-179-vr-acme Load Balancer-0 - CloudCustomers",POLL="GUEST_IP=192.168.1.133 GUEST_IP_ADDRESSES=\"10.0.15.11,fe80::aff:fe00:190b,192.168.1.133,fe80::c0ff:fe43:a485\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=208,DEPLOY_ID="420d30bc-5626-ac6c-7e79-c5963a2e5e80",VM_NAME="one-208-lb-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.129 GUEST_IP_ADDRESSES=\"192.168.1.129,fe80::c0ff:fe43:a481,10.0.20.110,fe80::aff:fe00:146e\" STATE=a CPU=0.00 MEMORY=1072128 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=44,DEPLOY_ID="420d183a-65c8-352d-1dbf-58235a805728",VM_NAME="one-44-vr-Hanasd LB0-0 - CloudCustomers",POLL="GUEST_IP=192.168.1.113 GUEST_IP_ADDRESSES=\"10.0.20.102,fe80::aff:fe00:1466,192.168.1.113,fe80::c0ff:fe43:a471\" STATE=a CPU=0.00 MEMORY=1032192 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=163,DEPLOY_ID="420dfb49-741b-61e0-dc01-5c245e62f234",VM_NAME="one-163-acme-crm-sql - CloudCustomers",POLL="GUEST_IP=10.0.21.16 GUEST_IP_ADDRESSES=\"fe80::8486:b9cb:6bde:88f7,10.0.21.16,fe80::999e:31f8:7287:4d15,192.168.1.145\" STATE=a CPU=157.97 MEMORY=28945408 NETRX=2334720 NETTX=7372800 ESX_HOST=\"1.1.10.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9541 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=196,DEPLOY_ID="420db75c-ccd3-9e64-7183-364357e8412e",VM_NAME="one-196-acme-dev - CloudCustomers",POLL="GUEST_IP=192.168.1.115 GUEST_IP_ADDRESSES=\"192.168.1.115,fe80::c0ff:fe43:a473\" STATE=a CPU=0.00 MEMORY=4022272 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=60,DEPLOY_ID="420d53d5-9379-04b6-6eab-7f81bd5bcb28",VM_NAME="one-60-rabbitmq2 - CloudCustomers",POLL="GUEST_IP=10.0.20.104 GUEST_IP_ADDRESSES=\"10.0.20.104,fe80::aff:fe00:1468\" STATE=a CPU=0.00 MEMORY=1067008 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.30\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=2147483647 VMWARETOOLS_VERSION_STATUS=guestToolsUnmanaged RESOURCE_POOL=\"Resources\" "]
VM = [ID=67,DEPLOY_ID="420d88be-ae9c-ca86-ff50-40ead483c782",VM_NAME="one-67-acme server - CloudCustomers",POLL="GUEST_IP=192.168.1.112 GUEST_IP_ADDRESSES=\"fe80::a10f:bc2b:7096:d90d,192.168.1.112,fe80::99f6:bcac:8863:116d,10.0.21.10\" STATE=a CPU=149.98 MEMORY=16862208 NETRX=0 NETTX=10854400 ESX_HOST=\"1.1.10.33\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=9541 VMWARETOOLS_VERSION_STATUS=guestToolsNeedUpgrade RESOURCE_POOL=\"Resources\" "]
VM = [ID=-1,DEPLOY_ID="420d04b9-cb7e-f4b6-090c-60c0b5b42356",VM_NAME="Win2012R2Std_x64_MSSQLStd_x64 - CloudCustomers",IMPORT_TEMPLATE="TkFNRSAgID0gIldpbjIwMTJSMlN0ZF94NjRfTVNTUUxTdGRfeDY0IC0gQ2xvdWRDdXN0b21lcnMiCkNQVSAgICA9ICIxIgp2Q1BVICAgPSAiMSIKTUVNT1JZID0gIjIwNDgiCkhZUEVSVklTT1IgPSAidmNlbnRlciIKUFVCTElDX0NMT1VEID0gWwogIFRZUEUgICAgICAgID0idmNlbnRlciIsCiAgVk1fVEVNUExBVEUgPSI0MjBkMDRiOS1jYjdlLWY0YjYtMDkwYy02MGMwYjViNDIzNTYiLAogIEhPU1QgICAgICAgID0iQ2xvdWRDdXN0b21lcnMiCl0KSU1QT1JUX1ZNX0lEICAgID0gIjQyMGQwNGI5LWNiN2UtZjRiNi0wOTBjLTYwYzBiNWI0MjM1NiIKSU1QT1JUX1NUQVRFICAgPSAiUlVOTklORyIKU0NIRURfUkVRVUlSRU1FTlRTPSJOQU1FPVwiQ2xvdWRDdXN0b21lcnNcIiIKREVTQ1JJUFRJT04gPSAidkNlbnRlciBWaXJ0dWFsIE1hY2hpbmUgaW1wb3J0ZWQgYnkgT3Blbk5lYnVsYSBmcm9tIENsdXN0ZXIgQ2xvdWRDdXN0b21lcnMiCkxPR089aW1hZ2VzL2xvZ29zL3dpbmRvd3M4LnBuZw==",POLL="STATE=a CPU=1.99 MEMORY=1978368 NETRX=0 NETTX=0 ESX_HOST=\"1.1.10.32\" GUEST_STATE=running VMWARETOOLS_RUNNING_STATUS=guestToolsRunning VMWARETOOLS_VERSION=10246 VMWARETOOLS_VERSION_STATUS=guestToolsCurrent RESOURCE_POOL=\"Resources\" "]
CUSTOMIZATION = [ NAME = "ubuntu_14.04", TYPE = "Linux" ]
VCENTER_DATASTORE="Backup Target"
VCENTER_DATASTORE="Horizon Premium Customer Storage 1"
VCENTER_DATASTORE="NetApp-5TB-sas"
VCENTER_DATASTORE="nmg_Internal_sas"
VCENTER_DATASTORE="OpenStackGlance"
VCENTER_DATASTORE="OpenStackNova"
VCENTER_DATASTORE="acmeStorage"
VCENTER_DATASTORE="Sas1"
VCENTER_DATASTORE="Sas2"
VCENTER_DATASTORE="Sas3"
VCENTER_DATASTORE="datastore1 (1)"
VCENTER_DATASTORE="datastore1 (2)"
VCENTER_DATASTORE="datastore1 (3)"
VCENTER_DATASTORE="datastore1 (4)"
VCENTER_DATASTORE="datastore1 (5)"
VCENTER_DATASTORE="datastore1 (6)"
VCENTER_DATASTORE="datastore1 (7)"
VCENTER_DATASTORE="datastore1 (8)"
VCENTER_DATASTORE="datastore1"
VCENTER_DATASTORE="vRealize Appliance Storage"
VCENTER_DATASTORE="vRealize Premium Customer Storage 1"
The vm_id in question her is 160 and 161, which doesn’t even appear in the output from the command above that I ran. They are both on template id 10 with out from below:
[root@nebula52-prod ~]# onetemplate show 10 -x
<VMTEMPLATE>
<ID>10</ID>
<UID>2</UID>
<GID>0</GID>
<UNAME>CloudAdmin</UNAME>
<GNAME>oneadmin</GNAME>
<NAME>Win 2012 R2 Std</NAME>
<PERMISSIONS>
<OWNER_U>1</OWNER_U>
<OWNER_M>1</OWNER_M>
<OWNER_A>0</OWNER_A>
<GROUP_U>1</GROUP_U>
<GROUP_M>0</GROUP_M>
<GROUP_A>0</GROUP_A>
<OTHER_U>1</OTHER_U>
<OTHER_M>0</OTHER_M>
<OTHER_A>0</OTHER_A>
</PERMISSIONS>
<REGTIME>1470965718</REGTIME>
<TEMPLATE>
<CONTEXT>
<NETWORK><![CDATA[YES]]></NETWORK>
<PASSWORD><![CDATA[$PASSWORD]]></PASSWORD>
<USERNAME><![CDATA[$USERNAME]]></USERNAME>
</CONTEXT>
<CPU><![CDATA[0.1]]></CPU>
<DESCRIPTION><![CDATA[Windows 2012 Server R2 x64]]></DESCRIPTION>
<GRAPHICS>
<LISTEN><![CDATA[0.0.0.0]]></LISTEN>
<TYPE><![CDATA[VNC]]></TYPE>
</GRAPHICS>
<HYPERVISOR><![CDATA[vcenter]]></HYPERVISOR>
<KEEP_DISKS_ON_DONE><![CDATA[NO]]></KEEP_DISKS_ON_DONE>
<LABELS><![CDATA[Windows]]></LABELS>
<LOGO><![CDATA[images/logos/windows8.png]]></LOGO>
<MEMORY><![CDATA[1024]]></MEMORY>
<NAME><![CDATA[Win 2012 R2 Standard 64-bit]]></NAME>
<PUBLIC_CLOUD>
<TYPE><![CDATA[vcenter]]></TYPE>
<VM_TEMPLATE><![CDATA[420d5483-a201-52a6-b877-49e0ccac4806]]></VM_TEMPLATE>
</PUBLIC_CLOUD>
<USER_INPUTS>
<CPU><![CDATA[O|fixed|| |0.1]]></CPU>
<MEMORY><![CDATA[M|list||1024,2048,4096,8192,16384,32768,65536|1024]]></MEMORY>
<PASSWORD><![CDATA[M|text|Password]]></PASSWORD>
<USERNAME><![CDATA[M|list|Username|Administrator|Administrator]]></USERNAME>
<VCPU><![CDATA[O|list||1,2,4,8,16,32|1]]></VCPU>
</USER_INPUTS>
<VCPU><![CDATA[1]]></VCPU>
</TEMPLATE>
</VMTEMPLATE>
We have a bunch of storage attached to vcenter, but all vm templates use OpenStackGlance. I’ve seen that issue appear on other machines as well before, but those machines are long gone. The way I’ve seen it before was that after machine got built the deploy_id was changed to cluster name and machines wouldn’t get any update. This seems to be a little different in that 161 has the correct deploy_id. Actually 160 shows up as the other error that I just mentioned. Deploy_id got changed to vm name in this case - it is supper strange.
Hi!
sorry I’ve been rereading all the info once again.
VM with ID 161. Yes, as you say the DEPLOY_ID has a vcenter UUID and the VM is in STATE: POWEROFF so it won’t get monitoring info. The ERROR=“Fri Sep 23 23:45:44 2016 : Ignoring monitoring information, error:syntax error, unexpected $end, expecting EQUAL or EQUAL_EMPTY at line 1, columns 1:15. Monitor information was: CloudCustomers” for that VM is fine to ignore, that was an error that happened on September so you can safely remove it. Then I think that VM is fine and can be powered on to get new monitoring info.
I can’t see how the deploy_id of the VM 160 is not an UUID and what happened to those VM as well, indeed is weirdl. Do you have any info on what would have happened at the time those VMs changed the deploy_id? (an update, a cluster migration?) that can gives us a clue? Also can you see a one-160-daddy1 VM in the Zombies tab if you visit Infrastructure -> Hosts -> CloudCustomers?
Cheers!
The thing with 161 one is that it is on and it has been on since the beginning. I powerd it on anyway and got this in sunstone
It appears there was a server exception. Please check server's log.
I checkned oned.log and there was nothing there related to this. Both 160 and 161 are not wild or zombie.
I don’t recall changing clusters or anything really that would cause this. I can try to migrate this machine to dev environment to have more freedom to poke around.