OpenNebula VM's in UNKNOWN state for a brief time

Hello all,

We are using Opennebula 4.10.2 in combination with a VCenter/VMWare ESXi 5.1 cluster. We configured the system to send an email on each status change of a VM.

A few times now we noticed that all VM’s are running in an unknown state. This only happens for a short time and restores itself. The VM’s are running fine. So wer eceive an email all VM’s are in an unknown state immediately followed by an email that says all VM’s are running.

The logging shows:

Wed Aug 26 16:47:36 2015 [Z0][InM][I]: Command execution fail: /var/lib/one/remotes/im/run_probes vcenter /var/lib/one//datastores 4124 20 0 cluster-01
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/connection.rb:61:in `parse_response': ManagedObjectNotFound: The object has already been deleted or ha
s not been completely created (RbVmomi::Fault)
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/connection.rb:90:in `call'
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/basic_types.rb:203:in `_call'
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/basic_types.rb:74:in `block (2 levels) in init'
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/basic_types.rb:183:in `_get_property'
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/basic_types.rb:35:in `block (2 levels) in init'
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vcenter_driver.rb:571:in `block in monitor_vms'
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vcenter_driver.rb:570:in `each'
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vcenter_driver.rb:570:in `monitor_vms'
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: from ./vcenter.rb:43:in `<main>'
Wed Aug 26 16:47:36 2015 [Z0][InM][E]: Error executing vcenter.rb
Wed Aug 26 16:47:36 2015 [Z0][InM][I]: ExitCode: 1
Wed Aug 26 16:47:36 2015 [Z0][ONE][E]: Error monitoring Host cluster-01 (0): Error executing vcenter.rb

While typing his post it just happened again:

Thu Aug 27 11:27:34 2015 [Z0][InM][I]: Command execution fail: /var/lib/one/remotes/im/run_probes vcenter /var/lib/one//datastores 4124 20 0 cluster-01
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/connection.rb:61:in `parse_response': ManagedObjectNotFound: The object has already been deleted or has not been completely created (RbVmomi::Fault)
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/connection.rb:90:in `call'
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/basic_types.rb:203:in `_call'
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/basic_types.rb:74:in `block (2 levels) in init'
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/basic_types.rb:183:in `_get_property'
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/basic_types.rb:35:in `block (2 levels) in init'
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vcenter_driver.rb:571:in `block in monitor_vms'
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vcenter_driver.rb:570:in `each'
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from /usr/lib/one/ruby/vcenter_driver.rb:570:in `monitor_vms'
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: from ./vcenter.rb:43:in `<main>'
Thu Aug 27 11:27:34 2015 [Z0][InM][E]: Error executing vcenter.rb
Thu Aug 27 11:27:34 2015 [Z0][InM][I]: ExitCode: 1
Thu Aug 27 11:27:34 2015 [Z0][ONE][E]: Error monitoring Host cluster-01 (0): Error executing vcenter.rb

Is this a known problem ? If yes, has it already been fixed in later versions ? Is there another solution ?

Kind Regards,
Rolf

Hi,

This issue should be fixed in 4.12.1, please update and let us know if the wrong behaviour persists.