Hi,
bash-4.2$ onedatastore list
ID NAME SIZE AVAIL CLUSTERS IMAGES TYPE DS TM STAT
1 CloudKVM-1 HD 529.7G 99% - 0 img fs ssh on
102 CloudStorage_ 889.7G 95% - 0 sys - shared on
103 CloudStorage_ 529.7G 99% - 0 fil fs shared on
106 CephDatastore 13.6T 100% 0 1 img ceph ceph on
108 CephSystem 13.6T 100% 0 0 sys - ceph on
bash-4.2$ onecluster show 0
CLUSTER 0 INFORMATION
ID : 0
NAME : CloudKVM
CLUSTER TEMPLATE
RESERVED_CPU=""
RESERVED_MEM=""
HOSTS
11
12
13
VNETS
0
DATASTORES
106
108
Access granted for all nodes:
bash-4.2$ rbd ls -p one --id libvirt
one-16
one-16-22-0
Also enable migrate via oned.conf.
TM_MAD_CONF = [
NAME = "ceph", LN_TARGET = "NONE", CLONE_TARGET = "SELF", SHARED = "YES",
DS_MIGRATE = "YES"
]
But when i try to migrate RUNNING VM from one host to another get error:
Sun Jan 22 02:28:41 2017 [Z0][VM][I]: New LCM state is RUNNING
Sun Jan 22 02:29:33 2017 [Z0][VM][I]: New LCM state is MIGRATE
Sun Jan 22 02:33:31 2017 [Z0][VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one/datastores/108/22/deployment.0' 'CephKVM-3' 22 CephKVM-3
Sun Jan 22 02:33:31 2017 [Z0][VMM][I]: error: Failed to create domain from /var/lib/one/datastores/108/22/deployment.0
Sun Jan 22 02:33:31 2017 [Z0][VMM][I]: error: internal error: qemu unexpectedly closed the monitor: 2017-01-21T23:33:31.269851Z qemu-kvm: -drive file=rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789,format=qcow2,if=none,id=drive-virtio-disk0,cache=none: error connecting
Sun Jan 22 02:33:31 2017 [Z0][VMM][I]: 2017-01-21T23:33:31.271699Z qemu-kvm: -drive file=rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789,format=qcow2,if=none,id=drive-virtio-disk0,cache=none: could not open disk image rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789: Could not open 'rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789': Connection timed out
Sun Jan 22 02:33:31 2017 [Z0][VMM][E]: Could not create domain from /var/lib/one/datastores/108/22/deployment.0
Sun Jan 22 02:33:31 2017 [Z0][VMM][I]: ExitCode: 255
Sun Jan 22 02:33:31 2017 [Z0][VMM][I]: Failed to execute virtualization driver operation: deploy.
Sun Jan 22 02:33:31 2017 [Z0][VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one/datastores/108/22/deployment.0
Sun Jan 22 02:33:31 2017 [Z0][VM][I]: New LCM state is RUNNING
Sun Jan 22 02:33:31 2017 [Z0][LCM][I]: Fail to live migrate VM. Assuming that the VM is still RUNNING (will poll VM).
Sun Jan 22 02:33:32 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_premigrate.
Sun Jan 22 02:33:32 2017 [Z0][VMM][I]: Successfully execute network driver operation: pre.
Sun Jan 22 02:33:32 2017 [Z0][VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/migrate '' 'CephKVM-1' 'CephKVM-3' 22 CephKVM-3
Sun Jan 22 02:33:32 2017 [Z0][VMM][E]: migrate: Command "virsh --connect qemu:///system migrate --live qemu+ssh://CephKVM-1/system" failed: error: command 'migrate' requires option
Sun Jan 22 02:33:32 2017 [Z0][VMM][E]: Could not migrate to CephKVM-1
Sun Jan 22 02:33:32 2017 [Z0][VMM][I]: ExitCode: 1
Sun Jan 22 02:33:32 2017 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_failmigrate.
Sun Jan 22 02:33:32 2017 [Z0][VMM][I]: Failed to execute virtualization driver operation: migrate.
Sun Jan 22 02:33:32 2017 [Z0][VMM][E]: Error live migrating VM: Could not migrate to CephKVM-1
Sun Jan 22 02:33:32 2017 [Z0][LCM][E]: deploy_failure_action, VM in a wrong state
Sun Jan 22 02:34:11 2017 [Z0][LCM][I]: VM running but monitor state is POWEROFF
Sun Jan 22 02:34:11 2017 [Z0][VM][I]: New LCM state is SHUTDOWN_POWEROFF
Sun Jan 22 02:34:11 2017 [Z0][VM][I]: New state is POWEROFF
Sun Jan 22 02:34:11 2017 [Z0][VM][I]: New LCM state is LCM_INIT
Sun Jan 22 03:02:24 2017 [Z0][VM][I]: New LCM state is PROLOG_MIGRATE_POWEROFF
Sun Jan 22 03:02:24 2017 [Z0][VM][I]: New state is ACTIVE
Sun Jan 22 03:02:25 2017 [Z0][VM][I]: New state is POWEROFF
Sun Jan 22 03:02:25 2017 [Z0][VM][I]: New LCM state is LCM_INIT
Jan 22 09:49:37 CloudKVM-1 libvirtd[1902]: Unable to read from monitor: Connection reset by peer
Jan 22 09:49:37 CloudKVM-1 libvirtd[1902]: internal error: qemu unexpectedly closed the monitor: 2017-01-22T06:49:37.337420Z qemu-kvm: -drive file=rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789,format=qcow2,if=none,id=drive-virtio-disk0,cache=none: error connecting
2017-01-22T06:49:37.339458Z qemu-kvm: -drive file=rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789,format=qcow2,if=none,id=drive-virtio-disk0,cache=none: could not open disk image rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789: Could not open 'rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789': Connection timed out
Jan 22 09:57:31 CloudKVM-1 libvirtd[1902]: Unable to read from monitor: Connection reset by peer
Jan 22 09:57:31 CloudKVM-1 libvirtd[1902]: internal error: qemu unexpectedly closed the monitor: 2017-01-22T06:57:31.420236Z qemu-kvm: -drive file=rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789,format=qcow2,if=none,id=drive-virtio-disk0,cache=none: error connecting
2017-01-22T06:57:31.422036Z qemu-kvm: -drive file=rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789,format=qcow2,if=none,id=drive-virtio-disk0,cache=none: could not open disk image rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789: Could not open 'rbd:one/one-16-22-0:id=libvirt:key=AQCAYoNYR0hTMxAAKXfPA82v+uvk9JS4ZcTI+w==:auth_supported=cephx\;none:mon_host=10.0.10.11\:6789\;10.0.10.22\:6789\;10.0.10.33\:6789': Connection timed out
[ceph@CloudKVM-1 ~]$ sudo virsh list
Id Name State
----------------------------------------------------
1 one-22 paused
[ceph@CloudKVM-1 ~]$ sudo virsh qemu-monitor-command --hmp one-22 'info block'
error: Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainCreateXML)
What`s wrong?