Shared file system with OpenNebula and Ceph

Community Support Storage
1

Hi
We are having an error with OpenNebula and CEPH as like " VM Migration Issue Between Ceph Hypervisors.

I am running ceph nautilus and the cluster is running properly. I’m having issues getting ceph datastores working properly on my installation, running 5.8.0-1 on Ubuntu18 with a shared file system along with Ceph datastores. I am having issues with migrations between hosts with TM_MAD set to “ceph”.

Here are my Error:

Thu Apr 9 13:47:08 2020 [Z0][TM][I]: Command execution failed (exit code: 2): /var/lib/one/remotes/tm/ceph/mv node3:/var/lib/one//datastores/124/1114 node2:/var/lib/one//datastores/124/1114 1114 124
Thu Apr 9 13:47:08 2020 [Z0][TM][I]: mv: Moving node3:/var/lib/one/datastores/124/1114 to node2:/var/lib/one/datastores/124/1114
Thu Apr 9 13:47:08 2020 [Z0][TM][E]: mv: Command “set -e -o pipefail
Thu Apr 9 13:47:08 2020 [Z0][TM][I]:
Thu Apr 9 13:47:08 2020 [Z0][TM][I]: tar -C /var/lib/one/datastores/124 --sparse -cf - 1114 | ssh node2-dhk-cls1.bol-online.com ‘tar -C /var/lib/one/datastores/124 --sparse -xf -’
Thu Apr 9 13:47:08 2020 [Z0][TM][I]: rm -rf /var/lib/one/datastores/124/1114” failed: tar: 1114: Cannot stat: No such file or directory
Thu Apr 9 13:47:08 2020 [Z0][TM][I]: tar: Exiting with failure status due to previous errors
Thu Apr 9 13:47:08 2020 [Z0][TM][E]: Error copying disk directory to target host
Thu Apr 9 13:47:08 2020 [Z0][TM][E]: Error executing image transfer script: Error copying disk directory to target host

Regards
Mosharaf

2

Did you check if a directory /var/lib/one//datastores/124/1114 exists on node3?

3

As I am using shared file system, normally the folder is available on the location as said; While I have trying to migrate and OpenNebula strart migration process, then in between the process, system deleted the currently location to activate it to another node but failed.
Theres may have an issue with ceph datastore and tm_mad=CEPH.

4

CEPH tm_mad uses SSH tm_mad move action. Probably log you posted is from retry action and files was deleted in first move action, which failed on something other.