OpenNebula Ceph HA for VM

Community Support
1

Good Day, Community
I have install Ceph Storage System (3 mons and 3 osd servers)
3 mons are installed on seperate VMs
and 3 osd nodes with KVM node for opennebula
I installed Opennebula without any problem and connected Ceph System_DS and Image_DS without any Problem by next guide:
https://docs.opennebula.io/6.0/open_cluster_deployment/storage_setup/ceph_ds.html

Size and etc everything ok. I was able to create and boot one VM on kvm1-host … without any issues. If i select VM and click on Storage - I see name of OS Image and Image located on cephDS.

So, I try to reboot kvm1 and expect that VM will be migrated to KVM2. But Vm on KVM1 become POWEROFF.
I configurated HA like this: Virtual Machines High Availability — OpenNebula 6.0.4 documentation

All packages is last for UBUNTU bullseye/sid

Please help me :slight_smile: make VM migrate to next available KVM host
Live migration works find
Thx

2

Hi, are you checked the contents of ft/host_error.rb hook? You need to implement fencing in it. Check oned.log too.

3

Good afternoon, yes, I looked at the file you specified. Commented out line:
#echo ““Fence host not configured, please edit ft/fence_host.sh”” && exit 1

But i think the problem is deeper. HA VM will work If Shared Storage Persist in DS. and seems that OpenNebula thinks that i do not have Shared Storage. Here is my configs:

System DS:

ALLOW_ORPHANS mixed
BRIDGE_LIST IP-KVM1 IP-KVM2
CEPH_HOST MON1:6789 MON2:6789 MON3:6789
CEPH_SECRET secret
CEPH_USER oneadmin
DISK_TYPE FILE
DS_MIGRATE NO
POOL_NAME one
RESTRICTED_DIRS /
SAFE_DIRS /var/tmp
SHARED YES
TM_MAD ceph
TYPE SYSTEM_DS

Image DS:

ALLOW_ORPHANS mixed
BRIDGE_LIST IP-KVM1 IP-KVM2
CEPH_HOST MON1:6789 MON2:6789 MON3:6789
CEPH_SECRET secret
CEPH_USER oneadmin
CLONE_TARGET SELF
CLONE_TARGET_SHARED SELF
CLONE_TARGET_SSH SYSTEM
DISK_TYPE RBD
DISK_TYPE_SHARED RBD
DISK_TYPE_SSH FILE
DRIVER raw
DS_MAD ceph
LN_TARGET NONE
LN_TARGET_SHARED NONE
LN_TARGET_SSH SYSTEM
POOL_NAME one
RESTRICTED_DIRS /
SAFE_DIRS /var/tmp
TM_MAD ceph
TM_MAD_SYSTEM ssh,shared