Problem create VM with CEPH datastore

Hello,

I’m trying to create VM with CEPH datastore and I got some problems and I can’t launch new VM. Anyone try OpenNebula with CEPH before ? Please help me create VM with CEPH datastore.

VM error log:

Sun Aug 7 22:59:46 2016 [Z0][VM][I]: New state is ACTIVE
Sun Aug 7 22:59:46 2016 [Z0][VM][I]: New LCM state is PROLOG
Sun Aug 7 22:59:48 2016 [Z0][VM][I]: New LCM state is BOOT
Sun Aug 7 22:59:48 2016 [Z0][VMM][I]: Generating deployment file: /var/lib/one/vms/20/deployment.0
Sun Aug 7 22:59:48 2016 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_context.
Sun Aug 7 22:59:48 2016 [Z0][VMM][I]: Successfully execute network driver operation: pre.
Sun
_ Aug 7 22:59:50 2016 [Z0][VMM][I]: Command execution fail: cat <<_
_ EOT | /var/tmp/one/vmm/kvm/deploy _
’/var/lib/one//datastores/111/20/deployment.0’ ‘hv004’ 20 hv004
Sun Aug 7 22:59:50 2016 [Z0][VMM][I]: error: Failed to create domain from /var/lib/one//datastores/111/20/deployment.0
Sun
_ Aug 7 22:59:50 2016 [Z0][VMM][I]: error: internal error: early end of _
_file from monitor, possible problem: 2016-08-08T05:59:49.804450Z _
qemu-system-x86_64: -drive _
file=rbd:one/one-7-20-0:id=libvirt1:key=AQBYaaVXXLV6EhAAUHJbIW1zjO2orxmkvnz3Xg==:auth_supported=cephx;none:mon_host=cp001:6789;hv001:6789;hv002:6789,format=qcow2,if=none,id=drive-virtio-disk0,cache=none:
_ Image is not in qcow2 format

Sun Aug 7 22:59:50 2016 [Z0][VMM][E]: Could not create domain from /var/lib/one//datastores/111/20/deployment.0
Sun Aug 7 22:59:50 2016 [Z0][VMM][I]: ExitCode: 255
Sun Aug 7 22:59:50 2016 [Z0][VMM][I]: Failed to execute virtualization driver operation: deploy.
Sun
_ Aug 7 22:59:50 2016 [Z0][VMM][E]: Error deploying virtual machine: _
_Could not create domain from _
/var/lib/one//datastores/111/20/deployment.0
Sun Aug 7 22:59:50 2016 [Z0][VM][I]: New LCM state is BOOT_FAILURE

cephds:
root@cp001:~# onedatastore show cephds
_DATASTORE 110 INFORMATION _
_ID : 110 _
_NAME : cephds _
_USER : oneadmin _
_GROUP : oneadmin _
_CLUSTERS : 0 _
_TYPE : IMAGE _
_DS_MAD : ceph _
_TM_MAD : ceph _
BASE PATH : /var/lib/one//datastores/110
_DISK_TYPE : RBD _
_STATE : READY _

_DATASTORE CAPACITY _
_TOTAL: : 159.2G _
_FREE: : 158.1G _
_USED: : 1.1G _
_LIMIT: : - _

_PERMISSIONS _
_OWNER : um- _
_GROUP : u-- _
_OTHER : — _

_DATASTORE TEMPLATE _
BRIDGE_LIST="hv001 hv002 hv003 hv004"
CEPH_HOST="cp001 hv001 hv002"
CEPH_SECRET="6ab28ca9-c08d-4d87-a4ee-536c6a8b4c6a"
CEPH_USER="libvirt1"
CLONE_TARGET="SELF"
DISK_TYPE="RBD"
DS_MAD="ceph"
LN_TARGET="NONE"
POOL_NAME="one"
RESTRICTED_DIRS="/"
SAFE_DIRS="/var/tmp"
TM_MAD="ceph"
TYPE=“IMAGE_DS”

ceph_system:

root@cp001:~# onedatastore show ceph_system
_DATASTORE 111 INFORMATION _
_ID : 111 _
_NAME : ceph_system _
_USER : oneadmin _
_GROUP : oneadmin _
_CLUSTERS : 0 _
_TYPE : SYSTEM _
_DS_MAD : - _
_TM_MAD : ceph _
BASE PATH : /var/lib/one//datastores/111
_DISK_TYPE : FILE _
_STATE : READY _

_DATASTORE CAPACITY _
_TOTAL: : 159.2G _
_FREE: : 158.1G _
_USED: : 1.1G _
_LIMIT: : - _

_PERMISSIONS _
_OWNER : um- _
_GROUP : u-- _
_OTHER : — _

_DATASTORE TEMPLATE _
BRIDGE_LIST="hv001 hv002 hv003 hv004"
CEPH_HOST="cp001 hv001 hv002"
CEPH_USER="libvirt1"
DISK_TYPE="FILE"
DS_MIGRATE="NO"
POOL_NAME="one"
RESTRICTED_DIRS="/"
SAFE_DIRS="/var/tmp"
SHARED="YES"
TM_MAD="ceph"
TYPE=“SYSTEM_DS”

Thank you in advance,

Hi,

Update: I think that the issue regarding to qcow3 format. When I create image with sunstone or oneimage command, I always got new image with qcow3 format.

Hi,

Update: template with raw format work with CEPH but VM can’t create snapshot. How to create VM snapshot with CEPH ?

Hi,

Update: CEPH + raw image can create disk snapshot but it can’t create VM snapshot. This problem is the same with thread Ceph datastore and snapshots

How to create VM with qcow2 format on CEPH datastore ? I would really appreciate if anyone can help me solve this issue.

Regards,

Hi,

Quote from CEPH “Ceph doesn’t support QCOW2 for hosting a virtual machine disk” :slight_smile:

Change qcow2 to raw.

1 Like

Note that VMs with raw images can’t be snapshotted, but you can snapshot the underlying disk.

1 Like