# Problem create VM with CEPH datastore

**URL:** <https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721>\
**Category:** Product Support\
**Created:** [August 8, 2016, 6:12am UTC](https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721 "2016-08-08T06:12:04Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![vynt-kenshiro](https://avatars.discourse-cdn.com/v4/letter/v/5fc32e/32.png) [@vynt-kenshiro](https://forum.opennebula.io/u/vynt-kenshiro)\
**Post date:** [August 8, 2016, 6:12am UTC](https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721/1 "2016-08-08T06:12:04Z")

</div>

Hello,

I’m trying to create VM with CEPH datastore and I got some problems and I can’t launch new VM. Anyone try OpenNebula with CEPH before ? Please help me create VM with CEPH datastore.

**VM error log:**

_Sun Aug 7 22:59:46 2016 [Z0][VM][I]: New state is ACTIVE_  
_Sun Aug 7 22:59:46 2016 [Z0][VM][I]: New LCM state is PROLOG_  
_Sun Aug 7 22:59:48 2016 [Z0][VM][I]: New LCM state is BOOT_  
_Sun Aug 7 22:59:48 2016 [Z0][VMM][I]: Generating deployment file: /var/lib/one/vms/20/deployment.0_  
_Sun Aug 7 22:59:48 2016 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm\_context._  
_Sun Aug 7 22:59:48 2016 [Z0][VMM][I]: Successfully execute network driver operation: pre._  
_Sun_  
\_ Aug 7 22:59:50 2016 [Z0][VMM][I]: Command execution fail: cat \<\<\_  
\_ EOT | /var/tmp/one/vmm/kvm/deploy \_  
_’/var/lib/one//datastores/111/20/deployment.0’ ‘hv004’ 20 hv004_  
_Sun Aug 7 22:59:50 2016 [Z0][VMM][I]: error: Failed to create domain from /var/lib/one//datastores/111/20/deployment.0_  
_Sun_  
\_ Aug 7 22:59:50 2016 [Z0][VMM][I]: error: internal error: early end of \_  
\_file from monitor, possible problem: 2016-08-08T05:59:49.804450Z \_  
_qemu-system-x86\_64: -drive \_  
 file=rbd:one/one-7-20-0:id=libvirt1:key=AQBYaaVXXLV6EhAAUHJbIW1zjO2orxmkvnz3Xg==:auth\_supported=cephx;none:mon\_host=cp001:6789;hv001:6789;hv002:6789,format=qcow2,if=none,id=drive-virtio-disk0,cache=none:  
\_ Image is not in qcow2 format_  
_Sun Aug 7 22:59:50 2016 [Z0][VMM][E]: Could not create domain from /var/lib/one//datastores/111/20/deployment.0_  
_Sun Aug 7 22:59:50 2016 [Z0][VMM][I]: ExitCode: 255_  
_Sun Aug 7 22:59:50 2016 [Z0][VMM][I]: Failed to execute virtualization driver operation: deploy._  
_Sun_  
\_ Aug 7 22:59:50 2016 [Z0][VMM][E]: Error deploying virtual machine: \_  
\_Could not create domain from \_  
_/var/lib/one//datastores/111/20/deployment.0_  
_Sun Aug 7 22:59:50 2016 [Z0][VM][I]: New LCM state is BOOT\_FAILURE_

**cephds:**  
_root@cp001:~# onedatastore show cephds_  
\_DATASTORE 110 INFORMATION \_  
\_ID : 110 \_  
\_NAME : cephds \_  
\_USER : oneadmin \_  
\_GROUP : oneadmin \_  
\_CLUSTERS : 0 \_  
\_TYPE : IMAGE \_  
\_DS\_MAD : ceph \_  
\_TM\_MAD : ceph \_  
_BASE PATH : /var/lib/one//datastores/110_  
\_DISK\_TYPE : RBD \_  
\_STATE : READY \_

\_DATASTORE CAPACITY \_  
\_TOTAL: : 159.2G \_  
\_FREE: : 158.1G \_  
\_USED: : 1.1G \_  
\_LIMIT: : - \_

\_PERMISSIONS \_  
\_OWNER : um- \_  
\_GROUP : u-- \_  
\_OTHER : — \_

\_DATASTORE TEMPLATE \_  
_BRIDGE\_LIST="hv001 hv002 hv003 hv004"_  
_CEPH\_HOST="cp001 hv001 hv002"_  
_CEPH\_SECRET="6ab28ca9-c08d-4d87-a4ee-536c6a8b4c6a"_  
_CEPH\_USER="libvirt1"_  
_CLONE\_TARGET="SELF"_  
_DISK\_TYPE="RBD"_  
_DS\_MAD="ceph"_  
_LN\_TARGET="NONE"_  
_POOL\_NAME="one"_  
_RESTRICTED\_DIRS="/"_  
_SAFE\_DIRS="/var/tmp"_  
_TM\_MAD="ceph"_  
_TYPE=“IMAGE\_DS”_

**ceph\_system:**

_root@cp001:~# onedatastore show ceph\_system_  
\_DATASTORE 111 INFORMATION \_  
\_ID : 111 \_  
\_NAME : ceph\_system \_  
\_USER : oneadmin \_  
\_GROUP : oneadmin \_  
\_CLUSTERS : 0 \_  
\_TYPE : SYSTEM \_  
\_DS\_MAD : - \_  
\_TM\_MAD : ceph \_  
_BASE PATH : /var/lib/one//datastores/111_  
\_DISK\_TYPE : FILE \_  
\_STATE : READY \_

\_DATASTORE CAPACITY \_  
\_TOTAL: : 159.2G \_  
\_FREE: : 158.1G \_  
\_USED: : 1.1G \_  
\_LIMIT: : - \_

\_PERMISSIONS \_  
\_OWNER : um- \_  
\_GROUP : u-- \_  
\_OTHER : — \_

\_DATASTORE TEMPLATE \_  
_BRIDGE\_LIST="hv001 hv002 hv003 hv004"_  
_CEPH\_HOST="cp001 hv001 hv002"_  
_CEPH\_USER="libvirt1"_  
_DISK\_TYPE="FILE"_  
_DS\_MIGRATE="NO"_  
_POOL\_NAME="one"_  
_RESTRICTED\_DIRS="/"_  
_SAFE\_DIRS="/var/tmp"_  
_SHARED="YES"_  
_TM\_MAD="ceph"_  
_TYPE=“SYSTEM\_DS”_

Thank you in advance,

---

<div class="post-metadata">

**Author:** ![vynt-kenshiro](https://avatars.discourse-cdn.com/v4/letter/v/5fc32e/32.png) [@vynt-kenshiro](https://forum.opennebula.io/u/vynt-kenshiro)\
**Post date:** [August 8, 2016, 8:32am UTC](https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721/2 "2016-08-08T08:32:37Z")

</div>

Hi,

Update: I think that the issue regarding to qcow3 format. When I create image with sunstone or oneimage command, I always got new image with qcow3 format.

---

<div class="post-metadata">

**Author:** ![vynt-kenshiro](https://avatars.discourse-cdn.com/v4/letter/v/5fc32e/32.png) [@vynt-kenshiro](https://forum.opennebula.io/u/vynt-kenshiro)\
**Post date:** [August 8, 2016, 2:08pm UTC](https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721/3 "2016-08-08T14:08:59Z")

</div>

Hi,

Update: template with raw format work with CEPH but VM can’t create snapshot. How to create VM snapshot with CEPH ?

---

<div class="post-metadata">

**Author:** ![vynt-kenshiro](https://avatars.discourse-cdn.com/v4/letter/v/5fc32e/32.png) [@vynt-kenshiro](https://forum.opennebula.io/u/vynt-kenshiro)\
**Post date:** [August 8, 2016, 2:23pm UTC](https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721/4 "2016-08-08T14:23:10Z")

</div>

Hi,

Update: CEPH + raw image can create disk snapshot but it can’t create VM snapshot. This problem is the same with thread [Ceph datastore and snapshots](https://forum.opennebula.io/t/ceph-datastore-and-snapshots/2647/7)

How to create VM with qcow2 format on CEPH datastore ? I would really appreciate if anyone can help me solve this issue.

Regards,

---

<div class="post-metadata">

**Author:** ![vynt-kenshiro](https://avatars.discourse-cdn.com/v4/letter/v/5fc32e/32.png) [@vynt-kenshiro](https://forum.opennebula.io/u/vynt-kenshiro)\
**Post date:** [August 8, 2016, 3:21pm UTC](https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721/5 "2016-08-08T15:21:20Z")

</div>

Hi,

Quote from CEPH “Ceph doesn’t support QCOW2 for hosting a virtual machine disk” 🙂

---

<div class="post-metadata">

**Author:** ![UAnton](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/uanton/32/6309_2.png) [@UAnton](https://forum.opennebula.io/u/UAnton)\
**Post date:** [August 9, 2016, 5:10pm UTC](https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721/6 "2016-08-09T17:10:57Z")

</div>

> [@vynt-kenshiro](#):
>
> Image is not in qcow2 format\_

Change qcow2 to raw.

---

<div class="post-metadata">

**Author:** ![cro](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/cro/32/4537_2.png) [@cro](https://forum.opennebula.io/u/cro)\
**Post date:** [August 9, 2016, 5:21pm UTC](https://forum.opennebula.io/t/problem-create-vm-with-ceph-datastore/2721/7 "2016-08-09T17:21:59Z")

</div>

Note that VMs with raw images can’t be snapshotted, but you _can_ snapshot the underlying disk.