Ceph + OpenNebula issue

Hello
I met strange issue …
i did setup my doc:
http://docs.opennebula.org/5.0/deployment/open_cloud_storage_setup/ceph_ds.html#frontend-setup

but getting

Thu Jul 14 03:24:10 2016 [Z0][ImM][E]: Error parsing datastore information: syntax error, unexpected VARIABLE, expecting EQUAL or EQUAL_EMPTY at line 1, columns 5:8. Monitoring information:
my_IP -> monitoring ceph host IP
:frowning:

tried cephfrontend - but any way getting this error :frowning:

Hi, Alexey,

can you paste your storage config here?

Best regards,
Vladimir

sure
onedatastore show cephds

DATASTORE 115 INFORMATION
ID : 115
NAME : cephds
USER : oneadmin
GROUP : oneadmin
CLUSTERS : 0
TYPE : IMAGE
DS_MAD : ceph
TM_MAD : ceph
BASE PATH : /var/lib/one//datastores/115
DISK_TYPE : RBD
STATE : READY

DATASTORE CAPACITY
TOTAL: : 0M
FREE: : 0M
USED: : 0M
LIMIT: : -

PERMISSIONS
OWNER : um-
GROUP : u–
OTHER : —

DATASTORE TEMPLATE
BRIDGE_LIST=“server1 server2 server3”
CEPH_HOST=“176.126.167.46”
CEPH_SECRET=“40f97aea-3368-4e58-8dc6-77a3a46e7ecf”
CEPH_USER=“libvirt”
CLONE_TARGET=“SELF”
DISK_TYPE=“RBD”
DS_MAD=“ceph”
LN_TARGET=“NONE”
POOL_NAME=“one”
RESTRICTED_DIRS=“/”
SAFE_DIRS=“/var/tmp”
TM_MAD=“ceph”

and
cat ds.conf

NAME = “cephds”
DS_MAD = ceph
TM_MAD = ceph

DISK_TYPE = RBD

POOL_NAME = one
CEPH_HOST = 176.126.167.46
CEPH_USER = libvirt
CEPH_SECRET = “40f97aea-3368-4e58-8dc6-77a3a46e7ecf”

BRIDGE_LIST = “server1 server2 server3”

forgot to mention… also I have SYSTEM_DS datastore with CEph (same cluster) and everything OK

onedatastore show ceph_system

DATASTORE 113 INFORMATION
ID : 113
NAME : ceph_system
USER : oneadmin
GROUP : oneadmin
CLUSTERS : 0
TYPE : SYSTEM
DS_MAD : -
TM_MAD : ceph
BASE PATH : /var/lib/one//datastores/113
DISK_TYPE : FILE
STATE : READY

DATASTORE CAPACITY
TOTAL: : 548.4G
FREE: : 548.4G
USED: : 0M
LIMIT: : -

PERMISSIONS
OWNER : um-
GROUP : u–
OTHER : —

DATASTORE TEMPLATE
BRIDGE_LIST=“server1 server2 server3”
CEPH_USER=“libvirt”
DISK_TYPE=“FILE”
DS_MIGRATE=“NO”
POOL_NAME=“one”
RESTRICTED_DIRS=“/”
SAFE_DIRS=“/var/tmp”
SHARED=“YES”
TM_MAD=“ceph”
TYPE=“SYSTEM_DS”

IMAGES
oneadmin@mcloud:~$ cat systemds.txt
NAME = ceph_system
TM_MAD = ceph
TYPE = SYSTEM_DS
BRIDGE_LIST=“server1 server2 server3”
POOL_NAME = one
CEPH_USER = libvirt

also :slight_smile:when i added it first time …everything was ok… then I’m delete it and now tring to re-add it and getting error :frowning:

reinstalled admin node - do same things and viola … all good :slight_smile:

HI! What hardware configuration you use for ceph? I use 4 server + 4 HP D2700. Have 36 SAS drives. 10Gb Network.
Read/Write speed = 1200/350 MB/s. In Windows VM write speed = 45MB/s. Add more drives not speed up. This is unacceptable for cloud.
Thanks!

UAnton,

Make sure you’re using virtio for the disks in the windows VM. Set device prefix to ‘vd’ in the VM template. You’ll then need to install the windows virtio drivers available from the fedora project.

Bob

Hi UAnton,

In addition if you are using Centos7 try qemu-kvm-ev from the oVirt repo. And as addition try to enable ‘virtio-blk data plane’. But with the 'qemu-kvm-ev" I can’t achieve remarkable additional performance gain by enabling it. (you can enable the feature by adding an “XML tweaking script” in the remotes/vmm/kvm/deploy script, just before the XML is passed to virsh)

Kind Regards,
Anton Todorov

UAnton
I’m setuped Opennebula + Ceph for development, right now i’m testing OpenNebula processing module for IspSystem Billing Manager 5

Thanks! Update qemu-kvm-ev resolve low speed problem!