Newbie need help

Community Support
1

Hi, my Name ist Heinz and i´m really newbie.
First of all i try to set up a Open Nebula CLuster with Ceph as datastore.

Open Nebula Cluster
1 Frontend called Nebula01 (HP DL 360 G6)
3 Nodes called Cnode01, Cnode02, Cnode03 (2 x HP DL 360 G8 , 1 x DL 360 G6)

Ceph Cluster
1 x Admin, Deploy Node called Cephmon01 (HP DL 360 G6)
3 x Mon Nodes called Cephnode01, Cephnode02, Cephnode03 (HP DL 360 G6)

Open Nebula configured Basic based on the Quick Start Dokumentation
https://docs.opennebula.org/5.4/deployment/open_cloud_storage_setup/ceph_ds.html

oneadmin@Nebula01:~$ tree -ps /var/lib/one/datastores/
/var/lib/one/datastores/
├── [drwxr-xr-x 4096] 0
├── [drwxr-xr-x 4096] 1
│ ├── [-rw-r–r-- 248529635] 08366c48e2690f2e2610598ebed5b3d6
│ └── [-rw-r–r-- 24933376] afcf5fe247928aa98d2261171d0fe1c2
└── [drwxr-xr-x 4096] 2

3 directories, 2 files

sgadmin@Cnode01:/$ lsmod | grep kvm
kvm_amd 65536 0
kvm 544768 1 kvm_amd
irqbypass 16384 1 kvm

oneadmin@Nebula01:~$ onedatastore show cephds
DATASTORE 101 INFORMATION
ID : 101
NAME : cephds
USER : oneadmin
GROUP : oneadmin
CLUSTERS : 0
TYPE : IMAGE
DS_MAD : ceph
TM_MAD : ceph
BASE PATH : /var/lib/one//datastores/101
DISK_TYPE : RBD
STATE : READY

DATASTORE CAPACITY
TOTAL: : 0M
FREE: : 0M
USED: : 0M
LIMIT: : -

PERMISSIONS
OWNER : uma
GROUP : u–
OTHER : —

DATASTORE TEMPLATE
ALLOW_ORPHANS="YES"
BRIDGE_LIST="cnode01"
CEPH_HOST="cephnode01:6789 cephnode02:6789 cephnode03:6789"
CEPH_SECRET="e11a118b-851c-4b1e-9563-abbf526af28d"
CEPH_USER="libvirt"
DISK_TYPE="RBD"
DS_MIGRATE="NO"
POOL_NAME="one"
RBD_FORMAT=“2"
RESTRICTED_DIRS=”/“
SAFE_DIRS=”/var/tmp"
SHARED="YES"
TM_MAD="ceph"
TYPE=“SYSTEM_DS”

IMAGES
oneadmin@Nebula01:~$ cat ds
cat: ds: No such file or directory
oneadmin@Nebula01:~$ cat ds.conf
cat: ds.conf: No such file or directory
oneadmin@Nebula01:~$ onedatastore show ceph_system
DATASTORE 100 INFORMATION
ID : 100
NAME : ceph_system
USER : oneadmin
GROUP : oneadmin
CLUSTERS : 0
TYPE : SYSTEM
DS_MAD : -
TM_MAD : ceph
BASE PATH : /var/lib/one//datastores/100
DISK_TYPE : RBD
STATE : READY

DATASTORE CAPACITY
TOTAL: : 0M
FREE: : 0M
USED: : 0M
LIMIT: : -

PERMISSIONS
OWNER : um-
GROUP : u–
OTHER : —

DATASTORE TEMPLATE
ALLOW_ORPHANS="YES"
BRIDGE_LIST="cnode01"
CEPH_HOST="cephnode01:6789 cephnode02:6789 cephnode03:6789"
CEPH_SECRET="e11a118b-851c-4b1e-9563-abbf526af28d"
CEPH_USER="libvirt"
DISK_TYPE="RBD"
DS_MIGRATE="NO"
POOL_NAME="one"
RBD_FORMAT=“2"
RESTRICTED_DIRS=”/“
SAFE_DIRS=”/var/tmp"
SHARED="YES"
TM_MAD="ceph"
TYPE=“SYSTEM_DS”

Ceph Cluster configured Basic based on Ceph Quickstart Dokumentation

 health HEALTH_OK
 monmap e3: 3 mons at {cephnode01=10.8.0.15:6789/0,cephnode02=10.8.0.16:6789/0,cephnode03=10.8.0.17:6789/0}
        election epoch 12, quorum 0,1,2 cephnode01,cephnode02,cephnode03
 osdmap e162: 18 osds: 18 up, 18 in
        flags sortbitwise,require_jewel_osds
  pgmap v4296: 232 pgs, 7 pools, 1588 bytes data, 171 objects
        746 MB used, 9477 GB / 9477 GB avail
             232 active+clean

ceph osd lspools
0 rbd,1 .rgw.root,2 default.rgw.control,3 default.rgw.data.root,4 default.rgw.gc,5 default.rgw.log,6 one,

And now my problems:

i tried to verifiy my Opennebula Installation with 3.4.1 KVM Based Cloud Verification
i imported the TTYLinux Template on the defoult configuerd datastore (not Ceph)…but don´t wont start with error:

  • deploy_action, error getting driver kv
  • New LCM state is BOOT_FAILURE

2nd. Problem:
my Ceph Datastore isn´t correct configured, it shows 0 Space

It´s a desaster for a newbie like me.
Please help…Team Viewer Session it´s also a solution. :rofl:
Regards Heinz