LINSTOR addon 3.x: VM disks are created in image resource group instead of system datastore

Product Support Installation & Configuration
1

Hello,

I recently migrated from the unofficial linstor_un driver to the official addon-linstor (v3.0.5) and noticed a change in behavior regarding VM disk placement.

Environment

  • OpenNebula: 7.0.1
  • LINSTOR addon: 3.0.5
  • Storage backend: LINSTOR + DRBD
  • Cluster: 3 frontend nodes, multiple hypervisors

Problem

When instantiating a VM, I explicitly select a SYSTEM datastore for disk placement (e.g. nebula-system-ssd-pc2, ID=107).

However, the VM is deployed using a system datastore (selected by scheduler), but the actual LINSTOR resource is created in the image datastore resource group (nebula-images)

Example

Selected in Web-UI

  • Placement ā†’ Datastore: nebula-system-ssd-pc2 (ID=107)

Resulting VM

A different system datastore is selected by the scheduler (ID=108):

VIRTUAL MACHINE HISTORY                                                         
SEQ UID  REQ   HOST         ACTION       DS           START        TIME     PROLOG
  0 -    -     hyperdev01   none        108  03/20 05:55:30   0d 01h00m   0h00m12s

Datastore configuration

Image datastore (ID=109):

DATASTORE TEMPLATE                                                              
ALLOW_ORPHANS="yes"
BRIDGE_LIST="hyperdev01 hyperdev02"
CLONE_TARGET="SYSTEM"
CLONE_TARGET_SHARED="SYSTEM"
CLONE_TARGET_SSH="SYSTEM"
COMPATIBLE_SYS_DS="107,106,108,0"
DISK_TYPE="BLOCK"
DISK_TYPE_SHARED="BLOCK"
DISK_TYPE_SSH="BLOCK"
DS_MAD="linstor"
LINSTOR_CONTROLLERS="192.168.250.101:3370,192.168.250.102:3370,192.168.250:3370"
LINSTOR_RESOURCE_GROUP="nebula-images"
LN_TARGET="NONE"
LN_TARGET_SHARED="NONE"
LN_TARGET_SSH="NONE"
PERSISTENT_SNAPSHOTS="YES"
RESTRICTED_DIRS="/"
SAFE_DIRS="/var/tmp"
TM_MAD="linstor"
TM_MAD_SYSTEM="ssh,shared"
TYPE="IMAGE_DS"

System datastore with resource-group place count 2 (ID=107):

ALLOW_ORPHANS="yes"
BRIDGE_LIST="hyperdev01 hyperdev02"
DISK_TYPE="BLOCK"
DS_MIGRATE="YES"
LINSTOR_CONTROLLERS="192.168.250.101:3370,192.168.250.102:3370,192.168.250:3370"
LINSTOR_RESOURCE_GROUP="nebula-system-ssd-pc2"
RESTRICTED_DIRS="/"
SAFE_DIRS="/var/tmp"
SHARED="YES"
TM_MAD="linstor"
TYPE="SYSTEM_DS"

LINSTOR resource

ā•­ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā•®
ā”Š ResourceName                    ā”Š ResourceGroup ā”Š Layers       ā”Š State ā”Š
ā•žā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•”
ā”Š OpenNebula-Image-37-vm288-disk0 ā”Š nebula-images ā”Š DRBD,STORAGE ā”Š ok    ā”Š
ā•°ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā•Æ

LINSTOR resource groups

ā•­ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā•®
ā”Š ResourceGroup         ā”Š SelectFilter             ā”Š VlmNrs ā”Š Description ā”Š
ā•žā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•ā•”
ā”Š DfltRscGrp            ā”Š PlaceCount: 2            ā”Š        ā”Š             ā”Š
ā•žā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā•”
ā”Š nebula-images         ā”Š PlaceCount: 1            ā”Š 0      ā”Š             ā”Š
ā”Š                       ā”Š StoragePool(s): ssd-pool ā”Š        ā”Š             ā”Š
ā•žā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā•”
ā”Š nebula-system-ssd-pc1 ā”Š PlaceCount: 1            ā”Š 0      ā”Š             ā”Š
ā”Š                       ā”Š StoragePool(s): ssd-pool ā”Š        ā”Š             ā”Š
ā•žā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā•”
ā”Š nebula-system-ssd-pc2 ā”Š PlaceCount: 2            ā”Š 0      ā”Š             ā”Š
ā”Š                       ā”Š StoragePool(s): ssd-pool ā”Š        ā”Š             ā”Š
ā•žā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā”„ā•”
ā”Š nebula-system-ssd-pc3 ā”Š PlaceCount: 3            ā”Š 0      ā”Š             ā”Š
ā”Š                       ā”Š StoragePool(s): ssd-pool ā”Š        ā”Š             ā”Š
ā•°ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā”€ā•Æ

Is it possible to make OpenNebula create VM disks in the system datastore resource group instead of inheriting from the image?

2

Hello @Get_Smile,

Apologies for the delay in the reply. From what I could investigate, this behavior is expected with the current LINSTOR add-on 3.x integration. VM disks are created in the image resource group by design, as LINSTOR handles placement differently compared to traditional system datastore workflows.

I suggest you to check this post from Linbit: How to setup Linstor on OpenNebula.
Or check for some support on Linbit forum, or User Guides and Product Documentation, also from Linbit.

Regards,