Cannot dispatch VM to host, but no error

Community Support
1

Hello,

I have two hosts, each in their own cluster.

I’m trying to provision a new VM and I’m trying to find out why it remains in the PENDING state forever. The sched.log says:

Wed Sep 22 20:04:53 2021 [Z0][SCHED][D]: Setting VM groups placement constraints. Total time: 0.00s
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Request #23 HOST/#1 MANAGE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * HOST/#1  #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * ZONE/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * MARKETPLACE+MARKETPLACEAPP/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 VM+IMAGE+TEMPLATE+DOCUMENT+SECGROUP+VMGROUP/* CREATE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 HOST/* MANAGE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Permission granted
Wed Sep 22 20:04:53 2021 [Z0][SCHED][D]: Host 1 discarded for VM 62. Not enough memory: 4194304/2303452
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Request #23 HOST/#2 MANAGE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * HOST/#2  #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * ZONE/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * MARKETPLACE+MARKETPLACEAPP/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 VM+IMAGE+TEMPLATE+DOCUMENT+SECGROUP+VMGROUP/* CREATE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 HOST/* MANAGE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Permission granted
Wed Sep 22 20:04:53 2021 [Z0][RANK][D]: Rank evaluation for expression : - RUNNING_VMS
Wed Sep 22 20:04:53 2021 [Z0][RANK][D]: ID: 2 Rank: 0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Request #23 DATASTORE/#100 USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * DATASTORE/#100  #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * ZONE/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * MARKETPLACE+MARKETPLACEAPP/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 VM+IMAGE+TEMPLATE+DOCUMENT+SECGROUP+VMGROUP/* CREATE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 HOST/* MANAGE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 NET/* USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 DATASTORE/* USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Permission granted
Wed Sep 22 20:04:53 2021 [Z0][SCHED][D]: System DS 100 discarded for VM 62. It does not fulfill SCHED_DS_REQUIREMENTS.
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Request #23 DATASTORE/#101 USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * DATASTORE/#101  #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * ZONE/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * MARKETPLACE+MARKETPLACEAPP/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 VM+IMAGE+TEMPLATE+DOCUMENT+SECGROUP+VMGROUP/* CREATE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 HOST/* MANAGE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 NET/* USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 DATASTORE/* USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Permission granted
Wed Sep 22 20:04:53 2021 [Z0][SCHED][D]: System DS 101 discarded for VM 62. It does not fulfill SCHED_DS_REQUIREMENTS.
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Request #23 DATASTORE/#102 USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * DATASTORE/#102  #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * ZONE/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  * MARKETPLACE+MARKETPLACEAPP/* USE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 VM+IMAGE+TEMPLATE+DOCUMENT+SECGROUP+VMGROUP/* CREATE *
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 HOST/* MANAGE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 NET/* USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: > Rule  @1 DATASTORE/* USE #0
Wed Sep 22 20:04:53 2021 [Z0][ACL][D]: Permission granted
Wed Sep 22 20:04:53 2021 [Z0][RANK][D]: Rank evaluation for expression : FREE_MB
Wed Sep 22 20:04:53 2021 [Z0][RANK][D]: ID: 102 Rank: 0
Wed Sep 22 20:04:53 2021 [Z0][SCHED][D]: Match Making statistics:
	Number of VMs:             1
	Total time:                0s
	Total Cluster Match time:  0s
	Total Host Match time:     0.00s
	Total Host Ranking time:   0.00s
	Total DS Match time:       0.01s
	Total DS Ranking time:     0.00s
	Total Network Match time:  0.00s
	Total Network Ranking time:0s

Wed Sep 22 20:04:53 2021 [Z0][SCHED][D]: Scheduling Results:
Virtual Machine: 62

	PRI	ID - HOSTS
	------------------------
	0	2

	PRI	ID - DATASTORES
	------------------------
	0	102


Wed Sep 22 20:04:53 2021 [Z0][SCHED][D]: Dispatching VMs to hosts:
	VMID	Priority	Host	System DS
	--------------------------------------------------------------

Wed Sep 22 20:04:53 2021 [Z0][SCHED][D]: Dispatching VMs to hosts. Total time: 0.25s

So, quite correctly, it’s excluded Host 1 because of a lack of RAM, and datastores 100 and 101 as they’re not the datastore we’re requesting (and are in a different cluster).

From what I can tell, the remaining host (#2) and datastore (#102) are correct, but I’m not sure why the Dispatching VMs to hosts section appears to be empty. In other words, why isn’t it dispatching this to host 2?

This is OpenNebula 6.0.0.2 with KVM nodes.

Thanks,

Marc

2

Hi @gigatux ,

You can set attribute LOG/DEBUG_LEVEL to 5 in /etc/one/sched.conf to get a more detailed scheduling information in /var/log/one/shed.log. Requires opennebula service restart.

Cheers.

3

@rdiaz Thanks, but we’re already on DEBUG_LEVEL 5 here.

LOG = [
  SYSTEM      = "file",
  DEBUG_LEVEL = 5
]

When deploying successfully to a host (in my case, host 1), I correctly get information in the Dispatching VMs to hosts section, but not when it should be deploying to my second host.