I have some newly created vm’s that reschedule just fine between the 2 hosts in (cluster id 100). Other, older vm’s (created before I added a second host in the cluster) don’t want to reschedule. Even if I migrate them to the other host, and then hit reschedule they still don’t want to reschedule. I cannot see anything in the logs as to why this would be… How can I even get around debugging this? Full debug of sched.log below:
Mon Jan 13 10:56:13 2020 [Z0][VM][D]: Pending/rescheduling VM and capacity requirements:
ACTION VM CPU Memory PCI System DS Image DS
------------------------------------------------------------
RESCHED 478 40 131072 0 1024 DS 108: 0
RESCHED 541 40 131072 0 1024 DS 108: 0
Mon Jan 13 10:56:13 2020 [Z0][HOST][D]: Discovered Hosts (enabled):
ID : 6
CLUSTER_ID : 100
PUBLIC : 0
MEM_USAGE : 210929664
CPU_USAGE : 7170
MAX_MEM : 528272604
MAX_CPU : 11952
FREE_DISK : 217971
RUNNING_VMS : 237
DSID FREE_MB
------------------------------
0 11662177
106 11662177
109 13337879
PCI ADDRESS CLASS VENDOR DEVICE VMID
-------------------------------------------------------
---------------------------------------------------------------------------
Node: 0 Memory: 0/251G
---------------------------------------------------------------------------
( 0 36)( 1 37)( 2 38)( 3 39)( 4 40)( 5 41)( 6 42)( 7 43)( 8 44)( 9 45)(10 46)(11 47)(12 48)(13 49)(14 50)(15 51)(16 52)(17 53)
( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)
---------------------------------------------------------------------------
Node: 1 Memory: 0/251G
---------------------------------------------------------------------------
(18 54)(19 55)(20 56)(21 57)(22 58)(23 59)(24 60)(25 61)(26 62)(27 63)(28 64)(29 65)(30 66)(31 67)(32 68)(33 69)(34 70)(35 71)
( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)
---------------------------------------------------------------------------
ID : 7
CLUSTER_ID : 100
PUBLIC : 0
MEM_USAGE : 42598400
CPU_USAGE : 3280
MAX_MEM : 610271220
MAX_CPU : 12400
FREE_DISK : 48515
RUNNING_VMS : 79
DSID FREE_MB
------------------------------
0 13224038
106 13224038
109 13224038
PCI ADDRESS CLASS VENDOR DEVICE VMID
-------------------------------------------------------
---------------------------------------------------------------------------
Node: 0 Memory: 0/188G
---------------------------------------------------------------------------
( 0 16)( 1 17)( 2 18)( 3 19)( 4 20)( 5 21)( 6 22)( 7 23)
( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)
---------------------------------------------------------------------------
Node: 1 Memory: 0/188G
---------------------------------------------------------------------------
( 8 24)( 9 25)(10 26)(11 27)(12 28)(13 29)(14 30)(15 31)
( - -)( - -)( - -)( - -)( - -)( - -)( - -)( - -)
---------------------------------------------------------------------------
Mon Jan 13 10:56:14 2020 [Z0][VM][D]: VMs in VMGroups:
Mon Jan 13 10:56:14 2020 [Z0][VNET][D]: Discovered VNETS:
ID Leases
--------------------
0 0
4 3
5 0
6 37
8 4
Mon Jan 13 10:56:14 2020 [Z0][SCHED][D]: Getting VM and Host information. Total time: 0.40s
Mon Jan 13 10:56:14 2020 [Z0][VMGRP][D]: VM Group Scheduling information
Mon Jan 13 10:56:14 2020 [Z0][SCHED][D]: Setting VM groups placement constraints. Total time: 0.00s
Mon Jan 13 10:56:14 2020 [Z0][SCHED][D]: Host 7 discarded for VM 478. VM cannot be migrated to its current Host.
Mon Jan 13 10:56:14 2020 [Z0][SCHED][D]: Host 6 discarded for VM 541. VM cannot be migrated to its current Host.
Mon Jan 13 10:56:14 2020 [Z0][SCHED][D]: Match Making statistics:
Number of VMs: 2
Total time: 0s
Total Cluster Match time: 0s
Total Host Match time: 0.00s
Total Host Ranking time: 0.00s
Total DS Match time: 0s
Total DS Ranking time: 0s
Total Network Match time: 0s
Total Network Ranking time:0s
Mon Jan 13 10:56:14 2020 [Z0][SCHED][D]: Scheduling Results:
Virtual Machine: 478
PRI ID - HOSTS
------------------------
-1 6
PRI ID - DATASTORES
------------------------
0 109
Virtual Machine: 541
PRI ID - HOSTS
------------------------
-1 7
PRI ID - DATASTORES
------------------------
0 109
Mon Jan 13 10:56:14 2020 [Z0][SCHED][D]: Dispatching VMs to hosts:
VMID Priority Host System DS
--------------------------------------------------------------
Mon Jan 13 10:56:14 2020 [Z0][SCHED][D]: Dispatching VMs to hosts. Total time: 0.08s