After update to 5.12 auto deploy of new VM not working
Hi,
as the title says, I need to manually deploy new VMs since the update from 5.10 to 5.12.
I have read that this could be due to the scheduler doesn’t deploy when there are not enough ressources.
The hosts are overcommited and I can’t see a bottleneck there:
MEMORY
TOTAL : 251.5G
TOTAL +/- RESERVED : 251.5G
USED (REAL) : 163.5G
USED (ALLOCATED) : 166G
CPU
TOTAL : 3200
TOTAL +/- RESERVED : 9600
USED (REAL) : 320
USED (ALLOCATED) : 5750
I don’t see any errors in oned.log and also the sched.log doesn’t give me anything:
root@sun01: /var/log/one # cat sched.log
Wed Nov 25 11:55:58 2020 [Z0][SCHED][I]: Init Scheduler Log system
Wed Nov 25 11:55:58 2020 [Z0][SCHED][I]: Starting Scheduler Daemon
Scheduler Configuration File
DEFAULT_DS_SCHED=POLICY=1
DEFAULT_NIC_SCHED=POLICY=1
DEFAULT_SCHED=POLICY=1
DIFFERENT_VNETS=YES
LIVE_RESCHEDS=0
LOG=DEBUG_LEVEL=3,SYSTEM=file
MAX_DISPATCH=30
MAX_HOST=1
MAX_VM=5000
MEMORY_SYSTEM_DS_SCALE=0
MESSAGE_SIZE=1073741824
ONE_XMLRPC=http://localhost:2633/RPC2
SCHED_INTERVAL=30
TIMEOUT=60
Wed Nov 25 11:55:58 2020 [Z0][SCHED][I]: XML-RPC client using 1073741824 bytes for response buffer.
Wed Nov 25 11:55:59 2020 [Z0][SCHED][I]: oned successfully contacted.
Wed Nov 25 11:55:59 2020 [Z0][SCHED][I]: Configuring scheduler for Zone ID: 0
Wed Nov 25 11:55:59 2020 [Z0][SCHED][I]: Starting scheduler loop...
Wed Nov 25 11:55:59 2020 [Z0][SCHED][I]: Scheduler loop started.
I would be grateful for any help.
Edit: I just realised that there are tons of files created in the /tmp directory of the leader:
-rw------- 1 oneadmin oneadmin 19M 25. Nov 13:39 core-mm_sched-sig6-user9869-group9869-pid3708-time1606307993
-rw------- 1 oneadmin oneadmin 19M 25. Nov 13:39 core-mm_sched-sig6-user9869-group9869-pid3665-time1606307957
-rw------- 1 oneadmin oneadmin 19M 25. Nov 13:38 core-mm_sched-sig6-user9869-group9869-pid3572-time1606307922
-rw------- 1 oneadmin oneadmin 19M 25. Nov 13:38 core-mm_sched-sig6-user9869-group9869-pid3531-time1606307887
I can’t read these files. Does this has anything to do with the problem?