System datastore showing 0/0 GB

laser · March 16, 2021, 8:00am

Hi Team,
After fresh installation of OpenNebula, I’m getting this result on datastores

Should it be like this ? I still didn’t touched anything regarding storage, and I thought that by default, the system datastore will have the same GB as the other ones …

laser · March 16, 2021, 8:21am

BTW -
I’ve now noticed some change between image vs. system datastores.
It seems that DS_MAD is missing there :

can it tell something ?

feldsam · March 16, 2021, 2:26pm

Hello, it is normal for system ds not have ds_mad. you should check logs for monitoring errors

grep -i error /var/log/one/oned.log

laser · March 17, 2021, 6:34am

Hi, thanks for your prompt.
Here is the output :
grep -i error /var/log/one/oned.log
Tue Mar 16 09:24:47 2021 [Z0][ONE][I]: Log level:3 [0=ERROR,1=WARNING,2=INFO,3=DEBUG]
Tue Mar 16 09:24:47 2021 [Z0][ONE][E]: SQL command was: SELECT version FROM local_db_versioning WHERE oid=(SELECT MAX(oid) FROM local_db_versioning), error: no such table: local_db_versioning
Tue Mar 16 09:24:47 2021 [Z0][ONE][E]: SQL command was: SELECT version FROM db_versioning WHERE oid=(SELECT MAX(oid) FROM db_versioning), error: no such table: db_versioning
Wed Mar 17 00:00:01 2021 [Z0][ONE][E]: SQL command was: SELECT MIN(stime) FROM history, error: callback requested query abort

BTW -
I’ve installed OpenNebula twice. one on a VM and one on physical server - and the same result…

feldsam · March 17, 2021, 10:42am

Hmm, looks like you are missing db_verioning table. Try to create it manually

github.com

OpenNebula/one/blob/947c9716cddf2c595213f4c72ac379ec57a2ecd6/src/nebula/SystemDB.cc#L33


/* -------------------------------------------------------------------------- */

// Pool control table
const char * SystemDB::pc_table = "pool_control";
const char * SystemDB::pc_names = "tablename, last_oid";

const char * SystemDB::pc_bootstrap = "CREATE TABLE pool_control "
    "(tablename VARCHAR(32) PRIMARY KEY, last_oid BIGINT UNSIGNED)";


// DB versioning table, shared (federation) tables
const char * SystemDB::shared_ver_table = "db_versioning";
const char * SystemDB::shared_ver_names = "oid, version, timestamp, comment";

const char * SystemDB::shared_ver_bootstrap = "CREATE TABLE db_versioning "
    "(oid INTEGER PRIMARY KEY, version VARCHAR(256), timestamp INTEGER, "
    "comment VARCHAR(256))";

// DB versioning table, local tables
const char * SystemDB::local_ver_table = "local_db_versioning";
const char * SystemDB::local_ver_names = "oid, version, timestamp, comment, is_slave";

laser · March 17, 2021, 11:16am

Thanks Krisitan !
But where and how to create it ? what is the exact command ?
[or to which file should I add it ? to vi /etc/one/oned.conf ]?

feldsam · March 17, 2021, 11:58am

I recommend you connect to your mysql server and check if tables are missing. If you don’t know, then google for ‘how to list mysql tables cli’ in google

feldsam · March 17, 2021, 12:00pm

but you probably dont use mysql but sqlite located in /var/lib/one/one.db. In that case I recommend you to use mysql

https://docs.opennebula.io/5.12/deployment/opennebula_installation/frontend_installation.html#step-5-enabling-mysql-mariadb-postgresql-optional

laser · March 17, 2021, 12:02pm

thanks again Kristian for this info !

laser · March 18, 2021, 9:02am

Hello Again,
The issue was with 5.12 , so now I’ve tried to install the newest version, 5.13 to see if it solves the issue.
But still, the same result.

How cab it be that I’m installing something from scratch on a new and clean machine and it happens again ? what am I missing ? I don’t want to deal with DBs, just want to install a straight-forward product.
Someone have a clue ?

feldsam · March 20, 2021, 8:04pm

probably some bug with sqlite integration? I installed OpenNebula few times without problems, but I always use MySQL.

laser · March 21, 2021, 8:22am

Very Strange.

Someone who using sqlite had this issue ??

ruben · March 22, 2021, 2:44pm

Hi, it seems that you are ssh mode, it is normal it displays 0. These drivers uses the local storage of each host, and so each host will have different usage statistics.

The actual usage of the datastore in each host is show under the host information or onehost show command. Note that this behavior is different for other drivers.

laser · March 24, 2021, 6:41am

Oh, Thanks Ruben for the professional reply.

I had an issue with create a VM [Pending STATE forever], so I suspected it was this issue. but now that you are saying that it’s normal behavior, I’ll go ahead and add the host again, and check other things.

Thanks !

When I’ll add an host, should I configure something in order to be able to create the VM on the host’s datastore [local] ? or if I’ll choose the VM to be create on the host, it’ll choose the host’s datastore by default ?

carolynperry · March 27, 2021, 6:54pm

this is really helpful for me. thank you for sharing with us…

arora2deepak · April 16, 2021, 11:03am

Damm even I am having a similar kind of issue, I have searched all over the internet and even have posted on number of threads on different forum, no solution seems to work. I am really frustrated, can anyone of you here help me resolve this issue, I am very much tired now.

ahuertas · April 16, 2021, 11:08am

Hello @laser

If you want to use local storage of the host, you need to follow these steps:

Have a system datastore using TM_MAD=ssh (this is created by default when you start OpenNebula first time)
Create the host and wait until it is in ON state.
Then when creating the VM, it will be deployed on the host and the system datastore.

If the VM is in PENDING state for so long, you need to check /var/log/one/sched.log to see what is the problem there. If you are not able to figure out, you can increase the scheduler debug level by editing the file /etc/one/sched.conf and changing the value under debug_level, then restart the scheduler.

Best,
Álex.

laser · April 20, 2021, 9:53am

Hi Alex, and thanks for your detailed reply.

I’ve installed the new version now [it’s the 4-5 time…] and the same happens…
My ‘system’ datastore is 0 GB…

I’m having the TM_MAD=ssh on my datastore.
I’m trying to create a VM on my host, and choosing the system datastore, and the VM is in “CLONING” state…

Can you please assist to solve it ? now I see that I’m not the only one who having that issue
Thanks in advance !

Here is the log :
cat /var/log/one/sched.log
Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: Init Scheduler Log system
Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: Starting Scheduler Daemon

 Scheduler Configuration File

COLD_MIGRATE_MODE=0
DEFAULT_DS_SCHED=POLICY=1
DEFAULT_NIC_SCHED=POLICY=1
DEFAULT_SCHED=POLICY=1
DIFFERENT_VNETS=YES
LIVE_RESCHEDS=0
LOG=DEBUG_LEVEL=3,SYSTEM=file
MAX_DISPATCH=30
MAX_HOST=1
MAX_VM=5000
MEMORY_SYSTEM_DS_SCALE=0
MESSAGE_SIZE=1073741824
ONE_XMLRPC=http://localhost:2633/RPC2
SCHED_INTERVAL=15
TIMEOUT=60

Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: XML-RPC client using 1073741824 bytes for response buffer.

Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: oned successfully contacted.
Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: Configuring scheduler for Zone ID: 0
Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: Starting scheduler loop…

And here is the ‘system’ datastore :

ahuertas · April 21, 2021, 8:16am

Hello @laser,

That system datastore is completely normal. Could you please share the VM log with the error you are getting when deploying a VM? It is located in /var/log/one/<VM_ID>.log.

Best,
Álex.

laser · April 21, 2021, 9:42am

Hi Alex, here is the log :
cat /var/log/one/0.log
Tue Apr 20 11:24:13 2021 [Z0][VM][I]: New state is CLONING
Tue Apr 20 11:24:31 2021 [Z0][VM][I]: New state is CLONING

And this is from my other setup, which there all the VMs I’m trying to create, are in PENDING state forever, and the VM log, just shows nothing.

After I’m deleting the VM I can see this :
cat /var/log/one/2.log
Tue Mar 9 04:12:31 2021 [Z0][VM][I]: New state is DONE
Tue Mar 9 04:12:31 2021 [Z0][VM][I]: New LCM state is LCM_INIT

And I want to thank you for your time & attention.
Hope we’ll be able to solve it

Thanks

Topic		Replies	Views
Storage Datastores ID0 system Unable to display capacity Community Support	2	462	February 14, 2017
Incorrect Datastore Info in OpenNebula 4.14 Community Support	0	451	July 18, 2016
[one.datastore.info] Error getting datastore [0] Storage	2	681	August 29, 2022
Running VMs in system DS Community Support	3	963	September 7, 2015
Datastore can see only 50GB General	3	355	January 11, 2021

System datastore showing 0/0 GB

Here is the log : cat /var/log/one/sched.log Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: Init Scheduler Log system Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: Starting Scheduler Daemon

Related topics

Here is the log :
cat /var/log/one/sched.log
Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: Init Scheduler Log system
Tue Apr 20 11:03:13 2021 [Z0][SCHED][I]: Starting Scheduler Daemon