Onedb upgrade to 6.10 failed

Patrick_Jahnke · September 3, 2024, 9:30am

Hello everybody,

I tried to update my lab environment to 6.10 and experienced a bug/failure. If I try to upgrade the db I get the following error:

Version read:
Shared tables 6.8.0 : Database migrated from 6.6.0 to 6.8.0 (OpenNebula 6.8.0) by onedb command.
Local tables  6.8.0 : Database migrated from 6.6.0 to 6.8.0 (OpenNebula 6.8.0) by onedb command.

MySQL dump stored in /var/lib/one/mysql_localhost_opennebula_2024-9-3_10:50:52.sql
Use 'onedb restore' or restore the DB using the mysql command:
mysql -u user -h server -P port db_name < backup_file


>>> Running migrators for shared tables
  > Running migrator /usr/lib/one/ruby/onedb/shared/6.8.0_to_6.10.0.rbm
  > Done in 0.00s

Database migrated from 6.8.0 to 6.10.0 (OpenNebula 6.10.0) by onedb command.

>>> Running migrators for local tables
  > Running migrator /usr/lib/one/ruby/onedb/local/6.8.0_to_6.10.0.rbm

#<ArgumentError: invalid byte sequence in UTF-8>
/usr/share/ruby/rexml/source.rb:189:in `check'
/usr/share/ruby/rexml/source.rb:189:in `match'
/usr/share/ruby/rexml/parsers/baseparser.rb:394:in `pull_event'
/usr/share/ruby/rexml/parsers/baseparser.rb:216:in `pull'
/usr/share/ruby/rexml/parsers/treeparser.rb:23:in `parse'
/usr/share/ruby/rexml/document.rb:288:in `build'
/usr/share/ruby/rexml/document.rb:45:in `initialize'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/xml_mini/rexml.rb:27:in `new'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/xml_mini/rexml.rb:27:in `parse'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/xml_mini.rb:99:in `parse'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/core_ext/hash/conversions.rb:131:in `initialize'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/core_ext/hash/conversions.rb:110:in `new'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/core_ext/hash/conversions.rb:110:in `from_xml'
local/6.8.0_to_6.10.0.rb:125:in `block (2 levels) in feature_5861'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/dataset/actions.rb:164:in `block in each'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:243:in `block (2 levels) in fetch_rows'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:243:in `each'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:243:in `block in fetch_rows'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:157:in `_execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/utils/mysql_mysql2.rb:40:in `block in execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/connection_pool/threaded.rb:88:in `hold'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/connecting.rb:286:in `synchronize'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/utils/mysql_mysql2.rb:40:in `execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/dataset/actions.rb:1189:in `execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:281:in `execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:241:in `fetch_rows'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/dataset/actions.rb:164:in `each'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/dataset.rb:61:in `fetch'
local/6.8.0_to_6.10.0.rb:122:in `block in feature_5861'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/transactions.rb:264:in `_transaction'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/transactions.rb:239:in `block in transaction'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/connection_pool/threaded.rb:92:in `hold'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/connecting.rb:286:in `synchronize'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/transactions.rb:197:in `transaction'
local/6.8.0_to_6.10.0.rb:121:in `feature_5861'
local/6.8.0_to_6.10.0.rb:41:in `up'
/usr/lib/one/ruby/onedb/onedb.rb:416:in `apply_migrators'
/usr/lib/one/ruby/onedb/onedb.rb:306:in `upgrade'
/usr/bin/onedb:469:in `block (2 levels) in <main>'
/usr/lib/one/ruby/cli/command_parser.rb:476:in `run'
/usr/lib/one/ruby/cli/command_parser.rb:84:in `initialize'
/usr/bin/onedb:355:in `new'
/usr/bin/onedb:355:in `<main>'
...
Exception parsing
Line: 143
Position: 5822
Last 80 unconsumed characters:
[CDATA[Ubuntu Server 18.04 Template System HDD 10GB - Update 24032020  Login: use
/usr/share/ruby/rexml/parsers/baseparser.rb:455:in `rescue in pull_event'
/usr/share/ruby/rexml/parsers/baseparser.rb:376:in `pull_event'
/usr/share/ruby/rexml/parsers/baseparser.rb:216:in `pull'
/usr/share/ruby/rexml/parsers/treeparser.rb:23:in `parse'
/usr/share/ruby/rexml/document.rb:288:in `build'
/usr/share/ruby/rexml/document.rb:45:in `initialize'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/xml_mini/rexml.rb:27:in `new'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/xml_mini/rexml.rb:27:in `parse'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/xml_mini.rb:99:in `parse'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/core_ext/hash/conversions.rb:131:in `initialize'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/core_ext/hash/conversions.rb:110:in `new'
/usr/share/one/gems-dist/gems/activesupport-4.2.11.3/lib/active_support/core_ext/hash/conversions.rb:110:in `from_xml'
local/6.8.0_to_6.10.0.rb:125:in `block (2 levels) in feature_5861'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/dataset/actions.rb:164:in `block in each'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:243:in `block (2 levels) in fetch_rows'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:243:in `each'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:243:in `block in fetch_rows'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:157:in `_execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/utils/mysql_mysql2.rb:40:in `block in execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/connection_pool/threaded.rb:88:in `hold'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/connecting.rb:286:in `synchronize'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/utils/mysql_mysql2.rb:40:in `execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/dataset/actions.rb:1189:in `execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:281:in `execute'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/adapters/mysql2.rb:241:in `fetch_rows'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/dataset/actions.rb:164:in `each'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/dataset.rb:61:in `fetch'
local/6.8.0_to_6.10.0.rb:122:in `block in feature_5861'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/transactions.rb:264:in `_transaction'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/transactions.rb:239:in `block in transaction'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/connection_pool/threaded.rb:92:in `hold'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/connecting.rb:286:in `synchronize'
/usr/share/one/gems-dist/gems/sequel-5.82.0/lib/sequel/database/transactions.rb:197:in `transaction'
local/6.8.0_to_6.10.0.rb:121:in `feature_5861'
local/6.8.0_to_6.10.0.rb:41:in `up'
/usr/lib/one/ruby/onedb/onedb.rb:416:in `apply_migrators'
/usr/lib/one/ruby/onedb/onedb.rb:306:in `upgrade'
/usr/bin/onedb:469:in `block (2 levels) in <main>'
/usr/lib/one/ruby/cli/command_parser.rb:476:in `run'
/usr/lib/one/ruby/cli/command_parser.rb:84:in `initialize'
/usr/bin/onedb:355:in `new'
/usr/bin/onedb:355:in `<main>'



The database will be restored
MySQL DB opennebula at localhost restored.

mkutouski · September 3, 2024, 10:48am

Have you performed required for the community edition release mandatory step?

Patrick_Jahnke · September 3, 2024, 11:06am

yes, I installed the opennebula-migration-community package

pczerny · September 3, 2024, 11:28am

It looks like there are special (local) characters in your VM, which the migrator can’t handle.

To help us solve the issue, can you please send us the following info:
Do you have something in /etc/one/oned.conf DB->encoding? By default this is empty.
Connect to your MySQL server and send us output of the following commands:

$ mysql -s -u <mysql_username> -p<mysql_password> opennebula
mysql> select * from local_db_versioning;
mysql> SELECT default_character_set_name,default_collation_name FROM information_schema.SCHEMATA WHERE schema_name = "opennebula";
mysql> SELECT CCSA.character_set_name,CCSA.collation_name FROM information_schema.`TABLES` T,information_schema.`COLLATION_CHARACTER_SET_APPLICABILITY` CCSA WHERE CCSA.collation_name = T.table_collation A
ND T.table_schema = "opennebula" AND T.table_name = "marketplaceapp_pool";
mysql> select * from vm_pool where body like '%Ubuntu Server 18.04 Template System HDD 10GB - Update 24032020%';

The last command should find the VM, which cause the issue, make sure the VM xml doesn’t contain sensitive information.

Just for a reference, I’m linking GitHub issue. It’s also UTF8 related, but on different place

Patrick_Jahnke · September 3, 2024, 2:33pm

my DB config looks like this:

DB = [ backend = “mysql”,
server = “localhost”,
port = 0,
user = “username”,
passwd = “password”,
db_name = “opennebula”
]

mysql> select * from local_db_versioning;

oid     version timestamp       comment is_slave
0       5.10.0  1584085942      OpenNebula 5.10.1 (45f6d6df) daemon bootstrap   0
1       5.12.0  1595314556      Database migrated from 5.10.0 to 5.12.0 (OpenNebula 5.12.0) by onedb command.   0
2       6.0.0   1620286384      Database migrated from 5.12.0 to 6.0.0 (OpenNebula 6.0.0) by onedb command.     0
3       6.2.0   1652357303      Database migrated from 6.0.0 to 6.2.0 (OpenNebula 6.2.0) by onedb command.      0
4       6.4.0   1652359908      Database migrated from 6.2.0 to 6.4.0 (OpenNebula 6.4.0) by onedb command.      0
5       6.6.0   1700223602      Database migrated from 6.4.0 to 6.6.0 (OpenNebula 6.6.0) by onedb command.      0
6       6.8.0   1700225498      Database migrated from 6.6.0 to 6.8.0 (OpenNebula 6.8.0) by onedb command.      0

SELECT default_character_set_name,default_collation_name FROM information_schema.SCHEMATA WHERE schema_name = “opennebula”;

default_character_set_name      default_collation_name
latin1  latin1_swedish_ci

SELECT CCSA.character_set_name,CCSA.collation_name FROM information_schema.TABLES T,information_schema.COLLATION_CHARACTER_SET_APPLICABILITY CCSA WHERE CCSA.collation_name = T.table_collation AND T.table_schema = “opennebula” AND T.table_name = “marketplaceapp_pool”;

character_set_name      collation_name
latin1  latin1_swedish_ci

select * from vm_pool where body like ‘%Ubuntu Server 18.04 Template System HDD 10GB - Update 24032020%’;

there is no output/result

I modified it to: select * from vm_pool where body like ‘%Update 24032020%’;

oid     name    body    uid     gid     state   lcm_state       owner_u group_u other_u short_body      search_token
12      deleteme        <VM>\n  <ID>12</ID>\n  <UID>4</UID>\n  <GID>0</GID>\n  <UNAME>user</UNAME>\n  <GNAME>oneadmin</GNAME>\n  <NAME>deleteme</NAME>\n  <PERMISSIONS>\n    <OWNER_U>1</OWNER_U>\n    <OWNER_M>1</OWNER_M>\n    <OWNER_A>0</OWNER_A>\n    <GROUP_U>0</GROUP_U>\n    <GROUP_M>0</GROUP_M>\n    <GROUP_A>0</GROUP_A>\n    <OTHER_U>0</OTHER_U>\n    <OTHER_M>0</OTHER_M>\n    <OTHER_A>0</OTHER_A>\n  </PERMISSIONS>\n  <STATE>6</STATE>\n  <LCM_STATE>0</LCM_STATE>\n  <PREV_STATE>6</PREV_STATE>\n  <PREV_LCM_STATE>0</PREV_LCM_STATE>\n  <RESCHED>0</RESCHED>\n  <STIME>1585116096</STIME>\n  <ETIME>1587444610</ETIME>\n  <DEPLOY_ID>one-12</DEPLOY_ID>\n  <MONITORING/>\n  <TEMPLATE>\n    <AUTOMATIC_DS_REQUIREMENTS><![CDATA[("CLUSTERS/ID" @> 100)]]></AUTOMATIC_DS_REQUIREMENTS>\n    <AUTOMATIC_NIC_REQUIREMENTS><![CDATA[("CLUSTERS/ID" @> 100)]]></AUTOMATIC_NIC_REQUIREMENTS>\n    <AUTOMATIC_REQUIREMENTS><![CDATA[(CLUSTER_ID = 100) & !(PUBLIC_CLOUD = YES) & !(PIN_POLICY = PINNED)]]></AUTOMATIC_REQUIREMENTS>\n    <CONTEXT>\n      <DISK_ID><![CDATA[1]]></DISK_ID>\n      <ETH0_CONTEXT_FORCE_IPV4><![CDATA[]]></ETH0_CONTEXT_FORCE_IPV4>\n      <ETH0_DNS><![CDATA[]]></ETH0_DNS>\n      <ETH0_EXTERNAL><![CDATA[]]></ETH0_EXTERNAL>\n      <ETH0_GATEWAY><![CDATA[]]></ETH0_GATEWAY>\n      <ETH0_GATEWAY6><![CDATA[]]></ETH0_GATEWAY6>\n      <ETH0_IP><![CDATA[]]></ETH0_IP>\n      <ETH0_IP6><![CDATA[]]></ETH0_IP6>\n      <ETH0_IP6_PREFIX_LENGTH><![CDATA[]]></ETH0_IP6_PREFIX_LENGTH>\n      <ETH0_IP6_ULA><![CDATA[]]></ETH0_IP6_ULA>\n      <ETH0_MAC><![CDATA[02:be:ef:00:66:02]]></ETH0_MAC>\n      <ETH0_MASK><![CDATA[]]></ETH0_MASK>\n      <ETH0_MTU><![CDATA[]]></ETH0_MTU>\n      <ETH0_NETWORK><![CDATA[]]></ETH0_NETWORK>\n      <ETH0_SEARCH_DOMAIN><![CDATA[]]></ETH0_SEARCH_DOMAIN>\n      <ETH0_VLAN_ID><![CDATA[66]]></ETH0_VLAN_ID>\n      <ETH0_VROUTER_IP><![CDATA[]]></ETH0_VROUTER_IP>\n      <ETH0_VROUTER_IP6><![CDATA[]]></ETH0_VROUTER_IP6>\n      <ETH0_VROUTER_MANAGEMENT><![CDATA[]]></ETH0_VROUTER_MANAGEMENT>\n      <NETWORK><![CDATA[YES]]></NETWORK>\n      <SSH_PUBLIC_KEY><![CDATA[deleted]]></SSH_PUBLIC_KEY>\n      <TARGET><![CDATA[hda]]></TARGET>\n    </CONTEXT>\n    <CPU><![CDATA[0.5]]></CPU>\n    <CPU_MODEL>\n      <MODEL><![CDATA[kvm64]]></MODEL>\n    </CPU_MODEL>\n    <DISK>\n      <ALLOW_ORPHANS><![CDATA[NO]]></ALLOW_ORPHANS>\n      <CLONE><![CDATA[YES]]></CLONE>\n      <CLONE_TARGET><![CDATA[SYSTEM]]></CLONE_TARGET>\n      <CLUSTER_ID><![CDATA[0,100]]></CLUSTER_ID>\n      <DATASTORE><![CDATA[default]]></DATASTORE>\n      <DATASTORE_ID><![CDATA[1]]></DATASTORE_ID>\n      <DEV_PREFIX><![CDATA[vd]]></DEV_PREFIX>\n      <DISK_ID><![CDATA[0]]></DISK_ID>\n      <DISK_SNAPSHOT_TOTAL_SIZE><![CDATA[0]]></DISK_SNAPSHOT_TOTAL_SIZE>\n      <DISK_TYPE><![CDATA[FILE]]></DISK_TYPE>\n      <DRIVER><![CDATA[qcow2]]></DRIVER>\n      <IMAGE><![CDATA[Ubuntu-18.04.4-System-HDD]]></IMAGE>\n      <IMAGE_ID><![CDATA[6]]></IMAGE_ID>\n      <IMAGE_STATE><![CDATA[2]]></IMAGE_STATE>\n      <IMAGE_UNAME><![CDATA[user]]></IMAGE_UNAME>\n      <LN_TARGET><![CDATA[SYSTEM]]></LN_TARGET>\n      <ORDER><![CDATA[1]]></ORDER>\n      <ORIGINAL_SIZE><![CDATA[10240]]></ORIGINAL_SIZE>\n      <READONLY><![CDATA[NO]]></READONLY>\n      <SAVE><![CDATA[NO]]></SAVE>\n      <SIZE><![CDATA[10240]]></SIZE>\n      <SOURCE><![CDATA[/var/lib/one//datastores/1/c3773afad8b6ddeac095382dda3a7223]]></SOURCE>\n      <TARGET><![CDATA[vda]]></TARGET>\n      <TM_MAD><![CDATA[ssh]]></TM_MAD>\n      <TYPE><![CDATA[FILE]]></TYPE>\n    </DISK>\n    <FEATURES>\n      <ACPI><![CDATA[yes]]></ACPI>\n      <APIC><![CDATA[yes]]></APIC>\n      <GUEST_AGENT><![CDATA[yes]]></GUEST_AGENT>\n    </FEATURES>\n    <GRAPHICS>\n      <LISTEN><![CDATA[0.0.0.0]]></LISTEN>\n      <TYPE><![CDATA[VNC]]></TYPE>\n    </GRAPHICS>\n    <MEMORY><![CDATA[4096]]></MEMORY>\n    <NIC>\n      <AR_ID><![CDATA[0]]></AR_ID>\n      <BRIDGE><![CDATA[ovs-em2]]></BRIDGE>\n      <BRIDGE_TYPE><![CDATA[openvswitch]]></BRIDGE_TYPE>\n      <CLUSTER_ID><![CDATA[100]]></CLUSTER_ID>\n      <MAC><![CDATA[02:be:ef:00:66:02]]></MAC>\n      <NAME><![CDATA[NIC0]]></NAME>\n      <NETWORK><![CDATA[LAN66_Services]]></NETWORK>\n      <NETWORK_ID><![CDATA[3]]></NETWORK_ID>\n      <NIC_ID><![CDATA[0]]></NIC_ID>\n      <PHYDEV><![CDATA[em2]]></PHYDEV>\n      <SECURITY_GROUPS><![CDATA[0]]></SECURITY_GROUPS>\n      <TARGET><![CDATA[one-12-0]]></TARGET>\n      <VLAN_ID><![CDATA[66]]></VLAN_ID>\n      <VN_MAD><![CDATA[ovswitch]]></VN_MAD>\n    </NIC>\n    <OS>\n      <ARCH><![CDATA[x86_64]]></ARCH>\n      <BOOT><![CDATA[disk0]]></BOOT>\n    </OS>\n    <SECURITY_GROUP_RULE>\n      <PROTOCOL><![CDATA[ALL]]></PROTOCOL>\n      <RULE_TYPE><![CDATA[OUTBOUND]]></RULE_TYPE>\n      <SECURITY_GROUP_ID><![CDATA[0]]></SECURITY_GROUP_ID>\n      <SECURITY_GROUP_NAME><![CDATA[default]]></SECURITY_GROUP_NAME>\n    </SECURITY_GROUP_RULE>\n    <SECURITY_GROUP_RULE>\n      <PROTOCOL><![CDATA[ALL]]></PROTOCOL>\n      <RULE_TYPE><![CDATA[INBOUND]]></RULE_TYPE>\n      <SECURITY_GROUP_ID><![CDATA[0]]></SECURITY_GROUP_ID>\n      <SECURITY_GROUP_NAME><![CDATA[default]]></SECURITY_GROUP_NAME>\n    </SECURITY_GROUP_RULE>\n    <TEMPLATE_ID><![CDATA[7]]></TEMPLATE_ID>\n    <TM_MAD_SYSTEM><![CDATA[ssh]]></TM_MAD_SYSTEM>\n    <VCPU><![CDATA[4]]></VCPU>\n    <VMID><![CDATA[12]]></VMID>\n  </TEMPLATE>\n  <USER_TEMPLATE>\n    <DESCRIPTION><![CDATA[Ubuntu Server 18.04 Template\nSystem HDD 10GB - Update 24032020\n\nLogin: user01 / Password.1234\nAdmin: root / Password.1234\n\nDefault-IP: 10.64.66.254\n\nDatei /root/ip-config-change.sh anpassen, ausführen und rebooten.]]></DESCRIPTION>\n    <HYPERVISOR><![CDATA[kvm]]></HYPERVISOR>\n    <LOGO><![CDATA[images/logos/ubuntu.png]]></LOGO>\n    <MEMORY_UNIT_COST><![CDATA[MB]]></MEMORY_UNIT_COST>\n  </USER_TEMPLATE>\n  <HISTORY_RECORDS>\n    <HISTORY>\n      <OID>12</OID>\n      <SEQ>0</SEQ>\n      <HOSTNAME>on64.gttng.lab.dt</HOSTNAME>\n      <HID>0</HID>\n      <CID>100</CID>\n      <STIME>1585116105</STIME>\n      <ETIME>1587444610</ETIME>\n      <VM_MAD><![CDATA[kvm]]></VM_MAD>\n      <TM_MAD><![CDATA[ssh]]></TM_MAD>\n      <DS_ID>0</DS_ID>\n      <PSTIME>1585116105</PSTIME>\n      <PETIME>1585116136</PETIME>\n      <RSTIME>1585116136</RSTIME>\n      <RETIME>1585120348</RETIME>\n      <ESTIME>1587444608</ESTIME>\n      <EETIME>1587444610</EETIME>\n      <ACTION>27</ACTION>\n      <UID>4</UID>\n      <GID>0</GID>\n      <REQUEST_ID>160</REQUEST_ID>\n    </HISTORY>\n  </HISTORY_RECORDS>\n  <BACKUPS>\n    <BACKUP_CONFIG/>\n    <BACKUP_IDS/>\n  </BACKUPS>\n  <SCHED_ACTIONS/>\n</VM>     4       0       6       0       1       0       0       <VM><ID>12</ID><UID>4</UID><GID>0</GID><UNAME>user</UNAME><GNAME>oneadmin</GNAME><NAME>deleteme</NAME><LAST_POLL>1585120348</LAST_POLL><STATE>6</STATE><LCM_STATE>0</LCM_STATE><RESCHED>0</RESCHED><STIME>1585116096</STIME><ETIME>1587444610</ETIME><DEPLOY_ID>one-12</DEPLOY_ID><TEMPLATE><CPU>0.5</CPU><MEMORY>4096</MEMORY><DISK><DISK_ID><![CDATA[0]]></DISK_ID><DATASTORE><![CDATA[default]]></DATASTORE><DATASTORE_ID><![CDATA[1]]></DATASTORE_ID><IMAGE><![CDATA[Ubuntu-18.04.4-System-HDD]]></IMAGE><IMAGE_ID><![CDATA[6]]></IMAGE_ID><SIZE><![CDATA[10240]]></SIZE><TYPE><![CDATA[FILE]]></TYPE><CLONE><![CDATA[YES]]></CLONE><CLONE_TARGET><![CDATA[SYSTEM]]></CLONE_TARGET><LN_TARGET><![CDATA[SYSTEM]]></LN_TARGET><DISK_SNAPSHOT_TOTAL_SIZE><![CDATA[0]]></DISK_SNAPSHOT_TOTAL_SIZE></DISK><NIC><MAC><![CDATA[02:be:ef:00:66:02]]></MAC><NETWORK><![CDATA[LAN66_Services]]></NETWORK><NETWORK_ID><![CDATA[3]]></NETWORK_ID><NIC_ID><![CDATA[0]]></NIC_ID><SECURITY_GROUPS><![CDATA[0]]></SECURITY_GROUPS></NIC><GRAPHICS><LISTEN><![CDATA[0.0.0.0]]></LISTEN><TYPE><![CDATA[VNC]]></TYPE></GRAPHICS></TEMPLATE><MONITORING><CPU><![CDATA[0.0]]></CPU><MEMORY><![CDATA[0]]></MEMORY><STATE><![CDATA[a]]></STATE></MONITORING><USER_TEMPLATE></USER_TEMPLATE><HISTORY_RECORDS><HISTORY><OID>12</OID><SEQ>0</SEQ><HOSTNAME><![CDATA[on64.gttng.lab.dt]]></HOSTNAME><HID>0</HID><CID>100</CID><DS_ID>0</DS_ID><ACTION><![CDATA[27]]></ACTION></HISTORY></HISTORY_RECORDS></VM>       UNAME=user\nGNAME=oneadmin\nAUTOMATIC_DS_REQUIREMENTS=("CLUSTERS/ID" @> 100)\nAUTOMATIC_NIC_REQUIREMENTS=("CLUSTERS/ID" @> 100)\nAUTOMATIC_REQUIREMENTS=(CLUSTER_ID = 100) & !(PUBLIC_CLOUD = YES) & !(PIN_POLICY = PINNED)\nDISK_ID=1\nETH0_MAC=02_be_ef_00_66_02\nETH0_VLAN_ID=66\nNETWORK=YES\nSSH_PUBLIC_KEY=deleted\nTARGET=hda\nCPU=0_5\nMODEL=kvm64\nALLOW_ORPHANS=NO\nCLONE=YES\nCLONE_TARGET=SYSTEM\nCLUSTER_ID=0,100\nDATASTORE=default\nDATASTORE_ID=1\nDEV_PREFIX=vd\nDISK_ID=0\nDISK_SNAPSHOT_TOTAL_SIZE=0\nDISK_TYPE=FILE\nDRIVER=qcow2\nIMAGE=Ubuntu_18_04_4_System_HDD\nIMAGE_ID=6\nIMAGE_STATE=2\nIMAGE_UNAME=user\nLN_TARGET=SYSTEM\nORDER=1\nORIGINAL_SIZE=10240\nREADONLY=NO\nSAVE=NO\nSIZE=10240\nSOURCE=/var/lib/one//datastores/1/c3773afad8b6ddeac095382dda3a7223\nTARGET=vda\nTM_MAD=ssh\nTYPE=FILE\nACPI=yes\nAPIC=yes\nGUEST_AGENT=yes\nLISTEN=0_0_0_0\nTYPE=VNC\nMEMORY=4096\nAR_ID=0\nBRIDGE=ovs_em2\nBRIDGE_TYPE=openvswitch\nCLUSTER_ID=100\nMAC=02_be_ef_00_66_02\nNAME=NIC0\nNETWORK=LAN66_Services\nNETWORK_ID=3\nNIC_ID=0\nPHYDEV=em2\nSECURITY_GROUPS=0\nTARGET=one_12_0\nVLAN_ID=66\nVN_MAD=ovswitch\nARCH=x86_64\nBOOT=disk0\nPROTOCOL=ALL\nRULE_TYPE=OUTBOUND\nSECURITY_GROUP_ID=0\nSECURITY_GROUP_NAME=default\nPROTOCOL=ALL\nRULE_TYPE=INBOUND\nSECURITY_GROUP_ID=0\nSECURITY_GROUP_NAME=default\nTEMPLATE_ID=7\nVCPU=4\nVMID=12\n\nDESCRIPTION=Ubuntu Server 18_04 Template\nSystem HDD 10GB _ Update 24032020\n\nLogin_ user01 / Password.1234\nAdmin_ root / Password.1234\n\nDefault_IP_ 10_64_66_254\n\nDatei /root/ip_config_change_sh anpassen, ausfÃ¼hren und rebooten_\nHYPERVISOR=kvm\nLOGO=images/logos/ubuntu_png\nMEMORY_UNIT_COST=MB\nNAME=deleteme\n

this is just the first line, there are more

so could the problem be “ausfÃ¼hren”/“ausführen”?

pczerny · September 3, 2024, 8:51pm

Yes, the problem is probably ausfÃ¼hren, if you manually replace it by ausführen, the upgrade should work.

It’s old DB, created with latin1 charset. New default charset for MySQL is utf8mb4. We had multiple issues with the DB charset, the final fix should be this issue, included in 6.8.0 and 6.6.1 version.

Can you try onevm show 12 in version 6.8? Does it work? I think it shouldn’t, the bug was introduced, by some previous upgrade.

Note: OpenNebula tools onedb change-body or onedb update-body will throw the same error. You need to manually fix the wrong character either by ugly command line in mysql or some GUI over the MySQL backend. If you need help with the command line, let me know here.

Patrick_Jahnke · September 4, 2024, 1:16pm

Thanks, that helped! Changed every “ausfÃ¼hren” und “ausführen” to “ausfuehren”. At first I tried to change “ausfÃ¼hren” to “ausführen”, but this didnt work.

Topic		Replies	Views
Upgrading onedb database from 4.10 to 4.12 fails Community Support	8	1552	March 11, 2015
[onedb] Upgrade error 5.10 -> 5.12 Upgrade	3	560	January 19, 2022
Db upgrade community 6.0.0 to 6.2.0 Upgrade	9	1461	May 23, 2022
Upgrade on debian 10 from 6.4 to 6.6 -- database upgrade not working Upgrade	3	343	October 10, 2024
Onedb upgrade 5.6 to 5.8 upgrades database to 5.10 Upgrade	2	1096	July 12, 2019

Onedb upgrade to 6.10 failed

Related topics