[Solved] Deployment hangs at "Generating deployment file"?

Hi,

I’m a bit irritated what’s happening here currently:

When I deploy a VM to a remote host, disk.0 is copied over to remote’s system Datastore, but then ONe stops after creating the deployment-File:

root@brick:~# ls -lah /var/lib/one//datastores/118/256/
total 7.2G
drwxrwxr-x 2 oneadmin oneadmin 4.0K Aug  1 02:35 .
drwxrwxr-x 5 oneadmin oneadmin 4.0K Aug  1 02:35 ..
-rw-r--r-- 1 oneadmin oneadmin 7.2G Aug  1 02:39 disk.0
root@brick:~# 

root@one-1:~# tail -F /var/log/one/256.log 
Thu Aug  1 02:31:07 2019 [Z0][VM][I]: New state is HOLD
Thu Aug  1 02:34:36 2019 [Z0][VM][I]: New state is ACTIVE
Thu Aug  1 02:34:36 2019 [Z0][VM][I]: New LCM state is PROLOG
Thu Aug  1 02:38:36 2019 [Z0][VM][I]: New LCM state is BOOT
Thu Aug  1 02:38:36 2019 [Z0][VMM][I]: Generating deployment file: /var/lib/one/vms/256/deployment.0

I’m rather sure this worked some weeks ago …

… like here, for another remote system:

root@one-1:~# cat /var/log/one/257.log 
Thu Aug  1 03:02:06 2019 [Z0][VM][I]: New state is HOLD
Thu Aug  1 03:04:05 2019 [Z0][VM][I]: New state is ACTIVE
Thu Aug  1 03:04:05 2019 [Z0][VM][I]: New LCM state is PROLOG
Thu Aug  1 03:17:04 2019 [Z0][VM][I]: New LCM state is BOOT
Thu Aug  1 03:17:04 2019 [Z0][VMM][I]: Generating deployment file: /var/lib/one/vms/257/deployment.0
Thu Aug  1 03:17:05 2019 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_context.
Thu Aug  1 03:17:06 2019 [Z0][VMM][I]: ExitCode: 0
Thu Aug  1 03:17:06 2019 [Z0][VMM][I]: Successfully execute network driver operation: pre.
Thu Aug  1 03:17:09 2019 [Z0][VMM][I]: ExitCode: 0
Thu Aug  1 03:17:09 2019 [Z0][VMM][I]: Successfully execute virtualization driver operation: deploy.
Thu Aug  1 03:17:09 2019 [Z0][VMM][I]: ExitCode: 0
Thu Aug  1 03:17:09 2019 [Z0][VMM][I]: Successfully execute network driver operation: post.
Thu Aug  1 03:17:09 2019 [Z0][VM][I]: New LCM state is RUNNING

As described here and here, systemctl restart opennebula.service and Recover -> retry via Sunstone fixed the issue:

Thu Aug  1 12:06:38 2019 [Z0][VMM][I]: Generating deployment file: /var/lib/one/vms/258/deployment.0
Thu Aug  1 12:06:40 2019 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_context.
Thu Aug  1 12:06:41 2019 [Z0][VMM][I]: ExitCode: 0
Thu Aug  1 12:06:41 2019 [Z0][VMM][I]: Successfully execute network driver operation: pre.
Thu Aug  1 12:06:45 2019 [Z0][VMM][I]: ExitCode: 0
Thu Aug  1 12:06:45 2019 [Z0][VMM][I]: Successfully execute virtualization driver operation: deploy.
Thu Aug  1 12:06:45 2019 [Z0][VMM][I]: ExitCode: 0
Thu Aug  1 12:06:45 2019 [Z0][VMM][I]: Successfully execute network driver operation: post.
Thu Aug  1 12:06:45 2019 [Z0][VM][I]: New LCM state is RUNNING