Error when importing a DockerHub image

[Daniel_Ruiz_Molina]

Hello,

I have added a testing Firecracker node to my OpenNebula environment and, now, I want to test a Firecracker image. After installing docker, docker-common and docker-client RPMs package in my server (running a CentOS-7, yes, old, but it’s working fine until a new full upgrade from the scratch), and added user “oneadmin” to group “dockerroot”, I have restarted opennebula and libvirtd services, so I think now system is ready to download a dockerhub image and, then, run it.

However, when I try to import “Debian” (bullseye tag) DockerHub image, I can’t import it to my “image” datastore. All logs reported to /var/log/message seems OK but, at the last step, image can’t be uploaded to “image” datastore.

I have run manually this process:

1. I have downloaded dockerhub image with “docker pull docker.io/debian:bullseye”
2. After it, I import to OpenNebula with "oneimage create -v --name Debian-Bullseye-DockerHub --path ‘docker://debian?size=2048&filesystem=ext4&format=raw&tag=bullseye’ --datastore 1
3. Then, system shows a “ID: 343” (the new ID for the new image) but image can’t be imported and logs in /var/log/message are these:

Apr 19 09:24:07 my_server kernel: IPv6: ADDRCONF(NETDEV_CHANGE): vethb4d47b3: link becomes ready
Apr 19 09:24:07 my_server kernel: docker0: port 1(vethb4d47b3) entered blocking state
Apr 19 09:24:07 my_server kernel: docker0: port 1(vethb4d47b3) entered forwarding state
Apr 19 09:24:07 my_server journal: PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
Apr 19 09:24:07 my_server journal: NAME="Debian GNU/Linux"
Apr 19 09:24:07 my_server journal: VERSION_ID="11"
Apr 19 09:24:07 my_server journal: VERSION="11 (bullseye)"
Apr 19 09:24:07 my_server journal: VERSION_CODENAME=bullseye
Apr 19 09:24:07 my_server journal: ID=debian
Apr 19 09:24:07 my_server journal: HOME_URL="https://www.debian.org/"
Apr 19 09:24:07 my_server journal: SUPPORT_URL="https://www.debian.org/support"
Apr 19 09:24:07 my_server journal: BUG_REPORT_URL="https://bugs.debian.org/"
Apr 19 09:24:08 my_server kernel: docker0: port 1(vethb4d47b3) entered disabled state
Apr 19 09:24:08 my_server kernel: docker0: port 1(vethb4d47b3) entered disabled state
Apr 19 09:24:08 my_server kernel: device vethb4d47b3 left promiscuous mode
Apr 19 09:24:08 my_server kernel: docker0: port 1(vethb4d47b3) entered disabled state
Apr 19 09:24:08 my_server libvirtd: 2023-04-19 07:24:08.088+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:08 my_server dockerd-current: time="2023-04-19T09:24:08.123996378+02:00" level=warning msg="26075a22d3736e14ef4e964c0d57cc4ba1b2ffbdce53ad634dbc355b00843b71 cleanup: failed to unmount secrets: invalid argument"
Apr 19 09:24:08 my_server dockerd-current: time="2023-04-19T09:24:08.267811999+02:00" level=error msg="Handler for GET /v1.26/containers/debian:bullseye/json returned error: No such container: debian:bullseye"
Apr 19 09:24:08 my_server libvirtd: 2023-04-19 07:24:08.345+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:08 my_server libvirtd: 2023-04-19 07:24:08.349+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:08 my_server libvirtd: 2023-04-19 07:24:08.369+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:08 my_server dockerd-current: time="2023-04-19T09:24:08.408357342+02:00" level=error msg="Handler for GET /v1.26/containers/debian:bullseye/json returned error: No such container: debian:bullseye"
Apr 19 09:24:08 my_server dockerd-current: time="2023-04-19T09:24:08.481176430+02:00" level=error msg="Handler for GET /v1.26/containers/debian:bullseye/json returned error: No such container: debian:bullseye"
Apr 19 09:24:08 my_server dockerd-current: time="2023-04-19T09:24:08.879378258+02:00" level=info msg="Layer sha256:f99422edfbe2a335471209b13e7a4cac4750b4f098a70a6814ab438aa0948b70 cleaned up"
Apr 19 09:24:09 my_server kernel: docker0: port 1(veth5826dd7) entered blocking state
Apr 19 09:24:09 my_server kernel: docker0: port 1(veth5826dd7) entered disabled state
Apr 19 09:24:09 my_server kernel: device veth5826dd7 entered promiscuous mode
Apr 19 09:24:09 my_server libvirtd: 2023-04-19 07:24:09.630+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:09 my_server libvirtd: 2023-04-19 07:24:09.634+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:09 my_server libvirtd: 2023-04-19 07:24:09.638+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:09 my_server libvirtd: 2023-04-19 07:24:09.657+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:09 my_server dockerd-current: time="2023-04-19T09:24:09.682809830+02:00" level=warning msg="1e878359042eae4e1b6e3c2527aaba676187f4f326aa7e4f06f828b2f424a352 cleanup: failed to unmount secrets: invalid argument"
Apr 19 09:24:09 my_server kernel: docker0: port 1(vethbe5f448) entered blocking state
Apr 19 09:24:09 my_server kernel: docker0: port 1(vethbe5f448) entered disabled state
Apr 19 09:24:09 my_server kernel: device vethbe5f448 entered promiscuous mode
Apr 19 09:24:09 my_server kernel: IPv6: ADDRCONF(NETDEV_UP): vethbe5f448: link is not ready
Apr 19 09:24:09 my_server kernel: docker0: port 1(vethbe5f448) entered blocking state
Apr 19 09:24:09 my_server kernel: docker0: port 1(vethbe5f448) entered forwarding state
Apr 19 09:24:09 my_server systemd: Started libcontainer container 3b2dd9b685f9f5571067daf80a58464caca77bb6be30cc7b4350ffd80d23be64.
Apr 19 09:24:09 my_server kernel: IPv6: ADDRCONF(NETDEV_CHANGE): vethbe5f448: link becomes ready
Apr 19 09:24:10 my_server journal: Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
Apr 19 09:24:10 my_server journal: Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
Apr 19 09:24:10 my_server journal: Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
Apr 19 09:24:10 my_server journal: Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8183 kB]
Apr 19 09:24:11 my_server journal: Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [237 kB]
Apr 19 09:24:11 my_server journal: Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [14.6 kB]
Apr 19 09:24:12 my_server journal: Fetched 8643 kB in 2s (4100 kB/s)
Apr 19 09:24:12 my_server journal: Reading package lists...
Apr 19 09:24:12 my_server kernel: docker0: port 1(vethbe5f448) entered disabled state
Apr 19 09:24:12 my_server kernel: docker0: port 1(vethbe5f448) entered disabled state
Apr 19 09:24:12 my_server kernel: device vethbe5f448 left promiscuous mode
Apr 19 09:24:12 my_server kernel: docker0: port 1(vethbe5f448) entered disabled state
Apr 19 09:24:12 my_server libvirtd: 2023-04-19 07:24:12.785+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:12 my_server libvirtd: 2023-04-19 07:24:12.789+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:12 my_server libvirtd: 2023-04-19 07:24:12.809+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:12 my_server libvirtd: 2023-04-19 07:24:12.813+0000: 53272: error : virNetDevSendEthtoolIoctl:3078 : ethtool ioctl error: No such device
Apr 19 09:24:12 my_server dockerd-current: time="2023-04-19T09:24:12.842410747+02:00" level=warning msg="3b2dd9b685f9f5571067daf80a58464caca77bb6be30cc7b4350ffd80d23be64 cleanup: failed to unmount secrets: invalid argument"
Apr 19 09:24:13 my_server kernel: docker0: port 1(veth049f279) entered blocking state
Apr 19 09:24:13 my_server kernel: docker0: port 1(veth049f279) entered disabled state
Apr 19 09:24:13 my_server kernel: device veth049f279 entered promiscuous mode
Apr 19 09:24:13 my_server kernel: IPv6: ADDRCONF(NETDEV_UP): veth049f279: link is not ready
Apr 19 09:24:13 my_server kernel: docker0: port 1(veth049f279) entered blocking state
Apr 19 09:24:13 my_server kernel: docker0: port 1(veth049f279) entered forwarding state
Apr 19 09:24:13 my_server systemd: Started libcontainer container d43395905213a96096f601c662e7450bc204e14853822e476bd5b4c668862238.
Apr 19 09:24:13 my_server kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth049f279: link becomes ready
Apr 19 09:24:13 my_server journal: Hit:1 http://deb.debian.org/debian bullseye InRelease
Apr 19 09:24:13 my_server journal: Hit:2 http://deb.debian.org/debian-security bullseye-security InRelease
Apr 19 09:24:13 my_server journal: Hit:3 http://deb.debian.org/debian bullseye-updates InRelease
Apr 19 09:24:14 my_server journal: Reading package lists...
Apr 19 09:24:14 my_server journal: Reading package lists...
Apr 19 09:24:15 my_server journal: Building dependency tree...
Apr 19 09:24:15 my_server journal: Reading state information...
Apr 19 09:24:15 my_server journal: The following additional packages will be installed:
Apr 19 09:24:15 my_server journal:  ca-certificates dmsetup libapparmor1 libargon2-1 libatm1 libbpf0 libbrotli1
Apr 19 09:24:15 my_server journal:  libbsd0 libcap2 libcap2-bin libcbor0 libcryptsetup12 libcurl4 libdbus-1-3
Apr 19 09:24:15 my_server journal:  libdevmapper1.02.1 libedit2 libelf1 libexpat1 libfido2-1 libgpm2 libhavege2
Apr 19 09:24:15 my_server journal:  libip4tc2 libjson-c5 libkmod2 libldap-2.4-2 libldap-common libmd0 libmnl0
Apr 19 09:24:15 my_server journal:  libncurses6 libncursesw6 libnghttp2-14 libnss-systemd libpam-cap
Apr 19 09:24:15 my_server journal:  libpam-systemd libprocps8 libpsl5 librtmp1 libsasl2-2 libsasl2-modules
Apr 19 09:24:15 my_server journal:  libsasl2-modules-db libssh2-1 libwrap0 libx11-6 libx11-data libxau6 libxcb1
Apr 19 09:24:15 my_server journal:  libxdmcp6 libxext6 libxmuu1 libxtables12 ncurses-term openssh-client
Apr 19 09:24:15 my_server journal:  openssh-sftp-server openssl procps psmisc publicsuffix runit-helper
Apr 19 09:24:15 my_server journal:  sensible-utils systemd-sysv systemd-timesyncd ucf vim-common xauth xxd
Apr 19 09:24:15 my_server journal: Suggested packages:
Apr 19 09:24:15 my_server journal:  default-dbus-session-bus | dbus-session-bus apparmor iproute2-doc gpm
Apr 19 09:24:15 my_server journal:  libsasl2-modules-gssapi-mit | libsasl2-modules-gssapi-heimdal
Apr 19 09:24:15 my_server journal:  libsasl2-modules-ldap libsasl2-modules-otp libsasl2-modules-sql keychain
Apr 19 09:24:15 my_server journal:  libpam-ssh monkeysphere ssh-askpass molly-guard ufw systemd-container
Apr 19 09:24:15 my_server journal:  policykit-1 indent
Apr 19 09:24:15 my_server journal: The following NEW packages will be installed:
Apr 19 09:24:15 my_server journal:  ca-certificates curl dbus dmsetup haveged iproute2 iputils-ping kmod
Apr 19 09:24:15 my_server journal:  libapparmor1 libargon2-1 libatm1 libbpf0 libbrotli1 libbsd0 libcap2
Apr 19 09:24:15 my_server journal:  libcap2-bin libcbor0 libcryptsetup12 libcurl4 libdbus-1-3 libdevmapper1.02.1
Apr 19 09:24:15 my_server journal:  libedit2 libelf1 libexpat1 libfido2-1 libgpm2 libhavege2 libip4tc2
Apr 19 09:24:15 my_server journal:  libjson-c5 libkmod2 libldap-2.4-2 libldap-common libmd0 libmnl0 libncurses6
Apr 19 09:24:15 my_server journal:  libncursesw6 libnghttp2-14 libnss-systemd libpam-cap libpam-systemd
Apr 19 09:24:15 my_server journal:  libprocps8 libpsl5 librtmp1 libsasl2-2 libsasl2-modules libsasl2-modules-db
Apr 19 09:24:15 my_server journal:  libssh2-1 libwrap0 libx11-6 libx11-data libxau6 libxcb1 libxdmcp6 libxext6
Apr 19 09:24:15 my_server journal:  libxmuu1 libxtables12 ncurses-term net-tools openssh-client openssh-server
Apr 19 09:24:15 my_server journal:  openssh-sftp-server openssl procps psmisc publicsuffix runit-helper
Apr 19 09:24:15 my_server journal:  sensible-utils sudo systemd systemd-sysv systemd-timesyncd ucf udev
Apr 19 09:24:15 my_server journal:  vim-common vim-tiny wget xauth xxd
Apr 19 09:24:15 my_server journal: 0 upgraded, 78 newly installed, 0 to remove and 0 not upgraded.
Apr 19 09:24:15 my_server journal: Need to get 20.8 MB of archives.
Apr 19 09:24:15 my_server journal: After this operation, 72.5 MB of additional disk space will be used.
Apr 19 09:24:15 my_server journal: Get:1 http://deb.debian.org/debian bullseye/main amd64 libapparmor1 amd64 2.13.6-10 [99.3 kB]
Apr 19 09:24:15 my_server journal: Get:2 http://deb.debian.org/debian bullseye/main amd64 libcap2 amd64 1:2.44-1 [23.6 kB]
Apr 19 09:24:15 my_server journal: Get:3 http://deb.debian.org/debian bullseye/main amd64 libargon2-1 amd64 0~20171227-0.2 [19.6 kB]
Apr 19 09:24:15 my_server journal: Get:4 http://deb.debian.org/debian bullseye/main amd64 dmsetup amd64 2:1.02.175-2.1 [92.1 kB]

[...]

Apr 19 09:24:16 my_server journal: Get:75 http://deb.debian.org/debian bullseye/main amd64 psmisc amd64 23.4-2 [198 kB]
Apr 19 09:24:16 my_server journal: Get:76 http://deb.debian.org/debian bullseye/main amd64 publicsuffix all 20220811.1734-0+deb11u1 [127 kB]
Apr 19 09:24:16 my_server journal: Get:77 http://deb.debian.org/debian-security bullseye-security/main amd64 sudo amd64 1.9.5p2-3+deb11u1 [1061 kB]
Apr 19 09:24:16 my_server journal: Get:78 http://deb.debian.org/debian bullseye/main amd64 xauth amd64 1:1.1-1 [40.5 kB]
Apr 19 09:24:16 my_server journal: debconf: delaying package configuration, since apt-utils is not installed
Apr 19 09:24:16 my_server journal: Fetched 20.8 MB in 1s (24.6 MB/s)
Apr 19 09:24:16 my_server journal: Selecting previously unselected package libapparmor1:amd64.#015
Apr 19 09:24:16 my_server journal: (Reading database ... #015(Reading database ... 5%#015(Reading database ... 10%#015(Reading database ... 15%#015(Reading database ... 20%#015(Reading database ... 25%#015(Reading database ... 30%#015(Reading database ... 35%#015(Reading database ... 40%#015(Reading database ... 45%#015(Reading database ... 50%#015(Reading database ... 55%#015(Reading database ... 60%#015(Reading database ... 65%#015(Reading database ... 70%#015(Reading database ... 75%#015(Reading database ... 80%#015(Reading database ... 85%#015(Reading database ... 90%#015(Reading database ... 95%#015(Reading database ... 100%#015(Reading database ... 6664 files and directories currently installed.)#015
Apr 19 09:24:16 my_server journal: Preparing to unpack .../0-libapparmor1_2.13.6-10_amd64.deb ...#015
Apr 19 09:24:16 my_server journal: Unpacking libapparmor1:amd64 (2.13.6-10) ...#015
Apr 19 09:24:16 my_server journal: Selecting previously unselected package libcap2:amd64.#015
Apr 19 09:24:16 my_server journal: Preparing to unpack .../1-libcap2_1%3a2.44-1_amd64.deb ...#015
Apr 19 09:24:16 my_server journal: Unpacking libcap2:amd64 (1:2.44-1) ...#015
Apr 19 09:24:16 my_server journal: Selecting previously unselected package libargon2-1:amd64.#015
Apr 19 09:24:16 my_server journal: Preparing to unpack .../2-libargon2-1_0~20171227-0.2_amd64.deb ...#015
Apr 19 09:24:16 my_server journal: Unpacking libargon2-1:amd64 (0~20171227-0.2) ...#015

[...]

Apr 19 09:24:22 my_server journal: Setting up libx11-data (2:1.7.2-1) ...#015
Apr 19 09:24:22 my_server journal: Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2+b2) ...#015
Apr 19 09:24:22 my_server journal: Setting up libncurses6:amd64 (6.2+20201114-2) ...#015
Apr 19 09:24:22 my_server journal: Setting up libdbus-1-3:amd64 (1.12.24-0+deb11u1) ...#015
Apr 19 09:24:22 my_server journal: Setting up dbus (1.12.24-0+deb11u1) ...#015
Apr 19 09:24:22 my_server journal: invoke-rc.d: could not determine current runlevel#015
Apr 19 09:24:22 my_server journal: invoke-rc.d: policy-rc.d denied execution of start.#015
Apr 19 09:24:22 my_server journal: Setting up libmnl0:amd64 (1.0.4-3) ...#015
Apr 19 09:24:22 my_server journal: Setting up systemd-timesyncd (247.3-7+deb11u1) ...#015
Apr 19 09:24:22 my_server journal: Created symlink /etc/systemd/system/dbus-org.freedesktop.timesync1.service → /lib/systemd/system/systemd-timesyncd.service.#015
Apr 19 09:24:22 my_server journal: Created symlink /etc/systemd/system/sysinit.target.wants/systemd-timesyncd.service → /lib/systemd/system/systemd-timesyncd.service.#015

[...]

Apr 19 09:24:23 my_server journal: update-alternatives: using /usr/bin/vim.tiny to provide /usr/bin/view (view) in auto mode#015
Apr 19 09:24:23 my_server journal: update-alternatives: using /usr/bin/vim.tiny to provide /usr/bin/ex (ex) in auto mode#015
Apr 19 09:24:23 my_server journal: update-alternatives: using /usr/bin/vim.tiny to provide /usr/bin/editor (editor) in auto mode#015
Apr 19 09:24:23 my_server journal: Setting up ca-certificates (20210119) ...#015
Apr 19 09:24:23 my_server journal: stat: cannot statx '/usr/local': Operation not permitted#015
Apr 19 09:24:23 my_server journal: debconf: unable to initialize frontend: Dialog#015
Apr 19 09:24:23 my_server journal: debconf: (TERM is not set, so the dialog frontend is not usable.)#015
Apr 19 09:24:23 my_server journal: debconf: falling back to frontend: Readline#015
Apr 19 09:24:23 my_server journal: debconf: unable to initialize frontend: Readline#015
Apr 19 09:24:25 my_server journal: debconf: falling back to frontend: Teletype#015
Apr 19 09:24:25 my_server journal: Setting up openssh-client (1:8.4p1-5+deb11u1) ...#015
Apr 19 09:24:25 my_server journal: Setting up libxext6:amd64 (2:1.3.3-1.1) ...#015
Apr 19 09:24:25 my_server journal: Setting up xauth (1:1.1-1) ...#015
Apr 19 09:24:25 my_server journal: Setting up openssh-sftp-server (1:8.4p1-5+deb11u1) ...#015
Apr 19 09:24:25 my_server journal: Setting up openssh-server (1:8.4p1-5+deb11u1) ...#015
Apr 19 09:24:25 my_server journal: debconf: unable to initialize frontend: Dialog#015
Apr 19 09:24:25 my_server journal: debconf: (TERM is not set, so the dialog frontend is not usable.)#015
Apr 19 09:24:25 my_server journal: debconf: falling back to frontend: Readline#015
Apr 19 09:24:25 my_server journal: debconf: unable to initialize frontend: Readline#015
Apr 19 09:24:25 my_server journal: debconf: (Can't locate Term/ReadLine.pm in @INC (you may need to install the Term::ReadLine module) (@INC contains: /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.32.1 /usr/local/share/perl/5.32.1 /usr/lib/x86_64-linux-gnu/perl5/5.32 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl-base /usr/lib/x86_64-linux-gnu/perl/5.32 /usr/share/perl/5.32 /usr/local/lib/site_perl) at /usr/share/perl5/Debconf/FrontEnd/Readline.pm line 7.)#015
Apr 19 09:24:25 my_server journal: debconf: falling back to frontend: Teletype#015
Apr 19 09:24:25 my_server journal: #015
Apr 19 09:24:25 my_server journal: Creating config file /etc/ssh/sshd_config with new version#015
Apr 19 09:24:25 my_server journal: stat: cannot statx '/tmp/tmp.5lThiy8hjh': Operation not permitted#015
Apr 19 09:24:25 my_server journal: dpkg: error processing package openssh-server (--configure):#015
Apr 19 09:24:25 my_server journal: installed openssh-server package post-installation script subprocess returned error exit status 1#015
Apr 19 09:24:25 my_server journal: Processing triggers for libc-bin (2.31-13+deb11u5) ...#015
Apr 19 09:24:26 my_server journal: Processing triggers for ca-certificates (20210119) ...#015
Apr 19 09:24:26 my_server journal: Updating certificates in /etc/ssl/certs...#015
Apr 19 09:24:26 my_server journal: 0 added, 0 removed; done.#015
Apr 19 09:24:26 my_server journal: Running hooks in /etc/ca-certificates/update.d...#015
Apr 19 09:24:26 my_server journal: done.#015
Apr 19 09:24:26 my_server journal: Errors were encountered while processing:#015
Apr 19 09:24:26 my_server journal: openssh-server#015
Apr 19 09:24:26 my_server journal: E: Sub-process /usr/bin/dpkg returned an error code (1)
Apr 19 09:24:26 my_server kernel: docker0: port 1(veth049f279) entered disabled state
Apr 19 09:24:26 my_server kernel: docker0: port 1(veth049f279) entered disabled state
Apr 19 09:24:26 my_server kernel: device veth049f279 left promiscuous mode
Apr 19 09:24:26 my_server kernel: docker0: port 1(veth049f279) entered disabled state
Apr 19 09:24:26 my_server dockerd-current: time="2023-04-19T09:24:26.734114309+02:00" level=warning msg="d43395905213a96096f601c662e7450bc204e14853822e476bd5b4c668862238 cleanup: failed to unmount secrets: invalid argument"
Apr 19 09:24:26 my_server libvirtd: 2023-04-19 07:24:26.795+0000: 53272: error : virFileReadAll:1460 : Failed to open file '/sys/class/net/vethb4e98e6/operstate': No such file or directory
Apr 19 09:24:26 my_server libvirtd: 2023-04-19 07:24:26.795+0000: 53272: error : virNetDevGetLinkInfo:2552 : unable to read: /sys/class/net/vethb4e98e6/operstate: No such file or directory
Apr 19 09:24:26 my_server dockerd-current: time="2023-04-19T09:24:26.799628505+02:00" level=error msg="Handler for DELETE /v1.26/images/one25591 returned error: No such image: one25591:latest"
Apr 19 09:25:23 my_server systemd-logind: New session 4047 of user root.
Apr 19 09:25:23 my_server systemd: Started Session 4047 of user root.

However, if I run container from CLI with “docker run -ti --name Test $IMAGE_ID”, docker container runs perfectly, so it seems problem is during conversion from container to OpenNebula image.

What could be the problem?

Thanks.

[dclavijo (Daniel Clavijo)]

However, when I try to import “Debian” (bullseye tag) DockerHub image, I can’t import it to my “image” datastore. All logs reported to /var/log/message seems OK but, at the last step, image can’t be uploaded to “image” datastore.

What exactly is the image can’t be imported into the image datastore ? Do you get an error from OpenNebula ? Is the image object not generated in the image pool (output of oneimage list) ?

[Daniel_Ruiz_Molina]

Hi,

Image I’m trying to upload to OpenNebula server is a “debian” from DockerHub MarketPlace with tag “bullseye”, but the problem also happens if I download another DockerHub image.

If I try to upload image from Sunstone, process ends in this way:

If I click on the image, I can see this information and its error:

Thanks.

[Daniel_Ruiz_Molina]

Hi,

After debugging scripts “/var/lib/one/remotes/datastore/fs/../downloader.sh” and “/var/lib/one/remotes/datastore/docker_downloader.sh”, I think the problem happens when “docker build” process tries to install/create the SSH key for the host. I have checked openssh-server version package and there is a update for that. My system is a CentOS-7 running openssh-server 7.4p1-21.el7 and there is an update 7.4p1-22.el7_9. However, I am not sure if I could update openssh-server package without generating a problem in OpenNebula (bootstrap, for example), because package opennebula has openssh-server as a dependency and, updating package, maybe keys are modified…

I have read in git - Docker build --ssh not forwaring id_rsa - Super User about a similar problem.

Could you (any of OpenNebula developers) make sure that update process won’t broke OpenNebula system?

Thanks.

[Daniel_Ruiz_Molina]

Now, I have tried to download a CentOS-7 Docker image and it has been perfectly created… So problem is with Debian Bullseye DockerHub…

Why?

[Daniel_Ruiz_Molina]

Now, I’m trying with a new fresh cluster running AlmaLinux-9.2 and I can’t download a DockerHub image (almalinux:latest or almalinux:9.2).

Could someone help me?

This is the error:

Jul 14 12:21:15 servidor systemd[1]: run-docker-netns-80ec49a8a313.mount: Deactivated successfully.
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.416151288+02:00" level=warning msg="no trace recorder found, skipping"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.457050579+02:00" level=debug msg="Calling HEAD /_ping"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.469006889+02:00" level=debug msg="Calling HEAD /_ping"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.469359945+02:00" level=debug msg="Calling DELETE /v1.43/images/almalinux?force=1"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.524508736+02:00" level=debug msg="Calling HEAD /_ping"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.524816697+02:00" level=debug msg="Calling DELETE /v1.43/images/one27076?force=1"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.537457257+02:00" level=debug msg="Calling HEAD /_ping"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.549380972+02:00" level=debug msg="Calling HEAD /_ping"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.549697473+02:00" level=debug msg="Calling DELETE /v1.43/images/almalinux?force=1"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.561373072+02:00" level=debug msg="Calling HEAD /_ping"
Jul 14 12:21:15 servidor dockerd[150251]: time="2023-07-14T12:21:15.561703333+02:00" level=debug msg="Calling DELETE /v1.43/images/one27076?force=1"
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.062819486+02:00" level=debug msg="2023/07/14 12:21:18 WARNING: [core] [Channel #16 SubChannel #17] grpc: addrConn.createTransport failed to connect to {" library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.063096670+02:00" level=debug msg="  \"Addr\": \"localhost\"," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.063113746+02:00" level=debug msg="  \"ServerName\": \"localhost\"," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.063129105+02:00" level=debug msg="  \"Attributes\": null," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.063137314+02:00" level=debug msg="  \"BalancerAttributes\": null," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.063151987+02:00" level=debug msg="  \"Type\": 0," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.063158887+02:00" level=debug msg="  \"Metadata\": null" library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.063165337+02:00" level=debug msg="}. Err: connection error: desc = \"transport: Error while dialing only one connection allowed\"" library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.103970626+02:00" level=debug msg="2023/07/14 12:21:18 WARNING: [core] [Channel #19 SubChannel #20] grpc: addrConn.createTransport failed to connect to {" library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.103997289+02:00" level=debug msg="  \"Addr\": \"localhost\"," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.104005211+02:00" level=debug msg="  \"ServerName\": \"localhost\"," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.104012136+02:00" level=debug msg="  \"Attributes\": null," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.104018518+02:00" level=debug msg="  \"BalancerAttributes\": null," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.104025980+02:00" level=debug msg="  \"Type\": 0," library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.104032125+02:00" level=debug msg="  \"Metadata\": null" library=grpc
Jul 14 12:21:18 servidor dockerd[150251]: time="2023-07-14T12:21:18.104046311+02:00" level=debug msg="}. Err: connection error: desc = \"transport: Error while dialing only one connection allowed\"" library=grpc

I have installed Docker-CE in this way: Install Docker Engine on CentOS | Docker Documentation.

Help, please, I need to download DockerHub images to create Firecracker VMs.

Thanks.

[dclavijo (Daniel Clavijo)]

This looks like a problem specific to your Docker setup, not really related to OpenNebula. The requirements are quite simple. If you happen to find problems related to OpenNebula, replace the file /var/lib/one/remotes/datastore/docker_downloader.sh in the frontend with the latest master file. There are some fixes not present in 6.6.0.

[Daniel_Ruiz_Molina]

Hi @dclavijo,

I’m going to explain what I have done, but I’m getting the same error.

First of all, I comment that I have added “:$tag” in line number 63 from file /var/lib/one/remotes/datastore/docker_downloader.sh in this way:
docker rmi -f "${image_name}":$tag
because it seems that script tries to delete “${image_name}”:latest, but not always the image is “latest” tag.

And second, after adding "set -x" and "trap read debug" in scripts /var/lib/one/remotes/datastore/docker_downloader.sh /var/lib/one/remotes/datastore/downloader.sh, I have checked that error ocurrs at line 660 from “downloader.sh” in “if” statement:

    if [ "$?" != "0" -o "$PIPESTATUS" != "0" ]; then
        echo "Error copying" >&2
        exit -1
    fi

It seems $PIPESTATUS returns 1:
+ '[' 0 '!=' 0 -o 1 '!=' 0 ']' (output with “set -x” and “trap read debug”)

I don’t understand why…

Help, please. I think I have followed in the right way the Docker installation explained here.

Thanks.

[Daniel_Ruiz_Molina]

Hi again, @dclavijo,

I have configured a “miniONE” cluster running this procedure: GitHub - OpenNebula/minione: Easy to use deployment tool for an OpenNebula evaluation environment.
In this guide, by default, script installs Docker, so admin could download a DockerHub image with no problem… But not. After installling “miniONE” and enabling all marketplaces (onemarket enable $marketplace_id), I have tried to download AlmaLinux with tag “9.2” Docker image. Image process creation has fail in the same way that in my testing cluster:

Tue Jul 18 12:24:01 2023 [Z0][ReM][D]: Req:9376 UID:0 IP:127.0.0.1 one.imagepool.info invoked , -2, 0, -200, -1
Tue Jul 18 12:24:01 2023 [Z0][ReM][D]: Req:9376 UID:0 one.imagepool.info result SUCCESS, "<IMAGE_POOL><IMAGE><..."
Tue Jul 18 12:24:01 2023 [Z0][ReM][D]: Req:6800 UID:0 IP:127.0.0.1 one.user.info invoked , 0, false
Tue Jul 18 12:24:01 2023 [Z0][ReM][D]: Req:6800 UID:0 one.user.info result SUCCESS, "<USER><ID>0</ID><GID..."
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: Command execution failed (exit code: 255): /var/lib/one/remotes/datastore/fs/cp PERTX0RSSVZFUl9BQ1RJT05fREFUQT48SU1BR0U+PElEPjE8L0lEPjxVSUQ+MDwvVUlEPjxHSUQ+MDwvR0lEPjxVTkFNRT5vbmVhZG1pbjwvVU5BTUU+PEdOQU1FPm9uZWFkbWluPC9HTkFNRT48TkFNRT5hbG1hbGludXggLSBEb2NrZXJIdWIgZm9yIEZpcmVjcmFja2VyPC9OQU1FPjxQRVJNSVNTSU9OUz48T1dORVJfVT4xPC9PV05FUl9VPjxPV05FUl9NPjE8L09XTkVSX00+PE9XTkVSX0E+MDwvT1dORVJfQT48R1JPVVBfVT4wPC9HUk9VUF9VPjxHUk9VUF9NPjA8L0dST1VQX00+PEdST1VQX0E+MDwvR1JPVVBfQT48T1RIRVJfVT4wPC9PVEhFUl9VPjxPVEhFUl9NPjA8L09USEVSX00+PE9USEVSX0E+MDwvT1RIRVJfQT48L1BFUk1JU1NJT05TPjxUWVBFPjA8L1RZUEU+PERJU0tfVFlQRT4wPC9ESVNLX1RZUEU+PFBFUlNJU1RFTlQ+MDwvUEVSU0lTVEVOVD48UkVHVElNRT4xNjg5Njc1ODE3PC9SRUdUSU1FPjxTT1VSQ0U+PCFbQ0RBVEFbXV0+PC9TT1VSQ0U+PFBBVEg+PCFbQ0RBVEFbZG9ja2VyOi8vYWxtYWxpbnV4P3NpemU9MjA0OCZmaWxlc3lzdGVtPWV4dDQmZm9ybWF0PXJhd11dPjwvUEFUSD48Rk9STUFUPjwhW0NEQVRBW11dPjwvRk9STUFUPjxGUz48IVtDREFUQVtdXT48L0ZTPjxTSVpFPjIwNDg8L1NJWkU+PFNUQVRFPjQ8L1NUQVRFPjxQUkVWX1NUQVRFPjA8L1BSRVZfU1RBVEU+PFJVTk5JTkdfVk1TPjA8L1JVTk5JTkdfVk1TPjxDTE9OSU5HX09QUz4wPC9DTE9OSU5HX09QUz48Q0xPTklOR19JRD4tMTwvQ0xPTklOR19JRD48VEFSR0VUX1NOQVBTSE9UPi0xPC9UQVJHRVRfU05BUFNIT1Q+PERBVEFTVE9SRV9JRD4xPC9EQVRBU1RPUkVfSUQ+PERBVEFTVE9SRT5kZWZhdWx0PC9EQVRBU1RPUkU+PFZNUz48L1ZNUz48Q0xPTkVTPjwvQ0xPTkVTPjxBUFBfQ0xPTkVTPjwvQVBQX0NMT05FUz48VEVNUExBVEU+PERFVl9QUkVGSVg+PCFbQ0RBVEFbdmRdXT48L0RFVl9QUkVGSVg+PEZST01fQVBQPjwhW0NEQVRBWzYxOV1dPjwvRlJPTV9BUFA+PEZST01fQVBQX01ENT48IVtDREFUQVtlN2IwNTA5NzUyYThiYTgyOWQ0YjA2ODU2YjMzODk4NV1dPjwvRlJPTV9BUFBfTUQ1PjxGUk9NX0FQUF9OQU1FPjwhW0NEQVRBW2FsbWFsaW51eF1dPjwvRlJPTV9BUFBfTkFNRT48VVJMX0FSR1M+PCFbQ0RBVEFbdGFnPTkuMl1dPjwvVVJMX0FSR1M+PC9URU1QTEFURT48U05BUFNIT1RTPjxBTExPV19PUlBIQU5TPjwhW0NEQVRBW05PXV0+PC9BTExPV19PUlBIQU5TPjxDVVJSRU5UX0JBU0U+PCFbQ0RBVEFbLTFdXT48L0NVUlJFTlRfQkFTRT48TkVYVF9TTkFQU0hPVD48IVtDREFUQVswXV0+PC9ORVhUX1NOQVBTSE9UPjwvU05BUFNIT1RTPjxCQUNLVVBfSU5DUkVNRU5UUz48L0JBQ0tVUF9JTkNSRU1FTlRTPjwvSU1BR0U+PERBVEFTVE9SRT48SUQ+MTwvSUQ+PFVJRD4wPC9VSUQ+PEdJRD4wPC9HSUQ+PFVOQU1FPm9uZWFkbWluPC9VTkFNRT48R05BTUU+b25lYWRtaW48L0dOQU1FPjxOQU1FPmRlZmF1bHQ8L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjE8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+PE9USEVSX00+MDwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PERTX01BRD48IVtDREFUQVtmc11dPjwvRFNfTUFEPjxUTV9NQUQ+PCFbQ0RBVEFbc3NoXV0+PC9UTV9NQUQ+PEJBU0VfUEFUSD48IVtDREFUQVsvdmFyL2xpYi9vbmUvL2RhdGFzdG9yZXMvMV1dPjwvQkFTRV9QQVRIPjxUWVBFPjA8L1RZUEU+PERJU0tfVFlQRT4wPC9ESVNLX1RZUEU+PFNUQVRFPjA8L1NUQVRFPjxDTFVTVEVSUz48SUQ+MDwvSUQ+PC9DTFVTVEVSUz48VE9UQUxfTUI+MzU4NzE8L1RPVEFMX01CPjxGUkVFX01CPjI4MzAzPC9GUkVFX01CPjxVU0VEX01CPjc1Njg8L1VTRURfTUI+PElNQUdFUz48SUQ+MDwvSUQ+PC9JTUFHRVM+PFRFTVBMQVRFPjxBTExPV19PUlBIQU5TPjwhW0NEQVRBW1lFU11dPjwvQUxMT1dfT1JQSEFOUz48Q0xPTkVfVEFSR0VUPjwhW0NEQVRBW1NZU1RFTV1dPjwvQ0xPTkVfVEFSR0VUPjxESVNLX1RZUEU+PCFbQ0RBVEFbRklMRV1dPjwvRElTS19UWVBFPjxEU19NQUQ+PCFbQ0RBVEFbZnNdXT48L0RTX01BRD48TE5fVEFSR0VUPjwhW0NEQVRBW1NZU1RFTV1dPjwvTE5fVEFSR0VUPjxSRVNUUklDVEVEX0RJUlM+PCFbQ0RBVEFbL11dPjwvUkVTVFJJQ1RFRF9ESVJTPjxTQUZFX0RJUlM+PCFbQ0RBVEFbL3Zhci90bXBdXT48L1NBRkVfRElSUz48VE1fTUFEPjwhW0NEQVRBW3NzaF1dPjwvVE1fTUFEPjxUWVBFPjwhW0NEQVRBW0lNQUdFX0RTXV0+PC9UWVBFPjwvVEVNUExBVEU+PC9EQVRBU1RPUkU+PE1BUktFVFBMQUNFPjxJRD4zPC9JRD48VUlEPjA8L1VJRD48R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+RG9ja2VySHViPC9OQU1FPjxTVEFURT4wPC9TVEFURT48TUFSS0VUX01BRD48IVtDREFUQVtkb2NrZXJodWJdXT48L01BUktFVF9NQUQ+PFpPTkVfSUQ+PCFbQ0RBVEFbMF1dPjwvWk9ORV9JRD48VE9UQUxfTUI+MDwvVE9UQUxfTUI+PEZSRUVfTUI+MDwvRlJFRV9NQj48VVNFRF9NQj4wPC9VU0VEX01CPjxNQVJLRVRQTEFDRUFQUFM+PElEPjQ1NDwvSUQ+PElEPjQ1NTwvSUQ+PElEPjQ1NjwvSUQ+PElEPjQ1NzwvSUQ+PElEPjQ1ODwvSUQ+PElEPjQ1OTwvSUQ+PElEPjQ2MDwvSUQ+PElEPjQ2MTwvSUQ+PElEPjQ2MjwvSUQ+PElEPjQ2MzwvSUQ+PElEPjQ2NDwvSUQ+PElEPjQ2NTwvSUQ+PElEPjQ2NjwvSUQ+PElEPjQ2NzwvSUQ+PElEPjQ2ODwvSUQ+PElEPjQ2OTwvSUQ+PElEPjQ3MDwvSUQ+PElEPjQ3MTwvSUQ+PElEPjQ3MjwvSUQ+PElEPjQ3MzwvSUQ+PElEPjQ3NDwvSUQ+PElEPjQ3NTwvSUQ+PElEPjQ3NjwvSUQ+PElEPjQ3NzwvSUQ+PElEPjQ3ODwvSUQ+PElEPjQ3OTwvSUQ+PElEPjQ4MDwvSUQ+PElEPjQ4MTwvSUQ+PElEPjQ4MjwvSUQ+PElEPjQ4MzwvSUQ+PElEPjQ4NDwvSUQ+PElEPjQ4NTwvSUQ+PElEPjQ4NjwvSUQ+PElEPjQ4NzwvSUQ+PElEPjQ4ODwvSUQ+PElEPjQ4OTwvSUQ+PElEPjQ5MDwvSUQ+PElEPjQ5MTwvSUQ+PElEPjQ5MjwvSUQ+PElEPjQ5MzwvSUQ+PElEPjQ5NDwvSUQ+PElEPjQ5NTwvSUQ+PElEPjQ5NjwvSUQ+PElEPjQ5NzwvSUQ+PElEPjQ5ODwvSUQ+PElEPjQ5OTwvSUQ+PElEPjUwMDwvSUQ+PElEPjUwMTwvSUQ+PElEPjUwMjwvSUQ+PElEPjUwMzwvSUQ+PElEPjUwNDwvSUQ+PElEPjUwNTwvSUQ+PElEPjUwNjwvSUQ+PElEPjUwNzwvSUQ+PElEPjUwODwvSUQ+PElEPjUwOTwvSUQ+PElEPjUxMDwvSUQ+PElEPjUxMTwvSUQ+PElEPjUxMjwvSUQ+PElEPjUxMzwvSUQ+PElEPjUxNDwvSUQ+PElEPjUxNTwvSUQ+PElEPjUxNjwvSUQ+PElEPjUxNzwvSUQ+PElEPjUxODwvSUQ+PElEPjUxOTwvSUQ+PElEPjUyMDwvSUQ+PElEPjUyMTwvSUQ+PElEPjUyMjwvSUQ+PElEPjUyMzwvSUQ+PElEPjUyNDwvSUQ+PElEPjUyNTwvSUQ+PElEPjUyNjwvSUQ+PElEPjUyNzwvSUQ+PElEPjUyODwvSUQ+PElEPjUyOTwvSUQ+PElEPjUzMDwvSUQ+PElEPjUzMTwvSUQ+PElEPjUzMjwvSUQ+PElEPjUzMzwvSUQ+PElEPjUzNDwvSUQ+PElEPjUzNTwvSUQ+PElEPjUzNjwvSUQ+PElEPjUzNzwvSUQ+PElEPjUzODwvSUQ+PElEPjUzOTwvSUQ+PElEPjU0MDwvSUQ+PElEPjU0MTwvSUQ+PElEPjU0MjwvSUQ+PElEPjU0MzwvSUQ+PElEPjU0NDwvSUQ+PElEPjU0NTwvSUQ+PElEPjU0NjwvSUQ+PElEPjU0NzwvSUQ+PElEPjU0ODwvSUQ+PElEPjU0OTwvSUQ+PElEPjU1MDwvSUQ+PElEPjU1MTwvSUQ+PElEPjU1MjwvSUQ+PElEPjU1MzwvSUQ+PElEPjU1NDwvSUQ+PElEPjU1NTwvSUQ+PElEPjU1NjwvSUQ+PElEPjU1NzwvSUQ+PElEPjU1ODwvSUQ+PElEPjU1OTwvSUQ+PElEPjU2MDwvSUQ+PElEPjU2MTwvSUQ+PElEPjU2MjwvSUQ+PElEPjU2MzwvSUQ+PElEPjU2NDwvSUQ+PElEPjU2NTwvSUQ+PElEPjU2NjwvSUQ+PElEPjU2NzwvSUQ+PElEPjU2ODwvSUQ+PElEPjU2OTwvSUQ+PElEPjU3MDwvSUQ+PElEPjU3MTwvSUQ+PElEPjU3MjwvSUQ+PElEPjU3MzwvSUQ+PElEPjU3NDwvSUQ+PElEPjU3NTwvSUQ+PElEPjU3NjwvSUQ+PElEPjU3NzwvSUQ+PElEPjU3ODwvSUQ+PElEPjU3OTwvSUQ+PElEPjU4MDwvSUQ+PElEPjU4MTwvSUQ+PElEPjU4MjwvSUQ+PElEPjU4MzwvSUQ+PElEPjU4NDwvSUQ+PElEPjU4NTwvSUQ+PElEPjU4NjwvSUQ+PElEPjU4NzwvSUQ+PElEPjU4ODwvSUQ+PElEPjU4OTwvSUQ+PElEPjU5MDwvSUQ+PElEPjU5MTwvSUQ+PElEPjU5MjwvSUQ+PElEPjU5MzwvSUQ+PElEPjU5NDwvSUQ+PElEPjU5NTwvSUQ+PElEPjU5NjwvSUQ+PElEPjU5NzwvSUQ+PElEPjU5ODwvSUQ+PElEPjU5OTwvSUQ+PElEPjYwMDwvSUQ+PElEPjYwMTwvSUQ+PElEPjYwMjwvSUQ+PElEPjYwMzwvSUQ+PElEPjYwNDwvSUQ+PElEPjYwNTwvSUQ+PElEPjYwNjwvSUQ+PElEPjYwNzwvSUQ+PElEPjYwODwvSUQ+PElEPjYwOTwvSUQ+PElEPjYxMDwvSUQ+PElEPjYxMTwvSUQ+PElEPjYxMjwvSUQ+PElEPjYxMzwvSUQ+PElEPjYxNDwvSUQ+PElEPjYxNTwvSUQ+PElEPjYxNjwvSUQ+PElEPjYxNzwvSUQ+PElEPjYxODwvSUQ+PElEPjYxOTwvSUQ+PElEPjYyMDwvSUQ+PElEPjYyMTwvSUQ+PElEPjYyMjwvSUQ+PElEPjYyMzwvSUQ+PElEPjYyNDwvSUQ+PElEPjYyNTwvSUQ+PElEPjYyNjwvSUQ+PElEPjYyNzwvSUQ+PC9NQVJLRVRQTEFDRUFQUFM+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4xPC9PV05FUl9BPjxHUk9VUF9VPjE8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjE8L09USEVSX1U+PE9USEVSX00+MDwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PFRFTVBMQVRFPjxERVNDUklQVElPTj48IVtDREFUQVtEb2NrZXJIdWIgaXMgdGhlIHdvcmxkJ3MgbGFyZ2VzdCBsaWJyYXJ5IGFuZCAgY29tbXVuaXR5IGZvciBjb250YWluZXIgaW1hZ2VzIGhvc3RlZCBhdCBodWIuZG9ja2VyLmNvbS9dXT48L0RFU0NSSVBUSU9OPjxNQVJLRVRfTUFEPjwhW0NEQVRBW2RvY2tlcmh1Yl1dPjwvTUFSS0VUX01BRD48L1RFTVBMQVRFPjwvTUFSS0VUUExBQ0U+PC9EU19EUklWRVJfQUNUSU9OX0RBVEE+ 1
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: cp: Copying local image docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2 to the image repository
Tue Jul 18 12:24:03 2023 [Z0][ImM][E]: cp: Command "set -e -o pipefail; /var/lib/one/remotes/datastore/fs/../downloader.sh   'docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2' '/var/lib/one//datastores/1/6c3a1fe720a6e6e988e140e675715ccb'" failed: Unable to find image 'almalinux:9.2' locally
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: 9.2: Pulling from library/almalinux
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: 874b82abea9e: Pulling fs layer
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: 874b82abea9e: Download complete
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: 874b82abea9e: Pull complete
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: Digest: sha256:f47335db534a28ec4050c7e5383db4f5361d4dc684af93a5d6f09db620b7b2ea
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: Status: Downloaded newer image for almalinux:9.2
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: Error response from daemon: No such image: almalinux:latest
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: Error response from daemon: No such image: almalinux:latest
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: Error copying
Tue Jul 18 12:24:03 2023 [Z0][ImM][I]: Error copying docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2 to /var/lib/one//datastores/1/6c3a1fe720a6e6e988e140e675715ccb
Tue Jul 18 12:24:03 2023 [Z0][ImM][E]: Error copying image in the datastore: INFO: cp: Copying local image docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2 to the image repository ERROR: cp: Command "set -e -o pipefail; /var/lib/one/remotes/datastore/fs/../downloader.sh   'docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2' '/var/lib/one//datastores/1/6c3a1fe720a6e6e988e140e675715ccb'" failed: Unable to find image 'almalinux:9.2' locally 9.2: Pulling from library/almalinux 874b82abea9e: Pulling fs layer 874b82abea9e: Download complete 874b82abea9e: Pull complete Digest: sha256:f47335db534a28ec4050c7e5383db4f5361d4dc684af93a5d6f09db620b7b2ea Status: Downloaded newer image for almalinux:9.2 Error response from daemon: No such image: almalinux:latest Error response from daemon: No such image: almalinux:latest Error copying Error copying docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2 to /var/lib/one//datastores/1/6c3a1fe720a6e6e988e140e675715ccb
Tue Jul 18 12:24:03 2023 [Z0][InM][D]: Monitoring datastore default (1)
Tue Jul 18 12:24:04 2023 [Z0][ImM][D]: Datastore default (1) successfully monitored.
Tue Jul 18 12:24:09 2023 [Z0][ReM][D]: Req:8848 UID:0 IP:127.0.0.1 one.zone.raftstatus invoked
Tue Jul 18 12:24:09 2023 [Z0][ReM][D]: Req:8848 UID:0 one.zone.raftstatus result SUCCESS, "<RAFT><SERVER_ID>-1<..."
Tue Jul 18 12:24:09 2023 [Z0][ReM][D]: Req:3152 UID:0 IP:127.0.0.1 one.vmpool.infoextended invoked , -2, -1, -1, -1

Running dockerd in interactive mode (dockerd -D -l debug), I can see the same logs and the same error that in my testing cluster:

DEBU[2023-07-18T12:38:39.771652984+02:00] DeleteConntrackEntries purged ipv4:0, ipv6:0 
DEBU[2023-07-18T12:38:39.771754341+02:00] DeleteConntrackEntriesByPort for udp ports purged ipv4:0, ipv6:0 
DEBU[2023-07-18T12:38:39.832638635+02:00] 11b617ed9d8876c1d554d644b4e26ab5061374463a1a0b1267150e8c481fe649 (e636464).deleteSvcRecords(ypfe1eflc7151w7i7ad4jz498, 172.17.0.2, <nil>, true) updateSvcRecord sid:11b617ed9d8876c1d554d644b4e26ab5061374463a1a0b1267150e8c481fe649  
DEBU[2023-07-18T12:38:39.854270783+02:00] Releasing addresses for endpoint ypfe1eflc7151w7i7ad4jz498's interface on network bridge 
DEBU[2023-07-18T12:38:39.854315574+02:00] ReleaseAddress(LocalDefault/172.17.0.0/16, 172.17.0.2) 
DEBU[2023-07-18T12:38:39.854400520+02:00] Released address Address:172.17.0.2 Sequence:Bits: 65536, Unselected: 65533, Sequence: (0xc0000000, 1)->(0x0, 2046)->(0x1, 1)->end Curr:3 
WARN[2023-07-18T12:38:39.892402107+02:00] no trace recorder found, skipping            
DEBU[2023-07-18T12:38:39.953289460+02:00] Calling HEAD /_ping                          
DEBU[2023-07-18T12:38:39.998825613+02:00] Calling HEAD /_ping                          
DEBU[2023-07-18T12:38:39.999196084+02:00] Calling DELETE /v1.43/images/almalinux?force=1 
DEBU[2023-07-18T12:38:40.037691044+02:00] Calling HEAD /_ping                          
DEBU[2023-07-18T12:38:40.038295831+02:00] Calling DELETE /v1.43/images/one31368?force=1 
DEBU[2023-07-18T12:38:40.082353418+02:00] Calling HEAD /_ping                          
DEBU[2023-07-18T12:38:40.124578270+02:00] Calling HEAD /_ping                          
DEBU[2023-07-18T12:38:40.126457516+02:00] Calling DELETE /v1.43/images/almalinux?force=1 
DEBU[2023-07-18T12:38:40.160662853+02:00] Calling HEAD /_ping                          
DEBU[2023-07-18T12:38:40.161213098+02:00] Calling DELETE /v1.43/images/one31368?force=1 
DEBU[2023-07-18T12:38:43.904529363+02:00] 2023/07/18 12:38:43 WARNING: [core] [Channel #8 SubChannel #9] grpc: addrConn.createTransport failed to connect to {  library=grpc
DEBU[2023-07-18T12:38:43.904604517+02:00]   "Addr": "localhost",                        library=grpc
DEBU[2023-07-18T12:38:43.904620033+02:00]   "ServerName": "localhost",                  library=grpc
DEBU[2023-07-18T12:38:43.904644210+02:00]   "Attributes": null,                         library=grpc
DEBU[2023-07-18T12:38:43.904658513+02:00]   "BalancerAttributes": null,                 library=grpc
DEBU[2023-07-18T12:38:43.904677808+02:00]   "Type": 0,                                  library=grpc
DEBU[2023-07-18T12:38:43.904692598+02:00]   "Metadata": null                            library=grpc
DEBU[2023-07-18T12:38:43.904706742+02:00] }. Err: connection error: desc = "transport: Error while dialing only one connection allowed"  library=grpc
DEBU[2023-07-18T12:38:43.950887267+02:00] 2023/07/18 12:38:43 WARNING: [core] [Channel #11 SubChannel #12] grpc: addrConn.createTransport failed to connect to {  library=grpc
DEBU[2023-07-18T12:38:43.950941146+02:00]   "Addr": "localhost",                        library=grpc
DEBU[2023-07-18T12:38:43.950968134+02:00]   "ServerName": "localhost",                  library=grpc
DEBU[2023-07-18T12:38:43.950982603+02:00]   "Attributes": null,                         library=grpc
DEBU[2023-07-18T12:38:43.951037242+02:00]   "BalancerAttributes": null,                 library=grpc
DEBU[2023-07-18T12:38:43.951070601+02:00]   "Type": 0,                                  library=grpc
DEBU[2023-07-18T12:38:43.951085715+02:00]   "Metadata": null                            library=grpc
DEBU[2023-07-18T12:38:43.951117466+02:00] }. Err: connection error: desc = "transport: Error while dialing only one connection allowed"  library=grpc

It appears an error about library=grpc… but I have not found any solution.

So with miniONE, errors also ocurrs in the same way that in my cluster.

Both clusters (my testing one and the second where I have installed miniONE) are running AlmaLinux-9.2, but some weeks ago I tried with Debian 11 and the result was the same error.

Thanks.

[Daniel_Ruiz_Molina]

Any idea, @dclavijo?

Thanks.

[dclavijo (Daniel Clavijo)]

This looks like a problem specific to your Docker setup, not really related to OpenNebula. The requirements are quite simple. If you happen to find problems related to OpenNebula, replace the file /var/lib/one/remotes/datastore/docker_downloader.sh in the frontend with the latest master file . There are some fixes not present in 6.6.0.

Did you patched the downloader file after using minione ?

[Daniel_Ruiz_Molina]

Hi,

After updating /var/lib/one/remotes/datastores/docker-download.sh, the error persists…

=> one/oned.log <==
Mon Jul 31 09:51:57 2023 [Z0][AuM][D]: _authenticate: -
Mon Jul 31 09:51:57 2023 [Z0][ReM][D]: Req:5760 UID:0 IP:127.0.0.1 one.marketapppool.info invoked , -2, -1, -1
Mon Jul 31 09:51:57 2023 [Z0][ReM][D]: Req:5760 UID:0 one.marketapppool.info result SUCCESS, "<MARKETPLACEAPP_POOL..."
Mon Jul 31 09:51:58 2023 [Z0][AuM][D]: _authenticate: -
Mon Jul 31 09:51:58 2023 [Z0][ReM][D]: Req:8640 UID:0 IP:127.0.0.1 one.marketapp.info invoked , 618, false
Mon Jul 31 09:51:58 2023 [Z0][ReM][D]: Req:8640 UID:0 one.marketapp.info result SUCCESS, "<MARKETPLACEAPP><ID>..."
Mon Jul 31 09:51:58 2023 [Z0][ReM][D]: Req:7824 UID:0 IP:127.0.0.1 one.user.info invoked , 0, false
Mon Jul 31 09:51:58 2023 [Z0][ReM][D]: Req:7824 UID:0 one.user.info result SUCCESS, "<USER><ID>0</ID><GID..."


==> messages <==
Jul 31 09:51:58 servidor systemd[1]: var-lib-docker-tmp-buildkit\x2dmount2100778342.mount: Deactivated successfully.
Jul 31 09:51:58 servidor systemd[1]: var-lib-docker-tmp-buildkit\x2dmount3314833504.mount: Deactivated successfully.
Jul 31 09:51:58 servidor NetworkManager[804]: <info>  [1690789918.6342] manager: (veth1806d40): new Veth device (/org/freedesktop/NetworkManager/Devices/29)
Jul 31 09:51:58 servidor NetworkManager[804]: <info>  [1690789918.6400] manager: (veth6821a08): new Veth device (/org/freedesktop/NetworkManager/Devices/30)
Jul 31 09:51:58 servidor kernel: docker0: port 1(veth6821a08) entered blocking state
Jul 31 09:51:58 servidor kernel: docker0: port 1(veth6821a08) entered disabled state
Jul 31 09:51:58 servidor kernel: device veth6821a08 entered promiscuous mode


==> one/oned.log <==
Mon Jul 31 09:51:59 2023 [Z0][ImM][I]: Command execution failed (exit code: 255): /var/lib/one/remotes/datastore/fs/cp PERTX0RSSVZFUl9BQ1RJT05fREFUQT48SU1BR0U+PElEPjQ8L0lEPjxVSUQ+MDwvVUlEPjxHSUQ+MDwvR0lEPjxVTkFNRT5vbmVhZG1pbjwvVU5BTUU+PEdOQU1FPm9uZWFkbWluPC9HTkFNRT48TkFNRT5hbG1hbGludXg8L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjA8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+PE9USEVSX00+MDwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48UEVSU0lTVEVOVD4wPC9QRVJTSVNURU5UPjxSRUdUSU1FPjE2OTA3ODk5MTU8L1JFR1RJTUU+PFNPVVJDRT48IVtDREFUQVtdXT48L1NPVVJDRT48UEFUSD48IVtDREFUQVtkb2NrZXI6Ly9hbG1hbGludXg/c2l6ZT0yMDQ4JmZpbGVzeXN0ZW09ZXh0NCZmb3JtYXQ9cmF3XV0+PC9QQVRIPjxGT1JNQVQ+PCFbQ0RBVEFbXV0+PC9GT1JNQVQ+PEZTPjwhW0NEQVRBW11dPjwvRlM+PFNJWkU+MjA0ODwvU0laRT48U1RBVEU+NDwvU1RBVEU+PFBSRVZfU1RBVEU+MDwvUFJFVl9TVEFURT48UlVOTklOR19WTVM+MDwvUlVOTklOR19WTVM+PENMT05JTkdfT1BTPjA8L0NMT05JTkdfT1BTPjxDTE9OSU5HX0lEPi0xPC9DTE9OSU5HX0lEPjxUQVJHRVRfU05BUFNIT1Q+LTE8L1RBUkdFVF9TTkFQU0hPVD48REFUQVNUT1JFX0lEPjE8L0RBVEFTVE9SRV9JRD48REFUQVNUT1JFPmRlZmF1bHQ8L0RBVEFTVE9SRT48Vk1TPjwvVk1TPjxDTE9ORVM+PC9DTE9ORVM+PEFQUF9DTE9ORVM+PC9BUFBfQ0xPTkVTPjxURU1QTEFURT48REVWX1BSRUZJWD48IVtDREFUQVt2ZF1dPjwvREVWX1BSRUZJWD48RlJPTV9BUFA+PCFbQ0RBVEFbNjE4XV0+PC9GUk9NX0FQUD48RlJPTV9BUFBfTUQ1PjwhW0NEQVRBW2Y4Y2VjYTZlYjNjYmVlM2U2ZTk4ODdmMWIwZWM0OTI5XV0+PC9GUk9NX0FQUF9NRDU+PEZST01fQVBQX05BTUU+PCFbQ0RBVEFbYWxtYWxpbnV4XV0+PC9GUk9NX0FQUF9OQU1FPjxVUkxfQVJHUz48IVtDREFUQVt0YWc9OS4yXV0+PC9VUkxfQVJHUz48L1RFTVBMQVRFPjxTTkFQU0hPVFM+PEFMTE9XX09SUEhBTlM+PCFbQ0RBVEFbTk9dXT48L0FMTE9XX09SUEhBTlM+PENVUlJFTlRfQkFTRT48IVtDREFUQVstMV1dPjwvQ1VSUkVOVF9CQVNFPjxORVhUX1NOQVBTSE9UPjwhW0NEQVRBWzBdXT48L05FWFRfU05BUFNIT1Q+PC9TTkFQU0hPVFM+PEJBQ0tVUF9JTkNSRU1FTlRTPjwvQkFDS1VQX0lOQ1JFTUVOVFM+PC9JTUFHRT48REFUQVNUT1JFPjxJRD4xPC9JRD48VUlEPjA8L1VJRD48R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+ZGVmYXVsdDwvTkFNRT48UEVSTUlTU0lPTlM+PE9XTkVSX1U+MTwvT1dORVJfVT48T1dORVJfTT4xPC9PV05FUl9NPjxPV05FUl9BPjA8L09XTkVSX0E+PEdST1VQX1U+MTwvR1JPVVBfVT48R1JPVVBfTT4wPC9HUk9VUF9NPjxHUk9VUF9BPjA8L0dST1VQX0E+PE9USEVSX1U+MDwvT1RIRVJfVT48T1RIRVJfTT4wPC9PVEhFUl9NPjxPVEhFUl9BPjA8L09USEVSX0E+PC9QRVJNSVNTSU9OUz48RFNfTUFEPjwhW0NEQVRBW2ZzXV0+PC9EU19NQUQ+PFRNX01BRD48IVtDREFUQVtzc2hdXT48L1RNX01BRD48QkFTRV9QQVRIPjwhW0NEQVRBWy92YXIvbGliL29uZS8vZGF0YXN0b3Jlcy8xXV0+PC9CQVNFX1BBVEg+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48U1RBVEU+MDwvU1RBVEU+PENMVVNURVJTPjxJRD4wPC9JRD48L0NMVVNURVJTPjxUT1RBTF9NQj4xNzM5NzwvVE9UQUxfTUI+PEZSRUVfTUI+OTYxMjwvRlJFRV9NQj48VVNFRF9NQj43Nzg2PC9VU0VEX01CPjxJTUFHRVM+PElEPjA8L0lEPjwvSU1BR0VTPjxURU1QTEFURT48QUxMT1dfT1JQSEFOUz48IVtDREFUQVtZRVNdXT48L0FMTE9XX09SUEhBTlM+PENMT05FX1RBUkdFVD48IVtDREFUQVtTWVNURU1dXT48L0NMT05FX1RBUkdFVD48RElTS19UWVBFPjwhW0NEQVRBW0ZJTEVdXT48L0RJU0tfVFlQRT48RFNfTUFEPjwhW0NEQVRBW2ZzXV0+PC9EU19NQUQ+PExOX1RBUkdFVD48IVtDREFUQVtTWVNURU1dXT48L0xOX1RBUkdFVD48UkVTVFJJQ1RFRF9ESVJTPjwhW0NEQVRBWy9dXT48L1JFU1RSSUNURURfRElSUz48U0FGRV9ESVJTPjwhW0NEQVRBWy92YXIvdG1wXV0+PC9TQUZFX0RJUlM+PFRNX01BRD48IVtDREFUQVtzc2hdXT48L1RNX01BRD48VFlQRT48IVtDREFUQVtJTUFHRV9EU11dPjwvVFlQRT48L1RFTVBMQVRFPjwvREFUQVNUT1JFPjxNQVJLRVRQTEFDRT48SUQ+MzwvSUQ+PFVJRD4wPC9VSUQ+PEdJRD4wPC9HSUQ+PFVOQU1FPm9uZWFkbWluPC9VTkFNRT48R05BTUU+b25lYWRtaW48L0dOQU1FPjxOQU1FPkRvY2tlckh1YjwvTkFNRT48U1RBVEU+MDwvU1RBVEU+PE1BUktFVF9NQUQ+PCFbQ0RBVEFbZG9ja2VyaHViXV0+PC9NQVJLRVRfTUFEPjxaT05FX0lEPjwhW0NEQVRBWzBdXT48L1pPTkVfSUQ+PFRPVEFMX01CPjA8L1RPVEFMX01CPjxGUkVFX01CPjA8L0ZSRUVfTUI+PFVTRURfTUI+MDwvVVNFRF9NQj48TUFSS0VUUExBQ0VBUFBTPjxJRD40NTM8L0lEPjxJRD40NTQ8L0lEPjxJRD40NTU8L0lEPjxJRD40NTY8L0lEPjxJRD40NTc8L0lEPjxJRD40NTg8L0lEPjxJRD40NTk8L0lEPjxJRD40NjA8L0lEPjxJRD40NjE8L0lEPjxJRD40NjI8L0lEPjxJRD40NjM8L0lEPjxJRD40NjQ8L0lEPjxJRD40NjU8L0lEPjxJRD40NjY8L0lEPjxJRD40Njc8L0lEPjxJRD40Njg8L0lEPjxJRD40Njk8L0lEPjxJRD40NzA8L0lEPjxJRD40NzE8L0lEPjxJRD40NzI8L0lEPjxJRD40NzM8L0lEPjxJRD40NzQ8L0lEPjxJRD40NzU8L0lEPjxJRD40NzY8L0lEPjxJRD40Nzc8L0lEPjxJRD40Nzg8L0lEPjxJRD40Nzk8L0lEPjxJRD40ODA8L0lEPjxJRD40ODE8L0lEPjxJRD40ODI8L0lEPjxJRD40ODM8L0lEPjxJRD40ODQ8L0lEPjxJRD40ODU8L0lEPjxJRD40ODY8L0lEPjxJRD40ODc8L0lEPjxJRD40ODg8L0lEPjxJRD40ODk8L0lEPjxJRD40OTA8L0lEPjxJRD40OTE8L0lEPjxJRD40OTI8L0lEPjxJRD40OTM8L0lEPjxJRD40OTQ8L0lEPjxJRD40OTU8L0lEPjxJRD40OTY8L0lEPjxJRD40OTc8L0lEPjxJRD40OTg8L0lEPjxJRD40OTk8L0lEPjxJRD41MDA8L0lEPjxJRD41MDE8L0lEPjxJRD41MDI8L0lEPjxJRD41MDM8L0lEPjxJRD41MDQ8L0lEPjxJRD41MDU8L0lEPjxJRD41MDY8L0lEPjxJRD41MDc8L0lEPjxJRD41MDg8L0lEPjxJRD41MDk8L0lEPjxJRD41MTA8L0lEPjxJRD41MTE8L0lEPjxJRD41MTI8L0lEPjxJRD41MTM8L0lEPjxJRD41MTQ8L0lEPjxJRD41MTU8L0lEPjxJRD41MTY8L0lEPjxJRD41MTc8L0lEPjxJRD41MTg8L0lEPjxJRD41MTk8L0lEPjxJRD41MjA8L0lEPjxJRD41MjE8L0lEPjxJRD41MjI8L0lEPjxJRD41MjM8L0lEPjxJRD41MjQ8L0lEPjxJRD41MjU8L0lEPjxJRD41MjY8L0lEPjxJRD41Mjc8L0lEPjxJRD41Mjg8L0lEPjxJRD41Mjk8L0lEPjxJRD41MzA8L0lEPjxJRD41MzE8L0lEPjxJRD41MzI8L0lEPjxJRD41MzM8L0lEPjxJRD41MzQ8L0lEPjxJRD41MzU8L0lEPjxJRD41MzY8L0lEPjxJRD41Mzc8L0lEPjxJRD41Mzg8L0lEPjxJRD41Mzk8L0lEPjxJRD41NDA8L0lEPjxJRD41NDE8L0lEPjxJRD41NDI8L0lEPjxJRD41NDM8L0lEPjxJRD41NDQ8L0lEPjxJRD41NDU8L0lEPjxJRD41NDY8L0lEPjxJRD41NDc8L0lEPjxJRD41NDg8L0lEPjxJRD41NDk8L0lEPjxJRD41NTA8L0lEPjxJRD41NTE8L0lEPjxJRD41NTI8L0lEPjxJRD41NTM8L0lEPjxJRD41NTQ8L0lEPjxJRD41NTU8L0lEPjxJRD41NTY8L0lEPjxJRD41NTc8L0lEPjxJRD41NTg8L0lEPjxJRD41NTk8L0lEPjxJRD41NjA8L0lEPjxJRD41NjE8L0lEPjxJRD41NjI8L0lEPjxJRD41NjM8L0lEPjxJRD41NjQ8L0lEPjxJRD41NjU8L0lEPjxJRD41NjY8L0lEPjxJRD41Njc8L0lEPjxJRD41Njg8L0lEPjxJRD41Njk8L0lEPjxJRD41NzA8L0lEPjxJRD41NzE8L0lEPjxJRD41NzI8L0lEPjxJRD41NzM8L0lEPjxJRD41NzQ8L0lEPjxJRD41NzU8L0lEPjxJRD41NzY8L0lEPjxJRD41Nzc8L0lEPjxJRD41Nzg8L0lEPjxJRD41Nzk8L0lEPjxJRD41ODA8L0lEPjxJRD41ODE8L0lEPjxJRD41ODI8L0lEPjxJRD41ODM8L0lEPjxJRD41ODQ8L0lEPjxJRD41ODU8L0lEPjxJRD41ODY8L0lEPjxJRD41ODc8L0lEPjxJRD41ODg8L0lEPjxJRD41ODk8L0lEPjxJRD41OTA8L0lEPjxJRD41OTE8L0lEPjxJRD41OTI8L0lEPjxJRD41OTM8L0lEPjxJRD41OTQ8L0lEPjxJRD41OTU8L0lEPjxJRD41OTY8L0lEPjxJRD41OTc8L0lEPjxJRD41OTg8L0lEPjxJRD41OTk8L0lEPjxJRD42MDA8L0lEPjxJRD42MDE8L0lEPjxJRD42MDI8L0lEPjxJRD42MDM8L0lEPjxJRD42MDQ8L0lEPjxJRD42MDU8L0lEPjxJRD42MDY8L0lEPjxJRD42MDc8L0lEPjxJRD42MDg8L0lEPjxJRD42MDk8L0lEPjxJRD42MTA8L0lEPjxJRD42MTE8L0lEPjxJRD42MTI8L0lEPjxJRD42MTM8L0lEPjxJRD42MTQ8L0lEPjxJRD42MTU8L0lEPjxJRD42MTY8L0lEPjxJRD42MTc8L0lEPjxJRD42MTg8L0lEPjxJRD42MTk8L0lEPjxJRD42MjA8L0lEPjxJRD42MjE8L0lEPjxJRD42MjI8L0lEPjxJRD42MjM8L0lEPjxJRD42MjQ8L0lEPjxJRD42MjU8L0lEPjxJRD42MjY8L0lEPjxJRD42Mjc8L0lEPjwvTUFSS0VUUExBQ0VBUFBTPjxQRVJNSVNTSU9OUz48T1dORVJfVT4xPC9PV05FUl9VPjxPV05FUl9NPjE8L09XTkVSX00+PE9XTkVSX0E+MTwvT1dORVJfQT48R1JPVVBfVT4xPC9HUk9VUF9VPjxHUk9VUF9NPjA8L0dST1VQX00+PEdST1VQX0E+MDwvR1JPVVBfQT48T1RIRVJfVT4xPC9PVEhFUl9VPjxPVEhFUl9NPjA8L09USEVSX00+PE9USEVSX0E+MDwvT1RIRVJfQT48L1BFUk1JU1NJT05TPjxURU1QTEFURT48REVTQ1JJUFRJT04+PCFbQ0RBVEFbRG9ja2VySHViIGlzIHRoZSB3b3JsZCdzIGxhcmdlc3QgbGlicmFyeSBhbmQgIGNvbW11bml0eSBmb3IgY29udGFpbmVyIGltYWdlcyBob3N0ZWQgYXQgaHViLmRvY2tlci5jb20vXV0+PC9ERVNDUklQVElPTj48TUFSS0VUX01BRD48IVtDREFUQVtkb2NrZXJodWJdXT48L01BUktFVF9NQUQ+PC9URU1QTEFURT48L01BUktFVFBMQUNFPjwvRFNfRFJJVkVSX0FDVElPTl9EQVRBPg== 4
Mon Jul 31 09:51:59 2023 [Z0][ImM][I]: cp: Copying local image docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2 to the image repository
Mon Jul 31 09:51:59 2023 [Z0][ImM][E]: cp: Command "set -e -o pipefail; /var/lib/one/remotes/datastore/fs/../downloader.sh   'docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2' '/var/lib/one//datastores/1/d5cd686405f730b72465df391d08755e'" failed: Error response from daemon: No such image: almalinux:latest
Mon Jul 31 09:51:59 2023 [Z0][ImM][I]: Error response from daemon: No such image: almalinux:latest
Mon Jul 31 09:51:59 2023 [Z0][ImM][I]: Error copying
Mon Jul 31 09:51:59 2023 [Z0][ImM][I]: Error copying docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2 to /var/lib/one//datastores/1/d5cd686405f730b72465df391d08755e
Mon Jul 31 09:51:59 2023 [Z0][ImM][E]: Error copying image in the datastore: INFO: cp: Copying local image docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2 to the image repository ERROR: cp: Command "set -e -o pipefail; /var/lib/one/remotes/datastore/fs/../downloader.sh   'docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2' '/var/lib/one//datastores/1/d5cd686405f730b72465df391d08755e'" failed: Error response from daemon: No such image: almalinux:latest Error response from daemon: No such image: almalinux:latest Error copying Error copying docker://almalinux?size=2048&filesystem=ext4&format=raw&tag=9.2 to /var/lib/one//datastores/1/d5cd686405f730b72465df391d08755e
Mon Jul 31 09:51:59 2023 [Z0][InM][D]: Monitoring datastore default (1)
Mon Jul 31 09:51:59 2023 [Z0][ImM][D]: Datastore default (1) successfully monitored.


==> messages <==
Jul 31 09:51:58 servidor journal[1707]: Removing a network device that was not added
Jul 31 09:51:58 servidor kernel: eth0: renamed from veth1806d40
Jul 31 09:51:58 servidor kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth6821a08: link becomes ready
Jul 31 09:51:58 servidor kernel: docker0: port 1(veth6821a08) entered blocking state
Jul 31 09:51:58 servidor kernel: docker0: port 1(veth6821a08) entered forwarding state
Jul 31 09:51:58 servidor NetworkManager[804]: <info>  [1690789918.8249] device (veth6821a08): carrier: link connected
Jul 31 09:51:58 servidor NetworkManager[804]: <info>  [1690789918.8259] device (docker0): carrier: link connected
Jul 31 09:51:58 servidor kernel: docker0: port 1(veth6821a08) entered disabled state
Jul 31 09:51:58 servidor kernel: veth1806d40: renamed from eth0
Jul 31 09:51:58 servidor NetworkManager[804]: <info>  [1690789918.8761] manager: (veth1806d40): new Veth device (/org/freedesktop/NetworkManager/Devices/31)
Jul 31 09:51:58 servidor kernel: docker0: port 1(veth6821a08) entered disabled state
Jul 31 09:51:58 servidor kernel: device veth6821a08 left promiscuous mode
Jul 31 09:51:58 servidor kernel: docker0: port 1(veth6821a08) entered disabled state
Jul 31 09:51:58 servidor journal[1707]: Removing a network device that was not added
Jul 31 09:51:58 servidor journal[1707]: Removing a network device that was not added
Jul 31 09:51:58 servidor dockerd[17553]: time="2023-07-31T09:51:58.901420587+02:00" level=warning msg="no trace recorder found, skipping"
Jul 31 09:51:59 servidor systemd[1]: run-runc-oxf9hj91g3zug8ell3i0dffnv-runc.1kztea.mount: Deactivated successfully.
Jul 31 09:51:59 servidor systemd[1]: var-lib-docker-buildkit-executor-oxf9hj91g3zug8ell3i0dffnv-rootfs.mount: Deactivated successfully.
Jul 31 09:51:59 servidor systemd[1]: var-lib-docker-overlay2-3ld50abjv77tj8ro0juvhx5fp-merged.mount: Deactivated successfully.


==> one/oned.log <==
Mon Jul 31 09:52:00 2023 [Z0][ReM][D]: Req:7728 UID:0 IP:127.0.0.1 one.zone.raftstatus invoked 
Mon Jul 31 09:52:00 2023 [Z0][ReM][D]: Req:7728 UID:0 one.zone.raftstatus result SUCCESS, "<RAFT><SERVER_ID>-1<..."
Mon Jul 31 09:52:06 2023 [Z0][ReM][D]: Req:6272 UID:0 IP:127.0.0.1 one.zone.raftstatus invoked 
Mon Jul 31 09:52:06 2023 [Z0][ReM][D]: Req:6272 UID:0 one.zone.raftstatus result SUCCESS, "<RAFT><SERVER_ID>-1<..."
Mon Jul 31 09:52:06 2023 [Z0][ReM][D]: Req:2912 UID:0 IP:127.0.0.1 one.vmpool.infoextended invoked , -2, -1, -1, -1
Mon Jul 31 09:52:06 2023 [Z0][ReM][D]: Req:2912 UID:0 one.vmpool.infoextended result SUCCESS, "<VM_POOL></VM_POOL>"
Mon Jul 31 09:52:06 2023 [Z0][ReM][D]: Req:2656 UID:0 IP:127.0.0.1 one.vmpool.infoextended invoked , -2, -1, -1, -1
Mon Jul 31 09:52:06 2023 [Z0][ReM][D]: Req:2656 UID:0 one.vmpool.infoextended result SUCCESS, "<VM_POOL></VM_POOL>"
Mon Jul 31 09:52:06 2023 [Z0][DBM][I]: Purging obsolete LogDB records: 0 records purged. Log state: 0,0 - 0,0
Mon Jul 31 09:52:06 2023 [Z0][DBM][I]: Purging obsolete federated LogDB records: 0 records purged. Federated log size: 0.
Mon Jul 31 09:52:10 2023 [Z0][ReM][D]: Req:3312 UID:0 IP:127.0.0.1 one.zone.raftstatus invoked 
Mon Jul 31 09:52:10 2023 [Z0][ReM][D]: Req:3312 UID:0 one.zone.raftstatus result SUCCESS, "<RAFT><SERVER_ID>-1<..."

I have change permissions to /var/run/docker.sock to 666 (and restarted docker and opennebula daemons), but nothing…

I would like to upgrade my servers to 6.6.0 in September, but I need that downloading process of a DockerHub image runs well, because I want to add a third server for Firecracker VMs…

Thanks.

[dclavijo (Daniel Clavijo)]

Give this a go DockerHub handle images without a latest tag · Issue #6198 · OpenNebula/one · GitHub

[Daniel_Ruiz_Molina]

Hi @dclavijo,

I have tried this solution (removing line “RUN echo “#Generated by OpenNebula” > /etc/resolv.conf” in /usr/share/one/dockerhub/dockerfile and it seems that now image process creation from a DockerHub image runs OK. So… thanks!!!

I have tried this solution in my AlmaLinux-9.2 OpenNebula testing cluster. I will reproduce, again, all environment to make sure.

Thanks.