Lxc container giving error while launching

Community Support
1

Please, describe the problem here and provide additional information below (if applicable) …
We have added lxc node and while creating lxc container using market places images its giving below error related to block devices not on such as below.

Thu Feb 13 13:49:48 2025 [Z0][VM][I]: New state is ACTIVE
Thu Feb 13 13:49:48 2025 [Z0][VM][I]: New LCM state is PROLOG
Thu Feb 13 13:51:12 2025 [Z0][VM][I]: New LCM state is BOOT
Thu Feb 13 13:51:12 2025 [Z0][VMM][I]: Generating deployment file: /var/lib/one/vms/119/deployment.0
Thu Feb 13 13:51:14 2025 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_context.
Thu Feb 13 13:51:15 2025 [Z0][VMM][I]: ExitCode: 0
Thu Feb 13 13:51:15 2025 [Z0][VMM][I]: Successfully execute network driver operation: pre.
Thu Feb 13 13:51:15 2025 [Z0][VMM][I]: ExitCode: 0
Thu Feb 13 13:51:15 2025 [Z0][VMM][I]: Successfully execute virtualization driver operation: /bin/mkdir -p.
Thu Feb 13 13:51:15 2025 [Z0][VMM][I]: ExitCode: 0
Thu Feb 13 13:51:15 2025 [Z0][VMM][I]: Successfully execute virtualization driver operation: /bin/cat - >/var/lib/one//datastores/118/119/vm.xml.
Thu Feb 13 13:51:16 2025 [Z0][VMM][I]: ExitCode: 0
Thu Feb 13 13:51:16 2025 [Z0][VMM][I]: Successfully execute virtualization driver operation: /bin/cat - >/var/lib/one//datastores/118/119/ds.xml.
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: Command execution fail (exit code: 255): cat << ‘EOT’ | /var/tmp/one/vmm/lxc/deploy ‘/var/lib/one//datastores/118/119/deployment.0’ ‘blrnode1’ 119 blrnode1
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: deploy: No block device on /var/lib/one/datastores/118/119/mapper/disk.0
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: deploy: No block device on /var/lib/one/datastores/118/119/mapper/disk.1
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo lxc-ls
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lsblk -o NAME,FSTYPE
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lsblk -o NAME,FSTYPE
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lsblk -o NAME,FSTYPE
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lsblk -o NAME,FSTYPE
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo -n mount /dev/vg-one-118/lv-one-119-0 /var/lib/one/datastores/118/119/mapper/disk.0
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo -n bindfs --uid-offset=-9869 --gid-offset=-9869 -o suid /var/lib/one/datastores/118/119/mapper/disk.0 /var/lib/lxc-one/119/disk.0
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo -n losetup --find --show /var/lib/one/datastores/118/119/disk.1
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lsblk -o NAME,FSTYPE
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo -n mount /dev/loop0 /var/lib/one/datastores/118/119/mapper/disk.1
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo -n bindfs --uid-offset=-9869 --gid-offset=-9869 -o suid /var/lib/one/datastores/118/119/mapper/disk.1 /var/lib/lxc-one/119/disk.1
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo lxc-create -n ‘one-119’ --config /var/lib/one/datastores/118/119/deployment.file --template none
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: Error executing: sudo lxc-start -n ‘one-119’
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: [stderr]: lxc-start: one-119: lxccontainer.c: wait_on_daemonized_start: 851 Received container state “ABORTING” instead of “RUNNING”
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lxc-start: one-119: tools/lxc_start.c: main: 329 The container failed to start
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lxc-start: one-119: tools/lxc_start.c: main: 332 To get more details, run the container in foreground mode
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lxc-start: one-119: tools/lxc_start.c: main: 335 Additional information can be obtained by setting the --logfile and --logpriority options
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: Check container logs at /var/log/lxc/one-119.log
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: deploy: No block device on /var/lib/one/datastores/118/119/mapper/disk.0
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo -n umount /var/lib/lxc-one/119/disk.1
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo -n umount /var/lib/one/datastores/118/119/mapper/disk.1
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo -n losetup -d /dev/loop0
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: sudo lxc-ls
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: Error executing: sudo lxc-destroy -n ‘one-119’
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: [stderr]: lxc-destroy: one-119: utils.c: _recursive_rmdir: 162 Inappropriate ioctl for device - Failed to delete “/var/lib/lxc-one/119/disk.0”
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lxc-destroy: one-119: storage/dir.c: dir_destroy: 133 Failed to delete “/var/lib/lxc-one/119/disk.0”
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lxc-destroy: one-119: lxccontainer.c: container_destroy: 2984 Error destroying rootfs for one-119
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: lxc-destroy: one-119: tools/lxc_destroy.c: do_destroy: 129 Destroying one-119 failed
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: Check container logs at /var/log/lxc/one-119.log
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: There was an error starting the containter.
Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: ExitCode: 255
Thu Feb 13 13:51:18 2025 [Z0][VMM][I]: ExitCode: 0
Thu Feb 13 13:51:18 2025 [Z0][VMM][I]: Successfully execute network driver operation: clean.
Thu Feb 13 13:51:18 2025 [Z0][VMM][I]: Failed to execute virtualization driver operation: deploy.
Thu Feb 13 13:51:18 2025 [Z0][VMM][E]: DEPLOY: INFO: deploy: No block device on /var/lib/one/datastores/118/119/mapper/disk.0 INFO: deploy: No block device on /var/lib/one/datastores/118/119/mapper/disk.1 sudo lxc-ls lsblk -o NAME,FSTYPE lsblk -o NAME,FSTYPE lsblk -o NAME,FSTYPE lsblk -o NAME,FSTYPE sudo -n mount /dev/vg-one-118/lv-one-119-0 /var/lib/one/datastores/118/119/mapper/disk.0 sudo -n bindfs --uid-offset=-9869 --gid-offset=-9869 -o suid /var/lib/one/datastores/118/119/mapper/disk.0 /var/lib/lxc-one/119/disk.0 sudo -n losetup --find --show /var/lib/one/datastores/118/119/disk.1 lsblk -o NAME,FSTYPE sudo -n mount /dev/loop0 /var/lib/one/datastores/118/119/mapper/disk.1 sudo -n bindfs --uid-offset=-9869 --gid-offset=-9869 -o suid /var/lib/one/datastores/118/119/mapper/disk.1 /var/lib/lxc-one/119/disk.1 sudo lxc-create -n ‘one-119’ --config /var/lib/one/datastores/118/119/deployment.file --template none Error executing: sudo lxc-start -n ‘one-119’ [stderr]: lxc-start: one-119: lxccontainer.c: wait_on_daemonized_start: 851 Received container state “ABORTING” instead of “RUNNING” lxc-start: one-119: tools/lxc_start.c: main: 329 The container failed to start lxc-start: one-119: tools/lxc_start.c: main: 332 To get more details, run the container in foreground mode lxc-start: one-119: tools/lxc_start.c: main: 335 Additional information can be obtained by setting the --logfile and --logpriority options Check container logs at /var/log/lxc/one-119.log INFO: deploy: No block device on /var/lib/one/datastores/118/119/mapper/disk.0 sudo -n umount /var/lib/lxc-one/119/disk.1 sudo -n umount /var/lib/one/datastores/118/119/mapper/disk.1 sudo -n losetup -d /dev/loop0 sudo lxc-ls Error executing: sudo lxc-destroy -n ‘one-119’ [stderr]: lxc-destroy: one-119: utils.c: _recursive_rmdir: 162 Inappropriate ioctl for device - Failed to delete “/var/lib/lxc-one/119/disk.0” lxc-destroy: one-119: storage/dir.c: dir_destroy: 133 Failed to delete “/var/lib/lxc-one/119/disk.0” lxc-destroy: one-119: lxccontainer.c: container_destroy: 2984 Error destroying rootfs for one-119 lxc-destroy: one-119: tools/lxc_destroy.c: do_destroy: 129 Destroying one-119 failed Check container logs at /var/log/lxc/one-119.log There was an error starting the containter. ExitCode: 255
Thu Feb 13 13:51:18 2025 [Z0][VM][I]: New LCM state is BOOT_FAILURE

Versions of the related components and OS (frontend, hypervisors, VMs):

Steps to reproduce:

Current results:

Expected results:

2

lxc failed to start the container for whatever reason

Thu Feb 13 13:51:17 2025 [Z0][VMM][I]: Check container logs at /var/log/lxc/one-119.log

Take a look at that file for clues

3

Hi Daniel,
Thanks for responding & sharing the clue to look the problem where lies but it will appreciate if you give some more information for below errors, which i found at suggested log location.
lxc-start one-124 20250213171408.829 ERROR conf - conf.c:mount_autodev:1133 - Input/output error - Failed to create “/dev” directory
lxc-start one-124 20250213171408.829 ERROR conf - conf.c:lxc_setup:3527 - Failed to mount “/dev”
lxc-start one-124 20250213171408.829 ERROR start - start.c:do_start:1299 - Failed to setup container “one-124”
lxc-start one-124 20250213171408.830 ERROR sync - sync.c:__sync_wait:62 - An error occurred in another process (expected sequence number 5)
lxc-start one-124 20250213171408.830 ERROR start - start.c:lxc_abort:1103 - Function not implemented - Failed to send SIGKILL to 21067
lxc-start one-124 20250213171408.830 ERROR lxccontainer - lxccontainer.c:wait_on_daemonized_start:851 - Received container state “ABORTING” instead of “RUNNING”
lxc-start one-124 20250213171408.832 ERROR start - start.c:__lxc_start:2019 - Failed to spawn container “one-124”

4

lxc-start one-124 20250213171408.829 ERROR conf - conf.c:mount_autodev:1133 - Input/output error - Failed to create “/dev” directory
lxc-start one-124 20250213171408.829 ERROR conf - conf.c:lxc_setup:3527 - Failed to mount “/dev”

Perhaps there is an issue with the VM image. Please inspect the image contents and check if the filesystem in looks alright. For this you can

  • mount the logical volume sudo -n mount /dev/vg-one-118/lv-one-119-0 /var/lib/one/datastores/118/119/mapper/disk.0
  • then inspect the filesystem on the mountpoint ls -l /var/lib/one/datastores/118/119/mapper/disk.0.

If possible, please also share the VM instance template onevm show -j <vm_id>.

5

Thanks for your suggestion, Daniel. let me check this again will post you the further asked details.

6

Hi Daniel,
Pls find the asked details.
**************after mounting the said disk.0
[oneadmin@lxcnode mnt]$ ls -l
total 28
drwxr-xr-x 2 root root 4096 Feb 21 16:25 context
drw-r–r-- 2 root root 4096 Feb 21 16:20 dev
drwx------ 2 root root 16384 Feb 21 16:11 lost+found
drwxr-xr-x 2 root root 4096 Feb 21 16:25 proc
[oneadmin@lxcnode mnt]$

onevm show -j ****
[oneadmin@vOne opt]$ onevm show -j 166

{

“VM”: {

"ID": "166",

"UID": "0",

"GID": "0",

"UNAME": "oneadmin",

"GNAME": "oneadmin",

"NAME": "cn",

"PERMISSIONS": {

  "OWNER_U": "1",

  "OWNER_M": "1",

  "OWNER_A": "0",

  "GROUP_U": "0",

  "GROUP_M": "0",

  "GROUP_A": "0",

  "OTHER_U": "0",

  "OTHER_M": "0",

  "OTHER_A": "0"

},

"LAST_POLL": "1740388944",

"STATE": "3",

"LCM_STATE": "36",

"PREV_STATE": "3",

"PREV_LCM_STATE": "36",

"RESCHED": "0",

"STIME": "1740388091",

"ETIME": "0",

"DEPLOY_ID": {

},

"MONITORING": {

  "DISK_SIZE": [

    {

      "ID": "0",

      "SIZE": "3"

    },

    {

      "ID": "1",

      "SIZE": "1"

    }

  ],

  "ID": "166",

  "TIMESTAMP": "1740388944"

},

"SCHED_ACTIONS": {

},

"TEMPLATE": {

  "AUTOMATIC_DS_REQUIREMENTS": "(\"CLUSTERS/ID\" @> 103)",

  "AUTOMATIC_NIC_REQUIREMENTS": "(\"CLUSTERS/ID\" @> 103)",

  "AUTOMATIC_REQUIREMENTS": "(CLUSTER_ID = 103) & !(PUBLIC_CLOUD = YES) & !(PIN_POLICY = PINNED)",

  "CONTEXT": {

    "DISK_ID": "1",

    "NETWORK": "YES",

    "SET_HOSTNAME": "cn",

    "SSH_PUBLIC_KEY": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMprlblGOjvzc9GuoIj9izXNzkfajGZcFekt3SbmT7G3+YMkTXcMGN1swhX4nb03ZiLjvOQcyTIySqmSD1OpwarahnaRIUgkodqI66NrYcTzSENsP3cBWg+Wl6vqMQXetZRvm74p719KmoI7to7W2kQDXl0Nj0uFYTqzsbhDcEk4SR3XwnShP8rHweNcslrhFqVjr7vm6v1ojp4n3VvbDLO6NbCDLGx/Ha8U9W8Jo4iyNhD4276KeEyTj/UgVCuU7gs5LQB8L8nk8/73epe1McwdasnC0yVs0Av0q9D1M5qKrL+UocoStkgcKNsPkpemfPXr0BzNB/QU4CmIrSbSytCFZe8PLPob8MWx4q+u+tE2AreObxCspARIKqAyRQ5LBnRETrx6wcYgo059k9EOq8gqUvZKP7LZ4Bm5W1e1KkRb8xuXQFqjzMhmbCuGdLU/SwOZ9cvBKsc7deiPWLtIjilhpwsbSnNty35KyV4CwoLBddHXpdcfVXeMoBv3WJGhU= oneadmin@vOne\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFzUg7+F5kVv7YJ6J9S+WFBkESbS7Z69xe+g6Wf0Oc6WTfpgXh8f+li9NqyF3muoWx4Q7Y5I+lwDTsDjuzeCDgOluNUodsx5p4dFTuxAtyOJfIj8MMXkm5bIyI0YxyzcwBM7kcj1usGEiodSACzJQpjgNqJfat+UQ+JORinpENoQZeaLqoXk3qCB6LRa9jRpLKe9WDu6S1w25nIkOVNT4wGxRNY8p6hnlmU9Ox80Td7oLFB4Z82GKDvOBh24Mr6Vav3Eq8SPen0T+OcVlgJGQ/qSlRRyfiwmk/DAJ2oNPGtYQEQgBOncPdeLRNfq+vb+y4S2g+QGKu1vrDdVCGeRq784177ocNt5biGMI3TF95eL+ZJ85Qq+w9JMGAvnhAXn3DB/gLOiahqawJBlVQMU+9ddsG9i+mG9AUH1ri4TKieCaApOPQoCPSF4E3NgywxKs/0gPI8vSj0lSpwIaHOoRuBcxTeeUuiIVI6ACkxGdRwmT4sd+Fe5Rh7zGCF+lNmSU= root@vOne",

    "TARGET": "hda"

  },

  "CPU": "1",

  "DISK": [

    {

      "ALLOW_ORPHANS": "YES",

      "CLONE": "YES",

      "CLONE_TARGET": "SYSTEM",

      "CLUSTER_ID": "103",

      "DATASTORE": "raw_device_ds",

      "DATASTORE_ID": "130",

      "DEV_PREFIX": "sd",

      "DISK_ID": "0",

      "DISK_SNAPSHOT_TOTAL_SIZE": "0",

      "DISK_TYPE": "BLOCK",

      "DRIVER": "raw",

      "FORMAT": "raw",

      "IMAGE": "oracle_7 - LXC",

      "IMAGE_ID": "83",

      "IMAGE_STATE": "2",

      "LN_TARGET": "SYSTEM",

      "ORIGINAL_SIZE": "2048",

      "READONLY": "NO",

      "SAVE": "NO",

      "SIZE": "10240",

      "SOURCE": "/var/lib/one//datastores/130/35da8374e10d46822bb293697d204eff",

      "TARGET": "sda",

      "TM_MAD": "ssh",

      "TYPE": "BLOCK"

    }

  ],

  "GRAPHICS": {

    "LISTEN": "0.0.0.0",

    "PORT": "6066",

    "TYPE": "vnc"

  },

  "MEMORY": "768",

  "OS": {

    "UUID": "6cad0d83-7c03-4dd3-8cb7-19721d310a5c"

  },

  "TEMPLATE_ID": "64",

  "TM_MAD_SYSTEM": "ssh",

  "VCPU": "2",

  "VMID": "166"

},

"USER_TEMPLATE": {

  "LXC_UNPRIVILEGED": "false",

  "SCHED_DS_REQUIREMENTS": "ID=\"125\"",

  "SCHED_REQUIREMENTS": "ID=\"8\""

},

"HISTORY_RECORDS": {

  "HISTORY": {

    "OID": "166",

    "SEQ": "0",

    "HOSTNAME": "lxcnode",

    "HID": "8",

    "CID": "103",

    "STIME": "1740388099",

    "ETIME": "0",

    "VM_MAD": "lxc",

    "TM_MAD": "ssh",

    "DS_ID": "125",

    "PSTIME": "1740388099",

    "PETIME": "1740388104",

    "RSTIME": "1740388104",

    "RETIME": "1740388109",

    "ESTIME": "0",

    "EETIME": "0",

    "ACTION": "0",

    "UID": "-1",

    "GID": "-1",

    "REQUEST_ID": "-1"

  }

},

"BACKUPS": {

  "BACKUP_CONFIG": {

  },

  "BACKUP_IDS": {

  }

}

}

}

7

This looks like an empty container image. There is no Linux FS to run.

What OS/distro do you have on the LXC node and what marketplace appliance did you use to create the container ?