Long time OpenNebula user, but only recently have been trying FireEdge. So far so good for the most part, BUT, I have run into an issue that my searches havent given any hints at.
My cluster deploys are fairly vanilla, no deviations from the docs, using Alma9 OS and OpenNebula-node-kvm + ceph squid with OSDs spread out across them all. One ceph system DS and one ceph image DS. I have no problems creating images directly on the ceph image DS, and on ON 6.4 and 6.8 importing apps from marketplace into the ceph image DS works as expected. However, FireEdge on 6.8, 6.10 and 7.0.1 doesn’t even provide the ceph image DS as an option to import apps to. I’m running both sunstone and FireEdge on 6.8 at the same time, and the images/templates I import via sunstone work just fine in FireEdge.
I’ve looked through the logs but found nothing relevant. It seems like there must be a setting or flag that FireEdge expects (and sunstone doesn’t) but I have not found any such flag documented or any reference to it in the config files.
Anybody else experience this and have any hints? I would really like to be running v7 with FireEdge but I would also really prefer to not need to use non-ceph DSs or configure ssh-based MAD if I can avoid it.
Sorry for the late reply, these days are complicated to follow the forum properly. In any case, welcome to this forum (glad to see you are a long time OpenNebula user), hope we can help you with your questions.
From what you shared, this isn’t a fundamental Ceph connectivity/auth issue, but something with how FireEdge is identifying datastore capabilities.
So couple of things to check:
Make sure your Ceph Image DS has attributes that make it eligible for app imports — for example: TYPE = IMAGE IMAGE_DRIVER = qemu (standard) TM_MAD = ceph and DS_MAD = ceph
Double-check that the Ceph Image DS is SHARED = yes and has a proper BRIDGE_LIST defined
Also check if FireEdge has any configurable setting (possibly in its config or defaults) that restricts the visible datastore list based on TYPE, ACCESS, or MARKETPLACE flags.
I’m sure you checked our documentation, but just in case: Ceph Datastore
However, it might be a bug in FireEdge, so my suggestion is to open an issue on the repo (let me know, so I can follow up with the team properly). You can file one here: ONE Repo.
@IanStakenvicius , to isolate the issue, could you, please, check if you can import the image from OpenNebula marketplace to ceph-based IMAGE DS via command line?
E.g. with something like:
onemarketapp export "Alpine Linux 3.21" alpine-3.21 --datastore <imageds_id>
where <imageds_id> needs to be replaced with your ceph-based Image DS.
Please, let us know the result. If it fails, please, share the relevant part of the oned.log file as well as the output of the onedatastore show <imageds_id> -j .
Thank you! No worries about any delays, t’is the season. So I forced a SHARED = yes via the gui, on both 6.8 and 7.0.1 and it started working. The setting (after I set it) disappeared rather than being shown in the list of properties for the DS. I also confirmed that SHARED = YES is in the oned.conf for the TM_MAD_CONF for ceph on both, so maybe ( if there is a bug ) it’s with loading that setting?
To confirm the issue in more detail I will need to tear down and start again (which I will), will report back via ticket whatever issue I find