# Long term statistics and capacity management for OpenNebula Clouds

**URL:** <https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886>\
**Category:** Integration Support\
**Created:** [March 4, 2016, 12:14pm UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886 "2016-03-04T12:14:27Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![opennebula2](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/opennebula2/32/6732_2.png) [@opennebula2](https://forum.opennebula.io/u/opennebula2)\
**Post date:** [March 4, 2016, 12:14pm UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886/1 "2016-03-04T12:14:27Z")

</div>

Hi,

we are running serveral OpenNebula Instances within our Datacenters.

Our current capacity management is built on top of some Excel Sheets which show us  
REAL vs. ALLOCATED vs. USED. This is odd.

All other Services (running on top of the OpenNebula IaaS-Stack) have their own Graphite Metrics collected and pushed them to shiny and cool Dashboards (like [Dashing.io](http://Dashing.io)).

I think the same solutions (for example ONE Graphite-Metrics out of the Box) for OpenNebula will be quite nice.  
It could be a shiny solution for providing long-term statistics and a base for Capacity management.

What do you think? What do you use for capacity management?

For example, a small patch of ` im/kvm-probes.d/kvm.rb` with some lines of code could generate the Metrics for these kind of statistics? But will this be the right place to gather this stats? Are there any other sources?

Best regards,

Sebastian

---

<div class="post-metadata">

**Author:** ![cmartin](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/cmartin/32/4278_2.png) [@cmartin](https://forum.opennebula.io/u/cmartin)\
**Post date:** [March 4, 2016, 4:51pm UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886/2 "2016-03-04T16:51:45Z")

</div>

Hi,

The probes might not be the best place to add custom code. They run in the the host, not the front-end, and you don’t have internal OpenNebula data that you may want to collect, such as allocated memory.  
I’d consider a cron job running in the front-end. The [ruby api](http://docs.opennebula.org/4.14/integration/system_interfaces/ruby.html) or the `onehost list -x` output will provide all the info you need to parse.

Let us know if you come up with a solution!

---

<div class="post-metadata">

**Author:** ![opennebula2](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/opennebula2/32/6732_2.png) [@opennebula2](https://forum.opennebula.io/u/opennebula2)\
**Post date:** [March 14, 2016, 1:36pm UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886/3 "2016-03-14T13:36:09Z")

</div>

Hi,

i created a small ruby class/script which pulls the desired informations out of OpenNebula (parsing the XML output of `onehost list -x` ). The desired values are pushed to graphite and i can play with the metrics. Currently there are only some Grafana Dashboards where you can filter for “Top Ressources” (for example “display the most loaded host” or “display the X hosts with most USED\_MEM”). The next steps will be to create some graphs for capacity management and develop a nice [Dashing.io](http://Dashing.io) dashboard for our big screens. Perhaps i will share the informations as a new post at your blog ( [http://opennebula.org/blog/](http://opennebula.org/blog/) ) - interested?

See some screenshots of the first graphed metrics:

 ![](https://canada1.discourse-cdn.com/flex031/uploads/opennebula/original/2X/7/7be1b7ed3c902c1dcc8eb04cb83c98380a0a3de4.png)

 ![](https://canada1.discourse-cdn.com/flex031/uploads/opennebula/original/2X/d/dad3b396eadf5bcb30c2783908186e1fda9f76dd.png)

 ![](https://canada1.discourse-cdn.com/flex031/uploads/opennebula/original/2X/4/4ac39282a7ca3ff868ab0ea1d176889f9bf2900a.png)

---

<div class="post-metadata">

**Author:** ![dmolina](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/dmolina/32/22_2.png) [@dmolina](https://forum.opennebula.io/u/dmolina)\
**Post date:** [March 14, 2016, 5:32pm UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886/4 "2016-03-14T17:32:28Z")

</div>

Hi Sebastian,

That looks great!! Details on this kind of development are always welcomed in our blog. Please send me an email address to [dmolina@opennebula.org](mailto:dmolina@opennebula.org) and I will create an account for you.

Thank you

---

<div class="post-metadata">

**Author:** ![anandharaj](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@anandharaj](https://forum.opennebula.io/u/anandharaj)\
**Post date:** [March 18, 2016, 7:29am UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886/5 "2016-03-18T07:29:04Z")

</div>

Hi @opennebula2,

That’s look great. Im very much interested to try out if you able to share it.

---

<div class="post-metadata">

**Author:** ![opennebula2](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/opennebula2/32/6732_2.png) [@opennebula2](https://forum.opennebula.io/u/opennebula2)\
**Post date:** [March 18, 2016, 11:21am UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886/6 "2016-03-18T11:21:39Z")

</div>

Hi,

of course i will share it. But currently i had to finalize it. The first Grafana-Dashboards are finished (with templating, filter for top resources, drilldown VMM host and capacity planning (N+1 redundancy). The next thing is to develop a Dashing dashboard with some interesting metrics.

My goal is to produce some content for the OpenNebula Blog (@dmolina: i already have a acccount “Sebastian Mangelkramer”).  
I will publish a short howto and everyone can play with it.

Best regards,  
Sebastian

Current “OpenNebula Dashing Dashboard”:

 ![](https://canada1.discourse-cdn.com/flex031/uploads/opennebula/original/2X/2/2a76477b46e5828d2d18e33769e88332cbf7adf3.png)

---

<div class="post-metadata">

**Author:** ![valerio\_schiavoni](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/valerio_schiavoni/32/4175_2.png) [@valerio\_schiavoni](https://forum.opennebula.io/u/valerio_schiavoni)\
**Post date:** [July 31, 2016, 11:10am UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886/7 "2016-07-31T11:10:55Z")

</div>

Any update on the mentioned short how-to ? Was it eventually published somewhere?

Thanks

---

<div class="post-metadata">

**Author:** ![opennebula2](https://yyz1.discourse-cdn.com/flex031/user_avatar/forum.opennebula.io/opennebula2/32/6732_2.png) [@opennebula2](https://forum.opennebula.io/u/opennebula2)\
**Post date:** [August 1, 2016, 9:58am UTC](https://forum.opennebula.io/t/long-term-statistics-and-capacity-management-for-opennebula-clouds/1886/8 "2016-08-01T09:58:08Z")

</div>

Hi, it was announced in the OpenNebula blog and one newsletter. Look there for more information: [https://github.com/TeleData/one-graphite](https://github.com/TeleData/one-graphite)

Let me know if you have any problems running the scripts.

Best regards,  
Sebastian
