OpsMgr data warehouse: some things to consider

If you plan to use data from OpsMgr DW, you should be aware that there is a number of some specific points you should consider when developing your data retrieval strategy. Here are some of them:

  1. Aggregation.

Applies to: State and Performance data.

OpsMgr DW doesn’t store raw data for a long period of time. Of course, this can be changed, but will not be very efficient from performance point of view. So, most of reports deal with daily or hourly aggregated data. That means that you do not have access to your every-single-second sample. It doesn’t exist any more. Forget it.

  1. Daily Aggregation vs  Time Zone.

Applies to: State and Performance data.

If you’re working in a global or a multi-timezone  environment, you should keep in mind that daily-aggregated state and performance data will be calculated for one time zone only. Let’s say you have your core OpsMgr services installed somewhere with time zone A=UTC+4. All daily aggregates will have a “time mark” which will correspond to the midnight in TZ A=UTC+4. What will happen if someone will try to build a report using the other time zone? Nothing good, actually: time will be cut off from parameters, time will be cut off from values, user will not see time at all. But the data is still correspond to its’ original time zone. Don’t expect anyone to recalculate daily aggregates for each particular TZ.

  1. Some data are not stored but calculated on demand.

Applies to: State data.

There are some specifics about how aggregated state data is stored: all states except Green (Healthy) and White (Unmonitored) are stored. Green and White – are not. These two are calculated on the fly using following logics: IF (for given hourly/daily subinterval) management pack is installed AND object existed AND data has been collected THEN it is Green OTHERWISE it is White. Of course, that is not that simple – we have to do calculation only for the part of time interval which is not covered by stored data (other states).

  1. Gaps and missing data.

Applies to:  Everywhere.

Yes, that may happen. And that happens. Really. That’s not a joke. Sometimes data may be dropped without any further notice. Sometimes you’ll not get any event or notification or such. So expect that and do not count on 100% data accuracy. That’s life. Nobody is the saint.

Note: As I’m writing this in the sky (literally), this post may be updated with some other notes anytime, all updates will be shared via Twitter, Facebook and LinkedIn – use right pane to subscribe and stay connected!

Leave a Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.