Our Data Sherlock, who’s been in the software business for over two decades now, recently decided to review the history of software back into the ‘60s. Why, you ask? Fair question because who wants to spend hours reading about software strategies and new products, all while trying to piece together strategies from four or five decades ago?
As someone who has owned go-to-market strategy for software companies before, our Data Sherlock believes this is great way to gain insights on patterns and assumptions that have proven to be false. Data Sherlock went onto expand upon the value of this particular exercise.
Specifically, our Data Sherlock told us, “I want you to think about the subject of event management and why I think the legacy approach is dead.
Event management was coined decades ago but boils down to two key concepts.
1. The volume and speed of events/alerts/etc. far exceeds the capacity of a team to process all of them on a daily basis so they require help.
2. Software must be used to try and find the few important events and dump the rest because the team needs to process the important events and ignore the rest.
Over the decades these two methods have held true and many software vendors have tried to improve event management with various weights, factors or variables all while trying to produce an output small enough that the resources could process them before the next batch dumped in their laps."
Our Data Sherlock further explained, “In my review it was almost comical how many unique software products hailed as 'revolutionary!' in past announcements were actually created with just minor tweaks or enhancements.”
Having done the review of the past, Data Sherlock went on to say, “Fast-forward to today and we need to ask ourselves some hard questions.
Do we see the pace of change or events slowing down? — Nope!
Do you in fact see a real possibility that the speed ramps up and you just turn off all event management solutions and wait for the phone to ring? — Don’t laugh; I have heard operation managers say with great certainty that this could be where they end up in the near future because their event management solutions are not keeping up with the speed and volume required.”
Our Data Sherlock considers the above to be factual as anyone can go back and review the same history that he did and even suspects that they we will come to the exact same outcome. Looking into the future, he believes that debates about whether to stick with the old methods associated with event management or adopting new strategies could emerge and as such wanted to share his thoughts.
“First, I believe it is unwise to try and hold onto an idea of creating management software with enough rules, configurations and such to reduce volume to manageable levels. I just don’t think this is possible and, more importantly, I believe it is the wrong strategy. I believe all the events are important and useful if you can capture them, compare them to a baseline and then let the software tell you what is not normal for your environment.
Second, I believe machine learning running against a complete data set is what produces the most accurate and useful information about what is and isn’t normal and the types of events that should be reviewed.
Third, I believe we must consider the “service context” or more specifically, the ability to look at everything in the context of business services. This empowers organizations to understand what is important and why it is important. The service context is critical as it is the better answer to the question of human scale, as rules and more configuration do not work in a go-forward strategy.
Thus, I believe the old world of event management that drove the creation of smaller lists is over and the future is one that considers all data, creates a baseline by learning your unique environment and finally produces notable events in context of your shop and all your data sets.”
Our Data Sherlock ended his explanation on this final note. “In the end, event management is dead—long live event analytics!"
Z – Data Sherlock