By Splunk October 27, 2009
Every week i run into someone that is having performance issues and they are not aware you can just add another server or two or ten. I’ll travel to meet a company and I’ll ask how many servers they are using for Splunk to search/index/report on a terabyte a day. They will say a couple. I’ll then ask how many they have for a similar sized hadoop or data warehouse project. They will say 50 to 100X that number. Look if your going to give these systems 300+ servers, can we please get 15?
Somehow there is a breakdown in our communication that we scale like all other good architectures.
The following are hopefully some easy pictures to help tell the story. It should be extremely simple and straight forward, to the point of being obvious – if not bug me and i’ll try again.