80,000 Transactions Per Second, Exponentially Faster Results
With Splunk, TSE has solved its manageability challenges at speed and scale. “We need a platform that is fully manageable in-house, flexible enough to handle different situations and able to parse data in minutes or even seconds,” says Atsushi Yamamoto, head of infrastructure and operations in the IT development department at TSE.
Splunk technology makes these goals possible by automatically storing data to the indexer, allowing TSE to quickly retrieve trade transaction information with Splunk’s search processing language (SPL). “We are running as many as 80,000 transactions per second, but Splunk lets us see all data in real time,” explains Yamamoto. “Since arrowhead processes every order in about 200 microseconds, even one second of waiting time is too long, but Splunk keeps pace with our needs by generating results tens of times faster than our old system.”
From saving time to increasing data availability, TSE is also reaping other benefits across the organization. “SPL comes with a series of functions for calculating percentile values. Its summary indexing also lets us extract values in advance and quickly get information,” says Yamamoto. “We now streamline coordination with peripheral systems through the intuitive applications programming interface while automating repetitive manual tasks. By compiling a simple search query, the information will immediately appear in Excel.”