Splunk Observability at Cisco Live: Agent Evaluation, Tokenomics on AWS, and Simplified Full-Stack Packaging

Observability Cale Hilts

Key takeaways

  1. Agent Evaluation & Guardrails: Evaluate live agent interactions in 100 milliseconds with Eval-G1 Evaluation Models and create custom, no-code safety rules in the new Evaluation Tuner. Both are planned for general availability in November 2026.
  2. Tokenomics: Launching as an AWS Marketplace solution, Tokenomics provides comprehensive cost governance and performance tracking, giving organizations running on AWS a unified way to monitor each agent by its cost and business results. It is planned for preview in November 2026, with general availability following in early 2027.
  3. Simplified Observability Adoption: Gain full-stack APM, infrastructure monitoring, and built-in Agent Observability without commercial barriers through new Essentials and Premier Editions, complete with tiered Observability Logs. Both editions are planned for general availability in early November 2026.

As AI becomes an integral part of production applications, the engineering teams responsible for those services face urgent, practical questions: Can we tell when an agent behaves unexpectedly? Can we steer its behavior to keep it on the right path? Can we find the logs needed to diagnose a live issue without facing bill shock? And can we connect our AI spend directly to business outcomes to prove these investments are genuinely paying off?

At Cisco Live Melbourne, we’re extending Splunk Observability Cloud and Splunk Agent Observability with new ways to govern AI spend and evaluate agent behavior in live production workflows. These announcements build on foundational capabilities introduced at .conf26, while Splunk Observability Cloud Essentials and Premier Editions provide an easier, more predictable way to adopt and expand full-stack observability.

Together, these updates support our core mission to Optimize AI at Scale: making it easier to troubleshoot applications, manage AI spend, and understand what agents do before their actions reach customers.

Maximize Infrastructure Resilience by Removing Commercial Barriers to Observability

For many organizations, the hardest part of scaling observability across an enterprise isn't the technology-it's the commercial friction. Navigating a maze of separate SKUs, unpredictable usage pricing, and commercial add-ons for emerging capabilities like AI agents makes it difficult and costly for platform leaders to standardize on a single platform.

Splunk Observability Cloud Essentials and Premier Editions solve this by dramatically simplifying how organizations buy, adopt, and expand observability across their entire enterprise:

To remove the commercial fear of runaway data costs as you expand, both editions include Observability Logs with tiered storage ($0.60-$0.85 per GB/day). Recent logs stay readily searchable in high-performance storage for live incident troubleshooting, while older logs automatically transition to lower-cost storage where they remain fully queryable. Inside Log Explorer, teams can investigate logs, metrics, and traces side-by-side using point-and-click filters, natural language prompts, or standard SPL-giving teams the freedom to scale telemetry without surprise overages.

simplified-1.png

Availability: Splunk Observability Cloud Essentials and Premier Editions are planned to be generally available in early November 2026.

Optimize Tokenomics

As enterprises scale generative AI applications on Amazon Web Services, managing the cost and performance of foundation models has quickly become a top operational headache. Building on the Agent Observability innovations introduced at .conf, Tokenomics will soon be available on the AWS Marketplace to provide comprehensive cost governance and performance tracking, giving organizations running AWS-hosted agents a unified way to monitor each agent by its cost and business results.

By pulling telemetry from Amazon Bedrock and CloudWatch, Tokenomics connects raw agent spend directly to business KPIs like NPS and transaction costs to show engineering teams exactly which AWS agents earn their budget, turning opaque token spend into defensible, executive-ready ROI.

Additionally, Tokenomics brings further enhancements, including provider cost settings in Splunk Agent Observability, and availability within Cisco Cloud Control.

simplified-2.jpg

Availability: Tokenomics is in preview starting December 2026 this month, with general availability on AWS Marketplace in early 2027. Provider cost settings in Splunk Agent Observability, and availability Tokenomics in Cisco Cloud Control will be generally available in Tokenomics in November 2026.

Monitor Agent Behavior

Splunk Agent Observability expands its capabilities to observe, evaluate, and guardrail with the new Evaluation Engine, giving teams new ways to verify agent behavior and enforce their own rules. Inside the Evaluation Engine you’ll find the new Eval-G1 Evaluation Models and Evaluation Tuner.

Eval-G1 Evaluation Models evaluate prompts and agent responses inline, before they reach a user or trigger an autonomous action. The new models return evaluations in about 100 milliseconds at 2.5 times faster than traditional large-language-model judges, with 95% benchmark accuracy. This makes it affordable to evaluate 100% of your production traffic for hallucinations, prompt injections, data leakage, and policy violations while drastically reducing the compute cost of continuous production evaluation.

simplified-3.png

Evaluation Tuner is the workspace where you create and fine-tune evaluator models from your traces and expert feedback in a few clicks. It gives product managers, application owners, and SREs a visual, no-code workspace for creating custom agent checks. Teams can write evaluation criteria in plain language, test them against historical production interactions, adjust sensitivity thresholds with visual sliders, and deploy approved guardrails directly to live workflows. This allows teams to apply their own brand, safety, and compliance rules without building custom Python scripts or machine-learning pipelines.

simplified-4.png

Together, the new Eval-G1 Evaluation Models and Evaluation Tuner help teams evaluate agent behavior as it happens and apply guardrails that reflect their exact business requirements.

Availability: Eval-G1 Evaluation Models and Evaluation Tuner are planned to be generally available in November 2026.

A Clearer Path to Optimizing AI at Scale

For the engineering and platform teams running AI in production, the questions are concrete: Are applications healthy? What is driving AI spend? Are autonomous agents following the rules we set for them?

At Cisco Live Melbourne and KubeCon NA in Salt Lake City, Splunk is adding new ways to evaluate agent behavior, create custom guardrails, manage AI spend, and connect it to business value. We invite you to stop by our booths at Cisco Live and KubeCon (booth #105) for more information on these innovations.

Get Observability Cloud for free or book a demo to see how Splunk can help maximize infrastructure resilience, monitor agent behavior, optimize Tokenomics, and troubleshoot autonomously.

Related Articles

Detecting Ryuk Using Splunk Attack Range
Security
6 Minute Read

Detecting Ryuk Using Splunk Attack Range

A new alert, Ransomware Activity Targeting the Healthcare and Public Health Sector, issued by the CISA poses ongoing and possible imminent attacks against the healthcare sector. Learn how you can detect the Ryuk ransomware as payload with Splunk Attack Range.
Active Directory Discovery Detection: Threat Research Release, September 2021
Security
15 Minute Read

Active Directory Discovery Detection: Threat Research Release, September 2021

In this blog post, we’ll walk you through this analytic story, demonstrate how we can simulate these attacks using PoshC2 & PurpleSharp to then collect and analyze the resulting telemetry to test our detections.
CosmicSting: A Critical XXE Vulnerability in Adobe Commerce and Magento (CVE-2024-34102)
Security
10 Minute Read

CosmicSting: A Critical XXE Vulnerability in Adobe Commerce and Magento (CVE-2024-34102)

The Splunk Research Team dissects the technical intricacies of the CosmicSting vulnerability, explores its potential impact on affected systems, and provides detection opportunities and mitigation strategies.