Your Data, Your Choice: Expanding Log Ingestion Options with OpenTelemetry

Platform Courtney Gannon

Key takeaways

  1. Splunk now supports native log ingestion through the OpenTelemetry Collector, making it easier for customers to use modern open standards with the Splunk platform.
  2. This lets organizations use one agent for logs, metrics, and traces instead of multiple tools, simplifying setup and ongoing management.
  3. By adopting an open, vendor-neutral standard, customers gain more flexibility, stronger compatibility, and can focus more on insights than infrastructure.

In the evolving landscape of modern IT, OpenTelemetry (OTel) has emerged as the gold standard for collecting traces, metrics, and logs. While the industry has moved rapidly toward these open-source standards, customers have found themselves at a crossroads when trying to integrate these standards with their existing Splunk platform.

The Challenge: Fragmented Data Ingestion

For some enterprise customers, the journey to full OpenTelemetry adoption has been met with a significant hurdle. Until now, Splunk’s support for sending data from the OpenTelemetry Collector to the Splunk Platform was largely limited to specific Kubernetes use cases.

This limitation created a fragmented experience. Customers often had to manage different agents for different environments, leading to increased architectural complexity and a lack of consistency across their observability pipeline. Despite these hurdles, the demand for OTel is undeniable—in fact, some Splunk Cloud customers have already started to adopt OpenTelemetry for logs ingestion on their own.

The Solution: Native Logs Ingestion via the OpenTelemetry Collector

To meet growing demand and simplify the user experience, we are excited to launch native logs Ingestion via the Splunk Distribution of the OpenTelemetry Collector for Splunk Platform via OTLP ingestion.

By providing full support for the OpenTelemetry Collector for log ingestion, Splunk is enabling a unified, standard agent for all environments and deployment models. This feature aligns Splunk’s offerings with global industry standards and provides a single path for data, regardless of whether your infrastructure is on-premise or in the cloud.

How This Benefits Splunk Customers

For those customers that are working to standardize on OpenTelemetry, the shift to native logs ingestion offers three primary advantages for your organization:

1. Industry Standardization and Future-Proofing

Interoperability: OTLP is an open, vendor-neutral protocol. This ensures seamless integration with modern observability tools and ecosystems.

Reduced Vendor Lock-in: By adopting an open standard, you reduce the risk of being tied to a single vendor's proprietary agent, ensuring your architecture remains compatible with evolving best practices.

2. Unified and Simplified Data Collection

A Single Agent: You can now deploy the OpenTelemetry Collector as your primary agent, eliminating the need for additional agents like the Universal Forwarder. This significantly simplifies your system architecture.

Consistency: With one agent handling traces, metrics, and logs, your data collection becomes standardized, making deployment and ongoing management much easier for operations teams.

3. Enhanced Observability Features​

Field Extraction: Collector can pre-process logs, structuring data for downstream use (e.g., Splunk Enterprise Security), improving log analytics efficiency.​

Looking Ahead

Native OpenTelemetry log ingestion is more than just a technical update; it is a commitment to providing Splunk customers with the flexibility and standardization required for the modern era of observability. By simplifying the ingestion pipeline, we are helping you focus less on managing agents and more on gaining insights from your data.

If you want to download this and try it today you can find more information here.

Related Articles

Federated Analytics: Analyze Data Wherever It Resides for Rapid and Holistic Security Visibility
Security
6 Minute Read

Federated Analytics: Analyze Data Wherever It Resides for Rapid and Holistic Security Visibility

Federated Analytics is now generally available as a premium add-on feature for Splunk Cloud Platform and Splunk Enterprise Security.
Staff Picks for Splunk Security Reading April 2023
Security
5 Minute Read

Staff Picks for Splunk Security Reading April 2023

Hello, everyone! Welcome to the Splunk staff picks blog. Each month, Splunk security experts curate a list of presentations, whitepapers, and customer case studies that we feel are worth a read. We hope you enjoy.
Introducing… The Threat Hunter’s Cookbook!
Security
1 Minute Read

Introducing… The Threat Hunter’s Cookbook!

The security experts on the SURGe team have released The Threat Hunter’s Cookbook, a hands-on guide for security practitioners that features actionable insights into threat hunting methods, ready-to-use queries, and more.