Splunk Hadoop Connect
Reliable Interoperability Between Splunk and Hadoop
Splunk Hadoop Connect provides bi-directional integration to easily and reliably move data between Splunk Enterprise and Hadoop. Deploy Splunk Enterprise quickly for real-time collection, indexing, analysis and visualizations and then reliably forward events to Hadoop for long-term archiving and additional batch analytics. You can further leverage Splunk Enterprise by importing data already stored in Hadoop. This makes it easy to stand up reliable, secure, enterprise-grade big data projects in days instead of months. Get Splunk Hadoop Connect.
Splunk Hadoop Connect delivers three core capabilities: Export, Explore, and Import.
- Export events collected and aggregated in Splunk Enterprise reliably to HDFS
- Explore and browse HDFS directories and files
- Import and index data from HDFS for secure searching, analysis and visualizations in Splunk Enterprise
Export Events to Hadoop
Use Splunk to collect and index massive streams of machine data in real-time. Then send all or a subset of events in a reliable and predictable way to HDFS for archiving, further processing or additional batch analytics. You can choose to pre-process data in Splunk, or export raw events.
Explore HDFS
Browse, navigate and inspect HDFS directories and files from the Splunk Hadoop Connect user interface before deciding to import them into Splunk.
Import Data from Hadoop
Import and index Hadoop data into Splunk to make it available for searching, reporting, analysis and visualizations and provide role-based access controls protection. Gain rapid insight and analysis without writing MapReduce code.