Log Management 101 Workshop Recap

Learn how to turn streaming log data into insights

June 4th, 2020

James Mountifield, Principle Solutions Architect EMEA, and log management engineer Tony Read reveal the value of logs in our Log Management 101 Workshop. Watch it on-demand to learn the basics of log management, and how to get started.

Watch on-demand: Log Management 101 Workshop

“Everything you’re likely to want to know about what is going on is contained in those logs.”

Logs are files that are a historical record of everything that happens within a system, including events worth investigation such as errors and intrusions. The most important part of a log’s anatomy is its timestamp – the exact time at which the event logged occurred. Along with that is other important information about what happened, like user information and port information. With this raw, unmodified information, modern log management tools like Humio can run fantastically complex queries to find out who did what within a system, or why a system experienced degradation in performance.

In this one-hour workshop, you’ll learn best practices for each of the four phases of log management, and you’ll pick up tips for how to observe patterns and find outliers.

The 5 Phases of Log Management

  1. Collect data from any machine data source.

  2. Format the data so it is standardized, consistent, and extensible.

  3. Route/transmit the data using log shippers into the log management tool.

  4. Receive the data into your log management tool.

  5. Answer questions and gain valuable insights.

"At Humio, we’re about taking all that data, ingesting it, and letting you run queries against it... at light speed."

Watch the workshop to learn:

  • What a log is

  • Why log management is important

  • How modern log management can collect and search hundreds of TB of logs every day - in real time

  • How to use logs to establish patterns and spot outliers

  • Best practices for getting started implementing a log management system

  • How any human-readable machine data is appropriate for collection

  • Why normalization of data can help with efficiency

  • The importance of platform-agnostic data shippers

  • When to implement a data streaming tool such as Kafka to receive data.

The workshop concludes with a practical demo that shows how to take a set of data from a period of time, determine normal limits, and then set up alerts to trigger if a system goes above or below those thresholds.

Watch the full Log Management 101 Workshop.

Sign up for the next live Quick Start Workshop.

Learn more

Watch Humio CTO Kresten Krab Thorup doing an overview of Humio: Video demo of Humio.

Learn more about the index-free architecture of Humio in this webinar: Humio CTO and founder Kresten Krab Thorup explains the benefits of Humio’s index-free architecture

Read about index-free logging: Index-Free Logging: Are Indexes Necessary, or Simply Overhead?

Listen to a podcast about how Humio uses time series databases: Time Series Databases with Kresten Krab Thorup