KubeCon + CloudNativeCon San Diego | November 18 – 21 | Learn more

Cloud Native Logging with Fluentd: New Online Course Available on Linux Foundation Training

The Cloud Native Computing Foundation and The Linux Foundation have designed a new, self-paced and hands-on course to introduce individuals with a technical background to the Fluentd log forwarding and aggregation tool for use in cloud native logging. Available starting today, Cloud Native Logging with Fluentd will provide users with the necessary skills to deploy Fluentd in a wide range of production settings.

As large scale, distributed systems become increasingly prevalent, the challenges of managing logs has become acute. It is increasingly common to have thousands of nodes and tens of thousands of services all emitting data which needs to be attributed, normalized and aggregated i.e. “logged”. Known as the “unified logging layer”, Fluentd provides fast and efficient log transformation and enrichment, as well as aggregation and forwarding.

“This course will explore the full range of Fluentd features, from installing Fluentd and running it in a container, to using it as a simple log forwarder or a sophisticated log aggregator and processor,” said Eduardo Silva, Principal Engineer at Arm Treasure Data. “As we see the Fluentd project growing into a full ecosystem of third party integrations and components, we are thrilled that this course will be offered so more people can realize the benefits it provides.”

Upon course completion, developers will be able to:

  • Install and configure Fluentd in Cloud Native environments
  • Configure Fluentd to process log data from multiple inputs
  • Configure Fluentd to filter and transform data
  • Configure Fluentd to distribute log data to various backends
  • Configure Fluentd for high availability and high performance

Course Outline

  1. Introduction to Fluentd and Unified Logging
    1. Lab: Run Fluentd on Linux
    2. Lab: Run Fluentd Using the Docker Container Runtime
    3. Lab: Run Fluentd Using Kubernetes
  2. Fluentd Configuration
    1. Lab: Configuring Fluentd
  3. Extending Fluentd with Plugins
    1. Lab: Extending Fluentd with Plugins: Working with Input and Output Plugins
  4. Filtering Data and Creating Pipelines
    1. Lab: Extending Fluentd with Plugins: Working with Input and Output Plugins
  5. Parsing and Formatting Data
    1. Lab: Working with Parser and Formatter Plugins, and Processing Apache2 Log Data
  6. Effective Configurations Design Using Labels and Includes
    1. Lab: Organizing Complex Configurations by Working with Container Logs
  7. Multi-Instance Deployments with Fluentd
    1. Lab: Using Multiple Fluentd Instances, Configuring High Availability and Testing Failover in Fluentd
  8. Monitoring the Unified Logging Layer
    1. Lab: Monitoring Fluentd
  9. Debugging, Tuning and Securing Fluentd Configurations
    1. Lab: Debugging Fluentd Configurations and Creating Intermediate Configurations
  10. Introduction to Fluent Bit
    1. Lab: Fluent Bit with Fluentd

To take this course, some familiarity with logging and log management is helpful. Labs require a minimal Ubuntu 16.04 system with Docker installed (Lab 1.b. supplies Docker installation instructions).

Interested in this course? Please visit the course’s Linux Foundation Training page to get more detailed information.