DEV Community

Cover image for Demystifying Log Collection in Cloud-Native Applications on Kubernetes
Cloud Native Engineer
Cloud Native Engineer

Posted on

Demystifying Log Collection in Cloud-Native Applications on Kubernetes

๐Ÿšข My latest newsletter episode "Demystifying Log Collection in Cloud-Native Applications on Kubernetes"

Episode #36: A DevOps Engineerโ€™s Guide to Aggregating Distributed Logs with Kubernetes and Elastic Tools.

  • ๐Ÿ–ฅ๏ธ DevOps Engineer Perspective: Exploring log collection from a DevOps viewpoint, aggregating logs from distributed sources into a single log analysis tool, like Elasticsearch

  • ๐ŸŒ Common challenges on Distributed Log Collection: log rotation, retry logic, in-memory buffers, async logging, and more.

  • ๐Ÿ› ๏ธ Kubernetes Logging Mechanisms: how Kubernetes gathers and makes container logs available to log collection agents.

  • ๐Ÿ•ธ๏ธ Nginx's logs in Kubernetes: how the modify Nginx container image to work in Kubernetes

  • ๐Ÿ”ง Node logging agent architecture: offload log collection to an external agent

  • ๐ŸชตSome common logging agents: Elastic agent, Elastic Beats, Otel collector

๐Ÿ‘‰ Read the full article https://open.substack.com/pub/cloudnativeengineer/p/log-collection-in-kubernetes

Top comments (0)