This setup installs a fluent-operator and fluent-bits (as daemonset) collecting containers logs and systemd logs for kubelet and containerd services running on the nodes.
It leverages the opentelemetry-envelope processor to pack the logs in otel format and adds additional attributes via lua scripting.
By default the fluent-operator deploys a pipeline with a predefined set of input, filter and output plugins. However the current version of the operator does not support, out of the box, the fluent-bit yaml configuration mode. The yaml configuration mode is required by the opentelemetry-envelope config.
This functionality is only exposed in YAML configuration and not in classic configuration mode due to the restriction of nested levels of configuration.
Thus this setup switches the configuration in yaml format by patching the ClusterFluentBitConfig resource and applies the required fluent-bit plugins.
This setup provides two fluent-bit pipelines.
- Tail Input -> Lua Filter -> Output OTLP