Fluent-bit: filter_kubernetes: filter based on specific namespaces

[edsiper]

Fluent Bit Kubernetes filter should provide a way to allow process or skip certain records coming from specific namespaces.

[okgolove]

Any progress here?

[dguendisch]

While a direct exclusion filter on namespaces in the k8s filter would be nice, I think the more meaningful approach is to support filtering on nested fields #483.
That would be way more generic and support a lot more use cases like filtering on labels, pod names, container names, whatever fields augmented by whatever plugin running before a grep exclude filter.

[rverma-nikiai]

Vendor runs multiple components in Kube-system namespace and maintaining their logs is usually not required. I suggest using the K8S-Logging.Exclude label on namespace to disable logging on that namespace.

[edsiper]

Current workaround:

• Set INPUT as _routable off_ , so data only hit the stream processor
• In the stream processor create a new stream like:

CREATE STREAM kube WITH(tag='kube-processed') FROM STREAM:tail-kubernetes WHERE kubernetes['namespace'] = 'something';