Cloud-on-k8s: Logstash part of ECK

[a1exus]

Hello World!

I see deploying Elasticsearch, Kibana and even APM, but NOT Logstash.

So there is my feature request)

[idanmo]

/cc @agup006

[dbwest]

What's the status on this?

[wescran]

Would also like to know the status on this. Would be great to have.

[dmitryzykov]

+1 for Logstash as part of ECK

[wutkemtt]

+1 Would be really helpful having LogStash integrated in ECK.

[emanuelflp]

+1

[wutkemtt]

Is there a plan to release this feature in the next weeks ?

[agup006]

We do not have any updates on Logstash as part of ECK at this time. Today, ECK can manage ingest node as part of a deployment that can be used alongside beats

[bitgandtter]

Any insights on why logstash is not part of ECK? the ELK stack misses that important piece. There must be a really important reason to not put a priority on this. Can maintainers expose the reason for it?

[tumluliu]

Is there any update to this issue? The missing of logstash is the final blocker for me to deploy ECK

[iFreeon]

+1 on what is the product team reasoning for not including Logstash. Is there a better way to do import logs or some integration with Kube where we don't need it any more?

[kksudo]

+1

[xlanor]

+. Even a year later, logstash support is not a priority?

The closest I could find was this medium article, will be attempting it shortly
https://medium.com/@raphaeldelio/deploy-logstash-and-filebeat-on-kubernetes-with-eck-ssl-and-filebeat-d9f616737390

[wutkemtt]

To all who are looking for the logstash feature set in ECK:
Probably Ingest Pipelines is the missing feature. I realized this during the update to the latest version 7.8. Definition of pipelines is easy and can contain nearly all processors known from logstash. Just take a look in Kibana under Stack Management.

[xlanor]

@wutkemtt , I took a look at ingest pipelines, but I don't see rabbitmq support in there like logstash does. Did I miss it?

Either way, using that medium article works, but I had to modify ES url to http instead of https.

The templates provided in that article require some quick modification to get it deployed as a deployment instead of a pod.

[wutkemtt]

I just needed the processors, so I don't know about the RabbitMQ support, sorry.