Telegraf: Logstash queue parser fail with Logstash 7

[ktibi]

Hello,

telegraf have a plugin for logstash.

The actual parser works for losgstash 6 but the format had change during the release 7.

Before 7 :

      "queue": {
        "events": 103,
        "type": "persisted",
        "capacity": {
          "queue_size_in_bytes": 1872391,
          "page_capacity_in_bytes": 67108864,
          "max_queue_size_in_bytes": 1073741824,
          "max_unread_events": 0
        },

After 7 :

      "queue" : {
        "type" : "persisted",
        "events_count" : 0,
        "queue_size_in_bytes" : 37677344,
        "max_queue_size_in_bytes" : 6442450944
      },

We need to change the structure of data in the plugin.

[danielnelson]

Would you be able to collect the output of a few curl commands, this will help us update the test cases:

http://127.0.0.1:9600/_node/stats/jvm
http://127.0.0.1:9600/_node/stats/process
http://127.0.0.1:9600/_node/stats/pipelines
http://127.0.0.1:9600/_node/stats/pipeline

[ktibi]

Hello @danielnelson

https://gist.github.com/ktibi/7ca84e0d22ff053578b3881ce671da43

[olddanmer]

I've faced with the same issue. Telegraf's logstash plugin can't parse

      "queue" : {
        "type" : "persisted",
        "events_count" : 2729970,
        "queue_size_in_bytes" : 3265998654,
        "max_queue_size_in_bytes" : 26843545600

[kcy1019]

I am having the same issue as @olddanmer. If its priority is low, then can I work on it? @danielnelson

[ktibi]

@kcy1019 Do you have plan for work on it ?