Fluent-bit: [out_forward] implement gzip compression

[hanyijun]

Hi,
Does the latest version fluent-bit support forward gizp compression?
If not have,when will fluent-bit support to add it?

[edsiper]

Lastest development version on GIT master (not released) comes with gzip support for certain areas, at the moment is implemented in the HTTP output plugin and it will be added too to Forward output.

[hanyijun]

Thanks!

[davemt]

This issue was closed, but it does not seem like compression was ever added to Forward output (please correct me if I'm wrong). Should it be re-opened?

[edsiper]

yes, A misunderstanding, no gzip yet implemented. reopening.

[hafkaM]

Hello.
Is gzip support for forwarding (in-out) planned?
Similar to fluentd?
I need to transmit data compressed over a network.
We transfer large volumes of logs from IP television.
Approx. 750Mbit /s.
And without compression, throttling occurs on gig interfaces.
I need forwarding between flunetd and fluentbit with compression.
Best regards
Michal.

[hafkaM]

I could use Kafka on the output. Where compression can be turned on. But a consumer from Kafka is missing for fluentbit.

[hafkaM]

Hi.
Can we expect early implementation of gzip compression into the forwarding processor please?
And if so, do you know approximately a time horizon?
I am preparing a project where I would definitely need compression.
To consider any other alternatives if necessary.

Thank you for answer
Best regards
Michal.

[hafkaM]

Hello.
That's great news.
It will help me a lot.
Thank you.
Best regards.
M.

From: Eduardo Silva [e-mail]
Sent: Friday, November 20, 2020 7:05 PM
To: fluent/fluent-bit [e-mail]
Cc: Havelka Michal [e-mail]; Comment [e-mail]
Subject: Re: [fluent/fluent-bit] [out_forward] implement gzip compression (#1497)

Closed #1497https://github.com/fluent/fluent-bit/issues/1497 via #2773https://github.com/fluent/fluent-bit/pull/2773.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com/fluent/fluent-bit/issues/1497#event-4022149445, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ANEXMF3FVMQLZ5VII2YY3MDSQ2VVBANCNFSM4IJ55LNA.

[edsiper]

Implemented, it will be part of v1.6.5 release.