Node-rdkafka: Feature Request - Support for Message Headers

Created on 8 May 2018  路  9Comments  路  Source: Blizzard/node-rdkafka

The underlying library has support for kafka message headers: https://github.com/edenhill/librdkafka/pull/1480.

It would be nice if you could expose the headers to the node library for both consumers and producers. We are looking at using them to store event metadata which we can use to debug issues in the case where our avro messages cannot be deserialised properly.

Thank you.

enhancement help wanted

Most helpful comment

Updates to the PR have been made with the new merged changes

All 9 comments

It is definitely something I want to add. I can't tell when I will have time right now to dedicate to it because of how my time at the office has had to be spent, but it is on my radar.

Hopefully I will have some time soon but will also be very, very happy to take a contribution for this.

@webmakersteve what's necessary to make this happen? I could try to take a look at it, but the codebase is pretty foreign to me

Looks like message headers are not supported in C++ yet, and the underlying bindings use the C++ version of librdkafka.

It looks like the C++ library has a PR added support for headers 7 days ago:

https://github.com/edenhill/librdkafka/pull/2109

https://github.com/edenhill/librdkafka/pull/1959

Please! This would be a great feature!

I have this PR open https://github.com/Blizzard/node-rdkafka/pull/478 needs a few changes once the librdkafka changes are merged but it should follow it mostly.

Updates to the PR have been made with the new merged changes

馃憤

This is resolved with 6065784faea0585d00c5196adb2f20cfd220f517

Was this page helpful?
0 / 5 - 0 ratings