The underlying library has support for kafka message headers: https://github.com/edenhill/librdkafka/pull/1480.
It would be nice if you could expose the headers to the node library for both consumers and producers. We are looking at using them to store event metadata which we can use to debug issues in the case where our avro messages cannot be deserialised properly.
Thank you.
It is definitely something I want to add. I can't tell when I will have time right now to dedicate to it because of how my time at the office has had to be spent, but it is on my radar.
Hopefully I will have some time soon but will also be very, very happy to take a contribution for this.
@webmakersteve what's necessary to make this happen? I could try to take a look at it, but the codebase is pretty foreign to me
Looks like message headers are not supported in C++ yet, and the underlying bindings use the C++ version of librdkafka.
It looks like the C++ library has a PR added support for headers 7 days ago:
Please! This would be a great feature!
I have this PR open https://github.com/Blizzard/node-rdkafka/pull/478 needs a few changes once the librdkafka changes are merged but it should follow it mostly.
Updates to the PR have been made with the new merged changes
馃憤
This is resolved with 6065784faea0585d00c5196adb2f20cfd220f517
Most helpful comment
Updates to the PR have been made with the new merged changes