Kafka-node: Add Timestamp to Producer Payload

Created on 10 Oct 2016  路  5Comments  路  Source: SOHU-Co/kafka-node

hey @hyperlink,

great packages. much appreciated.
Do you have plans to integrate the new timestamp feature into the producer payload anytime soon?
https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index

would be great to have.
thanks again for your efforts. cheers.

PRs Welcome enhancement producer

Most helpful comment

Realize there's other work need doing, but would like to see timestamp producer support so that this works seamlessly with a Kafka Stream consumer.

All 5 comments

Hello! Thanks for your kind words.

My focus now is to get the new consumer group released and fixing any issues related to it. I have no plan to work on this feature at the moment but don't let that stop you from implementing it. I welcome new contributions to this module. My overall goal is to try to move this module past the kafka 0.8 world it has languished in. 馃憤

Realize there's other work need doing, but would like to see timestamp producer support so that this works seamlessly with a Kafka Stream consumer.

Hi,
I have implemented it, but it requires deeper changes within code. I'm not sure how backward compatibility is solved? @hyperlink Can you please give some guidance?

@Maleandr looks like timestamp was added in 0.10 which means if you get a response from ApiVersionsRequest then it you should be good.

It could be tricky because a request should be made for each connect event and the result kept for that connection since each socket/broker may not always be on the same version (upgrade or rolling back). The client should be able to handle these scenarios.

If you want to throw up a PR I could a look.

This enhancement seems to be added already, isn't it? Just wondering, why is it still open?

Was this page helpful?
0 / 5 - 0 ratings