When running a high volume of data through kafka, using the standard consumer API, my service will eventually hit the "Local: No offset stored" error.
This only happens on version 2.7.0.
I have tested on version 2.5.1 and this issue does not occur.
I wonder if the cause could be similar to https://github.com/confluentinc/confluent-kafka-python/issues/71
Environment Information
Steps to Reproduce
node-rdkafka Configuration Settings
Additional context
Turns out this is an error on my part, closing issue, thanks for the great work team!
@jacob-bennett what was the error on your part?
We are running into this in production and I would love to know what the solution here was
@pranaygp @zenweasel It happens when commit is called without actually having anything to commit.
Turning on autocommit can help, or just making sure that commit is only called when something has been produced (and then ensuring that autocommit is actually switched off).
Most helpful comment
@jacob-bennett what was the error on your part?