Confluent-kafka-go: How to implement redundant kafka logic

Created on 16 Jul 2020  路  1Comment  路  Source: confluentinc/confluent-kafka-go

Hello.

My team is implementing Kafka redundancy. I need to be able to switch between instances if one instance goes down.

Is there a feature in the library for this or I need to handle it programmatically?

Thanks

Most helpful comment

If you just mean failover between broker instances within a single cluster, that is standard behavior - recommend reading up on Kafka fundamentals. There's no real reason to have redundant clusters in the same data center. If you are looking for cross-dc redundancy, here's the current state of affairs: https://www.confluent.io/blog/multi-region-data-replication/ . The confluent go client supports fetch-from-follower.

>All comments

If you just mean failover between broker instances within a single cluster, that is standard behavior - recommend reading up on Kafka fundamentals. There's no real reason to have redundant clusters in the same data center. If you are looking for cross-dc redundancy, here's the current state of affairs: https://www.confluent.io/blog/multi-region-data-replication/ . The confluent go client supports fetch-from-follower.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

qrpike picture qrpike  路  3Comments

MikeSchlosser16 picture MikeSchlosser16  路  6Comments

pavelnikolov picture pavelnikolov  路  8Comments

artemyarulin picture artemyarulin  路  8Comments

binary132 picture binary132  路  10Comments