Confluent-kafka-dotnet: Kafka exchange with avro

Created on 20 Jul 2017  路  3Comments  路  Source: confluentinc/confluent-kafka-dotnet

Hello,
I want to use avro to post kafka messages.
I am currently sending text messages in json format.
The goal is to take this message json and publish it with avro.
Language used: c # 4.5.2
Kafka DLL used: 0.9.5
Are there any example or information that can help me to solve this problem?

thank you in advance

question

All 3 comments

I want to use avro to post kafka messages.

so do many people! @treziac is currently working on this and i'm going to help get it in as quickly as possible. I expect there to be a proof-of-concept PR you can cherry pick from quite soon.

you could also check out:
https://github.com/jakobz/schema-registry-dotnet

Hey @Duorman !
Haven't been able to work on it this week, but I should post a PR this we (I hope)

As a quick question, ho do you create the json to post?
As a first draw, I didn't plan to add a serializer which takes an avro json (I could add it, but the apache avro library in C# does not content a json encoder, would have to develop it first)

There are two target used for my PR:

  • Use auto-generated classes from an avro schema (using avrogen tool from apache)
  • Use GenericRecord from an avro schema (king of Dictionary)

would this meet your needs?

Also in the first version, not everything will be possible - the apache avro library will need to be improve a bit (like logicalType which is not supported yet, and only for classic netframework yet, have to propose to port the avro library to netstandard)

Avro support based on @treziac's work was added in 0.11.4.

Was this page helpful?
0 / 5 - 0 ratings