Vector: Benchmark `simd_json` versus `serde_json` for encoding

Created on 26 Feb 2020  路  2Comments  路  Source: timberio/vector

https://github.com/simd-lite/simdjson-rs takes advantage of deeper hardware parallelization techniques to provide a faster serialization/deserialization.

A couple downsides is that it requires us to set some special compile flags since it requires special hardware instructions like avx2 https://github.com/simd-lite/simdjson-rs/blob/master/.cargo/config

codecs performance approval more demand enhancement

Most helpful comment

If you got questions about simd-json I'm glad to lend a hand

All 2 comments

Note that if we are ever going to provide pre-built Vector binaries with these AVX instructions, we shouldn't add -C target-cpu=native to the compiler flags, but rather set something like -C target-feature=+avx2.

The reason is that target-cpu=native would pick the CPU model used on the CI machine, which is generally not known to us.

If you got questions about simd-json I'm glad to lend a hand

Was this page helpful?
0 / 5 - 0 ratings

Related issues

binarylogic picture binarylogic  路  4Comments

trK54Ylmz picture trK54Ylmz  路  3Comments

LucioFranco picture LucioFranco  路  3Comments

valyala picture valyala  路  3Comments

leebenson picture leebenson  路  3Comments