Redisearch: support chinese now?

[yansuihehe]

[dvirsky]

I'd really like to add it but I need help from someone fluent in Chinese. Can you point me at good Chinese toeknization libraries?

[tairitian]

Do you mean this?
https://raw.githubusercontent.com/fxsjy/jieba/master/extra_dict/dict.txt.big

@dvirsky

[dvirsky]

@blm-fu that would be a good start, but you also need a tokenizer that will work on the text with it.

[lufeng4828]

nice project !!! but waiting for Chinese support also

There is a Chinese Words Segementation ,maybe can help:
c:https://github.com/yanyiwu/cjieba
c++:https://github.com/yanyiwu/cppjieba

[dvirsky]

We now have issue #206 so I'm closing this.

@lufeng4828 @blm-fu @yansuihehe once this is implemented we'd really appreciate your feedback in trying this out and making sure it works as expected.