Cheerio: Chinese characters are converted to unicode

[rubyless]

before:

<a target="_blank" title="首页"></a>

after:

<a target="_blank" title="&#x9996;&#x9875;"></a>

How to solve this problem..

[fb55]

Why is this an issue?

[youxiachai]

@rubyless 首页 -> "首页" it is right .....

because it is utf8 html encoding ..

[rubyless]

@youxiachai but i still want it be a chinese character。

[fb55]

@rubyless The conversion is helpful when inserting arbitrary data to a page (note: It _does not_ prevent XSS). But at least you don't have to worry about character encodings.

Of course, it's helpful to obtain the original encoding while editing a document by hand. But as that shouldn't be a primary use-case of cheerio, I'm closing this.

[rubyless]

Thanks a lot

[ikitty]

@fb55
I found this problem too.
And when we edit some Chinese character in this file by hand (or others people read or edit these file ), It's unreadable with these unicode characters.

So, May I have a option to decide whether we need convert Chinese Character to Unicode ?

Thank you

[fb55]

Cheerio now recognizes the decodeEntities flag, setting it to false should
do the trick.

[yicone]

@fb55
The method has resolved my problem.

.pipe(cheerio({
    run: function($, file) {},
    parserOptions: {
        decodeEntities: false
    }
}))

Thank you