Cheerio: Can't reach anything under noscript tag

Created on 5 Nov 2017 · 6Comments · Source: cheeriojs/cheerio

I've got cheerio.load(pageContent, { decodeEntities: false }), but then when I try to match an element that's under a noscript tag it doesn't work. I thought setting decodeEntities to false would allow this. How do I match that element?

Source

rightaway

👍4

Most helpful comment

try cheerio.load(pageContent, [ xmlMode: true});

enricopolanski on 2 Dec 2017

👍5

All 6 comments

try cheerio.load(pageContent, [ xmlMode: true});

enricopolanski on 2 Dec 2017

👍5

I'm seeing this too. This should not have been closed.

monkeysuffrage on 14 Mar 2018

Enabling xml mode fixes this, otherwise parse5 will always strip noscript tags.

fb55 on 14 Mar 2018

Right, but it's still an issue, right? It should stay open until it gets resolved.

monkeysuffrage on 15 Mar 2018

👍2

Try to match the noscript tag itself, get the html by calling .html() and then load that html with cheerio again. That way you'll be able to match any element under the noscript tag.

mitin001 on 18 Jul 2018

This is definitely still a bug with cheerio, as cheerio is essentially a browser without JavaScript support. The noscript tag is intended to provide content for browsers that do not support javascript (which would include search engines, web crawlers, and web scrapers).

"xmlMode: true" has several other side effects (see documentation) which can cause most pages, and especially those in question to fail to parse.