Puppeteer-extra: Anybody noticing increased detection rate recently?

[AdityaAnand1]

For e.g: I'm getting detected instantly on owler.com/company/chevron

Started happening about a week ago only.

[phpmoli]

yep, stopped working at patreon.com too

[AdityaAnand1]

Looks like cloudflare rolled out something targeted at detecting pupeteer instances somehow.

Any ideas @berstend?

Time to be the mouse again 😅 and try to one up the cat.

[vanilataher]

The problem is the source code in this repository is open to public and people from cloudflare can easily see it. So far cloudflare+hcaptcha works well. 🤔

[pg1671]

This site as well is being detected, looks like it is cloudflare as well. Just upgraded to latest puppeteer and latest stealth plugin (2.6.0) and still being detected.
https://www.apollo.io/companies/Gat-Beer/59bba689a6da98c2c77520c4

[berstend]

There's a big update coming tomorrow that might help with this :-)

[berstend]

Currently every headless browser can be detected with Array.isArray(navigator.plugins) (or the absence of navigator.plugins). I finished a complete rewrite of navigator.plugins & navigator.mimeTypes today that does a fully functional and native appearing mock of these properties. 😄

AFAIR that's a check CF is doing.

Need to clean up some docs and will push (and publish) this tomorrow.

[berstend]

The problem is the source code in this repository is open to public and people from cloudflare can easily see it. So far cloudflare+hcaptcha works well. 🤔

On the bright side: It forces us to build clean solutions over time, rather than just quick patches 😄 We're definitely entering the next stage of this cat & mouse game where implementation details are much more important.

[berstend]

We've made some massive updates (#291, #292, #297) which should fix the Cloudflare issues, please check with [email protected] and report here if there are more Cloudflare specific issues (ideally with the JS they're using).

[entrptaher]

That sounds super exciting, gonna test. :D