Streetmerchant: ASUS returning error code 403

Created on 7 Oct 2020  路  5Comments  路  Source: jef/streetmerchant

Description


ASUS is returning a 403 when scraping their site.

Screen Shot 2020-10-06 at 4 41 01 PM

Mac OS Mojave 10.14.6

bug

Most helpful comment

This isn't a bug, those pages aren't being served from asus currently - they got tired of people scraping all day.

see below -

https://store.asus.com/us/item/202009AM160000001/

All 5 comments

You probably got banned. Go look at one of the URLs.

I'm getting 403 errors from Asus as well, from the very first request after launching the script for the first time. I'm able to navigate to their graphics card URLs through a browser from the same IP.

Update your USER_AGENT

This isn't a bug, those pages aren't being served from asus currently - they got tired of people scraping all day.

see below -

https://store.asus.com/us/item/202009AM160000001/

Thanks for the help @jxjftw. I can't test too well since I'm banned 馃槄

Was this page helpful?
0 / 5 - 0 ratings

Related issues

MrRobot245 picture MrRobot245  路  5Comments

AlphaOmega2020 picture AlphaOmega2020  路  4Comments

dochodges picture dochodges  路  5Comments

FawnPat picture FawnPat  路  4Comments

lngchn picture lngchn  路  3Comments