Gallery-dl: deviantart download 404 error

[rawesomeawesome]

a newly common error i've encountered is that download links for deviations will redirect to a 404 error unless you refresh the page before clicking the download link... but there's no way to simulate or correct for this odd issue within gallery-dl, making it throw nothing but "[warning] '404 Not Found' for 'https://www.deviantart.com/download/[etc]" errors while failing to download any images i've tried everything including deleting browser cache, but the issue seems to somehow be on deviantart's side, requiring some extra step to access the 'true' download link.

steps to reproduce:

1. install gallery-dl in windows on any version of python or with the executable
2. add the config file with deviantart oauth for logging in
3. instruct gallery-dl to download a user's gallery
4. for extra testing, go into said user's gallery and attempt to download an image manually, getting a 404 error page from the download link until the deviation page has been refreshed, updating the download link to one that works. dl links thrown up by gallery-dl also result in said 404 page, reinforcing this connection.

[kattjevfel]

This is fixed in git master, either wait for a new release or upgrade to the latest dev version.
https://github.com/mikf/gallery-dl#pip

~ » gallery-dl https://www.deviantart.com/koniyo/gallery/
[deviantart][info] Requesting public access token
[downloader.http][warning] '404 Not Found' for 'https://www.deviantart.com/download/358476756/d5xfefo-c3a26c94-38c2-4fe0-99ab-a6e0861d5c7a.png?token=3454ed2b161f94381d2bbbf0f8e071b51f3f9caa&ts=1575028873'
[download][error] Failed to download progecto_portal_by_koniyo-d5xfefo.png
^C
KeyboardInterrupt
~ » gallery-dl --version                                 
1.11.1

~ » gallery-dl https://www.deviantart.com/koniyo/gallery/
/mnt/jupiter/Temp/gallery-dl/deviantart/Koniyo/progecto_portal_by_koniyo-d5xfefo.png
/mnt/jupiter/Temp/gallery-dl/deviantart/Koniyo/rostenkowskii_by_koniyo-d5xeuoa.png
^C
KeyboardInterrupt
~ » gallery-dl --version                                 
1.11.2-dev

[kattjevfel]

Even though this ticket only mentions full galleries, I think it's worth mentioning that I did get the same error for individual posts (full galleries work fine, downloaded their latest post that way instead)

~ » gallery-dl --verbose https://www.deviantart.com/shepherd0821/art/Modern-MoGal-092-Shape-821874285
[gallery-dl][debug] Version 1.11.2-dev
[gallery-dl][debug] Python 3.8.0 - Linux-5.4.0-arch1-1-fsync-x86_64-with-glibc2.2.5
[gallery-dl][debug] requests 2.22.0 - urllib3 1.25.7
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/shepherd0821/art/Modern-MoGal-092-Shape-821874285'
[gallery-dl][debug] Updating urllib3 ciphers
[deviantart][debug] Using custom API credentials (client-id 10218)
[deviantart][debug] Using DeviantartDeviationExtractor for 'https://www.deviantart.com/shepherd0821/art/Modern-MoGal-092-Shape-821874285'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /_napi/da-browse/shared_api/deviation/extended_fetch?deviationid=821874285&username=shepherd0821&type=art&include_session=false HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /download/821874285/ddlbm99-740e5af0-faad-4b0c-98e4-d0583bd3bc0b.jpg?token=874cdb91ee2876f59206b6382a45bfa4571062a6&ts=1575067218 HTTP/1.1" 404 None
[downloader.http][warning] '404 Not Found' for 'https://www.deviantart.com/download/821874285/ddlbm99-740e5af0-faad-4b0c-98e4-d0583bd3bc0b.jpg?token=874cdb91ee2876f59206b6382a45bfa4571062a6&ts=1575067218'
[download][error] Failed to download modern_mogal__092___shape_by_shepherd0821-ddlbm99.jpg

[mikf]

https://github.com/mikf/gallery-dl/issues/488#issuecomment-558851806