Warehouse: https://files.pythonhosted.org returns "504 Gateway Time-out" for many source files

[sunpoet]

Take https://pypi.org/project/esda/ for example.
The download link https://files.pythonhosted.org/packages/3e/84/bff39fdd34fc7f2dd3e0a1b7a6b92cea8ca17ce0ab9359a96ed301947cd6/esda-2.0.0.tar.gz on PyPI page is fetchable.
But the predictable link used in FreeBSD ports is https://files.pythonhosted.org/packages/source/e/esda/esda-2.0.0.tar.gz which is unfetchable (504 gateway timeout).
Not all of them are unreachable but it's around 80% failure to me.

My Platform

Tested on FreeBSD and Chrome (macOS).

Network telemetry

DNS Resolution

dig files.pythonhosted.org A
files.pythonhosted.org. 6   IN  CNAME   dualstack.r.ssl.global.fastly.net.
dualstack.r.ssl.global.fastly.net. 29 IN A  151.101.193.63
dualstack.r.ssl.global.fastly.net. 29 IN A  151.101.1.63
dualstack.r.ssl.global.fastly.net. 29 IN A  151.101.65.63
dualstack.r.ssl.global.fastly.net. 29 IN A  151.101.129.63

dig files.pythonhosted.org AAAA
files.pythonhosted.org. 28  IN  CNAME   dualstack.r.ssl.global.fastly.net.
dualstack.r.ssl.global.fastly.net. 29 IN AAAA   2a04:4e42::319
dualstack.r.ssl.global.fastly.net. 29 IN AAAA   2a04:4e42:200::319
dualstack.r.ssl.global.fastly.net. 29 IN AAAA   2a04:4e42:400::319
dualstack.r.ssl.global.fastly.net. 29 IN AAAA   2a04:4e42:600::319

[yan12125]

Seems fixed. https://files.pythonhosted.org/packages/source/e/esda/esda-2.0.0.tar.gz can be downloaded now. Another package https://files.pythonhosted.org/packages/source/n/nvchecker/nvchecker-1.4.tar.gz is broken yesterday, and it's also fixed today.

[sunpoet]

Confirmed. All the failed downloads are OK now.

[ncopa]

This issue seems to have reappeared. https://files.pythonhosted.org/packages/source/s/sgmllib3k/sgmllib3k-1.0.0.tar.gz gives 504.

[ncopa]

this too: https://files.pythonhosted.org/packages/source/n/netaddr/netaddr-0.7.19.tar.gz

[maxwell-k]

I am also seeing the same issue from a completely unconnected client; on both the above URLs and for example: https://files.pythonhosted.org/packages/source/p/pygit2/pygit2-0.28.0.tar.gz

[ncopa]

another: https://files.pythonhosted.org/packages/source/a/awake/awake-1.0.tar.gz

[jamadden]

Thanks. I'm able to reproduce this locally too. I've pinged the infrastructure team.

[horta]

Same problem here. I can't make the following urls work consistently:

• https://pypi.io/packages/source/l/limix-plot/limix-plot-0.1.0.tar.gz
• https://pypi.org/packages/source/l/limix-plot/limix-plot-0.1.0.tar.gz
• https://files.pythonhosted.org/packages/source/l/limix-plot/limix-plot-0.1.0.tar.gz

[sunpoet]

It seems to be solved now. I could download all the following files:

• https://files.pythonhosted.org/packages/source/s/sgmllib3k/sgmllib3k-1.0.0.tar.gz
• https://files.pythonhosted.org/packages/source/n/netaddr/netaddr-0.7.19.tar.gz
• https://files.pythonhosted.org/packages/source/p/pygit2/pygit2-0.28.0.tar.gz
• https://files.pythonhosted.org/packages/source/a/awake/awake-1.0.tar.gz
• https://pypi.io/packages/source/l/limix-plot/limix-plot-0.1.0.tar.gz
• https://pypi.org/packages/source/l/limix-plot/limix-plot-0.1.0.tar.gz
• https://files.pythonhosted.org/packages/source/l/limix-plot/limix-plot-0.1.0.tar.gz

[jamadden]

Thanks for the reports. The infrastructure team identified the issue and corrected it, and is taking steps to prevent it from occurring again.

[mickours]

Hi!
This is happening again. These two packages leads to 504 errors.

• https://files.pythonhosted.org/packages/source/k/kubernetes_asyncio/kubernetes_asyncio-9.0.0.tar.gz
• https://files.pythonhosted.org/packages/source/k/kubernetes_asyncio/kubernetes_asyncio-10.0.0.tar.gz

Since a few minutes they are back but this one is failing:

• https://files.pythonhosted.org/packages/source/m/marshmallow/marshmallow-3.0.1.tar.gz

It seems that the problem is not completely fixed.

[jamadden]

Hi @mickours I'm not able to reproduce that. If you continue to see this, please open a new issue in https://github.com/pypa/pypi-support. (cf #7070)

[mickours]

Yes, this was a transient failure, it comes back a few minutes later...