Chocolatey-coreteampackages: Many embedded packages updated with latency due to push errors

[mstick99]

Issue reused and edited by @majkinetor since it was not filled

---

Many larger embedded packages - which type is majority here - can and will fail to push to gallery until the upstream problem chocolatey/chocolatey.org#613 is fixed.

Report sample

The error is:

Attempting to push <package_name>.nupkg to https://push.chocolatey.org 
There was an internal server error, which might mean the package already exists on a Simple OData Server.

Packages from this repo being afected at this time:

• calibre
• chromium
• cmake.portable
• docker-kitematic
• keeweb
• php
• python3
• sweet-home-3d
• waterfox

[AdmiringWorm]

We're aware of the new version of Waterfox. Unfortunately the following issue is preventing the update: https://github.com/chocolatey/chocolatey.org/issues/613

[majkinetor]

We currently have bunch of packages with errors and this will only go up, and almost never down based on my tests. Repeats and ignores on updateall do not help at all.

/cc @ferventcoder @gep13

[majkinetor]

So what is the status with this ? Does it still happen ? I didn't notice errors recently maybe, out of memory few times.

/cc @gep13 @AdmiringWorm @mkevenaar

[gep13]

@majkinetor the changes that were made to chocolatey.org have definitely helped the situation, but I am not going to say that everything has been fixed.

Until we make changes to the actual physical infrastructure behind chocolatey.org there won't be much else that we can do though.

[majkinetor]

Its definite that problem isn't fixed based on AU reports since you introduced a change.
It occurs several times less then before and with different errors but still occurs in non-ignorable quantity.

The change at least makes it more tolerable.

[gep13]

@majkinetor there is still some infrastructure work pending for chocolatey.org that needs to be done before we can make anymore changes in this area. I currently don't know when that work is due to be completed, but I will let you know as soon as I know.

[majkinetor]

I added '_package version already exists on the repository_' to my AU options in repeat/ignore section and it works in preventing errors which may be annoying as there is nothing we can do.

[majkinetor]

Bunch of packages still randomly fail. Only larger packages are prone to this and are currently ignored by AU. All will eventually be published.

[ExE-Boss]

And once again “qBittorrent” failed to be pushed:

Ignored

|Icon|Name|NuspecVersion|IgnoreMessage|
|---|---|---|---|
||qbittorrent|4.2.0|AU ignored on: System.Management.Automation.RuntimeException: Chocolatey v0.10.15 Attempting to push qbittorrent.4.2.0.nupkg to https://push.chocolatey.org An error has occurred. It's possible the package version already exists on the repository.|

[majkinetor]

There are litterrary hundreeds of packages failing.

[majkinetor]

This is literray almost 2 years not solved ...

[ferventcoder]

Howdy folks! Apologies that we've had trouble identifying and fixing this. A lot of the work we've done around this feels like whack-a-mole and I appreciate that you've stuck with us while we've continued to work to resolve these issues.

That said, as mentioned over at https://github.com/chocolatey/chocolatey.org/issues/613, we've made some changes recently that may have went a long way into fixing the issues with pushing packages. Can I ask that if you see any issues with this, please comment on that issue so we can work to investigate them in near term?

[majkinetor]

I will close this as it doesn't seem to happen anymore.

[gep13]

@majkinetor thanks for following up with this! Do you know when the last time this happened from this repository was?

[majkinetor]

You could browse trhough history easily. Quickly searching it found many around month ago, for example 05-01

[AdmiringWorm]

@majkinetor the error in that report is for a different issue, which usually doesn't prevent the package from showing up on the website.

@gep13 the latest time the error seemed to happen was four days ago (the chromium package): https://gist.github.com/choco-bot/a14b1e5bfaf70839b338eb1ab7f8226f/bf09e720bc20daea24728b2324d3b0bb3d3e57bb

[majkinetor]

Good catch @AdmiringWorm, seems I closed this prematurelly.

[gep13]

@majkinetor am I right in saying that you haven't seen any further instances of Out of Memory exceptions, or other errors, when pushing packages to chocolatey.org?

[majkinetor]

Yah, fix looks legit so far 👍

[gep13]

@majkinetor said...
Yah, fix looks legit so far 👍

That is great news!