Azure-cli: Issue with ubuntu apt repo on Azure Pipelines hosted ubuntu-latest (xenial)

[lvlie]

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug
As of today I am receiving:

Get:37 https://packages.microsoft.com/repos/azure-cli xenial/main amd64 Packages [39.5 kB]
Err:37 https://packages.microsoft.com/repos/azure-cli xenial/main amd64 Packages
  Writing more data than expected (40278 > 39457)

When trying to install a random package on an "ubuntu-latest" Microsoft hosted Azure pipeline host (e.g. "sudo apt update && sudo apt install qemu"). Not sure if this is an issue with the repo or with the Azure pipeline host itself.

To Reproduce
sudo apt update && sudo apt install qemu (also after apt-get clean)

Expected behavior
Installing a package

Environment summary
apt using the official microsoft ubuntu repo (see above)

[h2floh]

Get the same error for xenial (16.04) and bionic (18.04) as well. There was an update to the packages just some hours ago, before it worked for me. If you look at the log, the InRelease file is older, seems something was not updated.

2020-01-07T08:19:51.2352748Z Get:1 https://packages.microsoft.com/repos/azure-cli bionic InRelease [3965 B]
2020-01-07T08:19:51.3268880Z Get:2 https://packages.microsoft.com/repos/azure-cli bionic/main amd64 Packages [7605 B]
2020-01-07T08:19:51.3275071Z Err:2 https://packages.microsoft.com/repos/azure-cli bionic/main amd64 Packages
2020-01-07T08:19:51.3275529Z   File has unexpected size (7772 != 7605). Mirror sync in progress? [IP: 13.75.127.55 443]
2020-01-07T08:19:51.3276004Z   Hashes of expected file:
2020-01-07T08:19:51.3276507Z    - Filesize:7605 [weak]
2020-01-07T08:19:51.3277343Z    - SHA512:c73d88b492e534460930e6c634d2c1a8b8e7397ae6504a5bbe43f061ec61fb2e280387dfea45c54b886aa9e8ead0b4d953aea3ee83e819d0254ea6470f3e7caa
2020-01-07T08:19:51.3278431Z    - SHA256:35e7475f1c5a179301354bf3d8f7ce28e2e8f4e8f722bcffeda7cdd948ead211
2020-01-07T08:19:51.3279095Z    - SHA1:8b89ee95b2def35d114a5c7a3c26646d9b2a841d [weak]
2020-01-07T08:19:51.3279708Z    - MD5Sum:59ec155e17e79af65f346ca52122d21b [weak]
2020-01-07T08:19:51.3280074Z   Release file created at: Wed, 18 Dec 2019 06:16:18 +0000
2020-01-07T08:19:51.6276628Z Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease
2020-01-07T08:19:51.8298078Z Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease
2020-01-07T08:19:51.8383245Z Hit:5 http://archive.ubuntu.com/ubuntu bionic-updates InRelease
2020-01-07T08:19:52.0495800Z Hit:6 http://archive.ubuntu.com/ubuntu bionic-backports InRelease
2020-01-07T08:19:52.1398649Z Fetched 3965 B in 1s (4246 B/s)
2020-01-07T08:19:53.1374204Z Reading package lists...
2020-01-07T08:19:53.1703011Z E: Failed to fetch https://packages.microsoft.com/repos/azure-cli/dists/bionic/main/binary-amd64/Packages.gz  File has unexpected size (7772 != 7605). Mirror sync in progress? [IP: 13.75.127.55 443]
2020-01-07T08:19:53.1705182Z    Hashes of expected file:
2020-01-07T08:19:53.1706357Z     - Filesize:7605 [weak]
2020-01-07T08:19:53.1707375Z     - SHA512:c73d88b492e534460930e6c634d2c1a8b8e7397ae6504a5bbe43f061ec61fb2e280387dfea45c54b886aa9e8ead0b4d953aea3ee83e819d0254ea6470f3e7caa
2020-01-07T08:19:53.1708413Z     - SHA256:35e7475f1c5a179301354bf3d8f7ce28e2e8f4e8f722bcffeda7cdd948ead211
2020-01-07T08:19:53.1709021Z     - SHA1:8b89ee95b2def35d114a5c7a3c26646d9b2a841d [weak]
2020-01-07T08:19:53.1709575Z     - MD5Sum:59ec155e17e79af65f346ca52122d21b [weak]
2020-01-07T08:19:53.1709918Z    Release file created at: Wed, 18 Dec 2019 06:16:18 +0000
2020-01-07T08:19:53.1710204Z E: Some index files failed to download. They have been ignored, or old ones used instead.
2020-01-07T08:19:53.3795388Z The command '/bin/sh -c curl -sL https://aka.ms/InstallAzureCLIDeb | bash -' returned a non-zero code: 100
2020-01-07T08:19:53.3869299Z ##[error]The command '/bin/sh -c curl -sL https://aka.ms/InstallAzureCLIDeb | bash -' returned a non-zero code: 100
2020-01-07T08:19:53.3880475Z ##[error]/usr/bin/docker failed with return code: 100
2020-01-07T08:19:53.3914739Z ##[section]Finishing: Build an image

[bim-msft]

@fengzhou-msft Please take a look.

[K-Visscher]

We're also having the same error over here on xenial (16.04)

2020-01-07T08:25:44.9161012Z Err:61 https://packages.microsoft.com/repos/azure-cli xenial/main amd64 Packages
2020-01-07T08:25:44.9161683Z   Writing more data than expected (40278 > 39457)
2020-01-07T08:25:51.4358553Z E: Failed to fetch https://packages.microsoft.com/repos/azure-cli/dists/xenial/main/binary-amd64/Packages  Writing more data than expected (40278 > 39457)
2020-01-07T08:25:51.4360631Z E: Some index files failed to download. They have been ignored, or old ones used instead.

[baruchiro]

Same in my Github Action:

https://github.com/baruchiro/israeli-bank-scrapers-desktop/runs/377085755#step:4:39

[prashantbhutani90]

Seeing the same in my project.

[fengzhou-msft]

We'are contacting internal teams to resolve this issue. Please download the package and install it locally for temp fix:

$curl -O https://packages.microsoft.com/repos/azure-cli/pool/main/a/azure-cli/azure-cli_2.0.79-1~xenial_all.deb
$apt install ./azure-cli_2.0.79-1~xenial_all.deb 

[fengzhou-msft]

The repo gets updated correctly and it should work now.

[baruchiro]

The repo gets updated correctly and it should work now.

Still failed:

https://github.com/baruchiro/israeli-bank-scrapers-desktop/runs/377185914#step:4:43

[fengzhou-msft]

The repo gets updated correctly and it should work now.

Still failed:

https://github.com/baruchiro/israeli-bank-scrapers-desktop/runs/377185914#step:4:43

bionic is also fixed. Please try again.

[lvlie]

Confirmed for xenial at least. I assume you will also fix the root cause to prevent further occurrences, but thats not for this issue of course 👍

Thanks for the help!