Buildx: Impossible to run git clone inside buildx with non x86 architecture
I don't know what to do anymore, I tried to change my desktop DNS, a bunch of docker node configurations, removed ipv6 from my router, my desktop, my interfaces, docker, updated buildx to the latest version, updates my kernel, docker.
Tried to disable HTTP, HTTPS and proxy under git configurations, everything appears to fail.
It works fine if I build without setting the platform, fail for both armv6 and armv7.
Any help would be much appreciated.
docker buildx inspect --bootstrap
Name: arm-builder
Driver: docker-container
Nodes:
Name: arm-builder0
Endpoint: unix:///var/run/docker.sock
Status: running
Flags: --allow-insecure-entitlement network.host --allow-insecure-entitlement security.insecure
Platforms: linux/arm/v6*, linux/amd64, linux/arm64, linux/386, linux/arm/v7
docker buildx version
github.com/docker/buildx .m
md5-8cbcc6693d13ba896d243e61fb59f2a2
docker --version
Docker version 20.10.3, build 48d30b5b32
md5-c255129c890d8e4f9b34aec4a091e339
docker buildx build --network=host --builder arm-builder --platform linux/arm/v6 . -t patrickelectric/test --push --output type=registry --progress=plain
md5-1f3fa95295cfd5d718a0dc4c045615f2
#8 170.5 + ping www.google.com -c 5
#8 170.6 PING www.google.com (172.217.172.132): 56 data bytes
#8 170.7 64 bytes from 172.217.172.132: icmp_seq=0 ttl=113 time=14.727 ms
#8 171.7 64 bytes from 172.217.172.132: icmp_seq=1 ttl=113 time=14.867 ms
#8 172.7 64 bytes from 172.217.172.132: icmp_seq=2 ttl=113 time=16.168 ms
#8 173.7 64 bytes from 172.217.172.132: icmp_seq=3 ttl=113 time=15.781 ms
#8 174.7 64 bytes from 172.217.172.132: icmp_seq=4 ttl=113 time=14.682 ms
#8 174.7 --- www.google.com ping statistics ---
#8 174.7 5 packets transmitted, 5 packets received, 0% packet loss
#8 174.7 round-trip min/avg/max/stddev = 14.682/15.245/16.168/0.611 ms
#8 174.7 + ping github.com -c 5
#8 174.8 PING github.com (140.82.114.3): 56 data bytes
#8 175.0 64 bytes from 140.82.114.3: icmp_seq=0 ttl=47 time=140.422 ms
#8 176.0 64 bytes from 140.82.114.3: icmp_seq=1 ttl=47 time=140.195 ms
#8 177.0 64 bytes from 140.82.114.3: icmp_seq=2 ttl=47 time=139.065 ms
#8 178.0 64 bytes from 140.82.114.3: icmp_seq=3 ttl=47 time=138.139 ms
#8 179.0 64 bytes from 140.82.114.3: icmp_seq=4 ttl=47 time=141.110 ms
#8 179.0 --- github.com ping statistics ---
#8 179.0 5 packets transmitted, 5 packets received, 0% packet loss
#8 179.0 round-trip min/avg/max/stddev = 138.139/139.786/141.110/1.054 ms
#8 179.0 + git clone -b 1.17.2 --single-branch --depth=1 [email protected]:GStreamer/gst-build.git
#8 179.1 Cloning into 'gst-build'...
#8 179.2 ssh: Could not resolve hostname github.com: Temporary failure in name resolution
#8 179.2 fatal: Could not read from remote repository.
#8 179.2
#8 179.2 Please make sure you have the correct access rights
#8 179.2 and the repository exists.
#8 ERROR: executor failed running [/bin/sh -c GST_VERSION=1.17.2 ./install_gst.sh && rm /install_gst.sh]: exit code: 128
md5-db85651bed8aec839c74f4aa2f69483a
#9 175.8 + ping www.google.com -c 5
#9 175.9 PING www.google.com (172.217.172.132): 56 data bytes
#9 175.9 64 bytes from 172.217.172.132: icmp_seq=0 ttl=113 time=16.296 ms
#9 176.9 64 bytes from 172.217.172.132: icmp_seq=1 ttl=113 time=14.696 ms
#9 177.9 64 bytes from 172.217.172.132: icmp_seq=2 ttl=113 time=13.564 ms
#9 178.9 64 bytes from 172.217.172.132: icmp_seq=3 ttl=113 time=16.361 ms
#9 179.9 64 bytes from 172.217.172.132: icmp_seq=4 ttl=113 time=15.264 ms
#9 179.9 --- www.google.com ping statistics ---
#9 179.9 5 packets transmitted, 5 packets received, 0% packet loss
#9 179.9 round-trip min/avg/max/stddev = 13.564/15.236/16.361/1.047 ms
#9 180.0 + ping github.com -c 5
#9 180.1 PING github.com (140.82.112.3): 56 data bytes
#9 180.3 64 bytes from 140.82.112.3: icmp_seq=0 ttl=46 time=136.187 ms
#9 181.3 64 bytes from 140.82.112.3: icmp_seq=1 ttl=46 time=134.629 ms
#9 182.3 64 bytes from 140.82.112.3: icmp_seq=2 ttl=46 time=134.015 ms
#9 183.3 64 bytes from 140.82.112.3: icmp_seq=3 ttl=46 time=132.351 ms
#9 184.3 64 bytes from 140.82.112.3: icmp_seq=4 ttl=46 time=135.359 ms
#9 184.3 --- github.com ping statistics ---
#9 184.3 5 packets transmitted, 5 packets received, 0% packet loss
#9 184.3 round-trip min/avg/max/stddev = 132.351/134.508/136.187/1.300 ms
#9 184.3 + git clone -b 1.17.2 --single-branch --depth=1 http://github.com/GStreamer/gst-build
#9 184.4 Cloning into 'gst-build'...
#9 184.6 fatal: unable to access 'http://github.com/GStreamer/gst-build/': Could not resolve host: github.com
#9 ERROR: executor failed running [/bin/sh -c GST_VERSION=1.17.2 ./install_gst.sh && rm /install_gst.sh]: exit code: 128
md5-9dd32515c73534d5549f09013bafef07
#9 173.3 + ping www.google.com -c 5
#9 173.4 PING www.google.com (172.217.30.100): 56 data bytes
#9 173.4 64 bytes from 172.217.30.100: icmp_seq=0 ttl=113 time=17.831 ms
#9 174.4 64 bytes from 172.217.30.100: icmp_seq=1 ttl=113 time=12.831 ms
#9 175.4 64 bytes from 172.217.30.100: icmp_seq=2 ttl=113 time=15.751 ms
#9 176.4 64 bytes from 172.217.30.100: icmp_seq=3 ttl=113 time=14.807 ms
#9 177.4 64 bytes from 172.217.30.100: icmp_seq=4 ttl=113 time=13.600 ms
#9 177.4 --- www.google.com ping statistics ---
#9 177.4 5 packets transmitted, 5 packets received, 0% packet loss
#9 177.4 round-trip min/avg/max/stddev = 12.831/14.964/17.831/1.748 ms
#9 177.4 + ping github.com -c 5
#9 177.5 PING github.com (140.82.114.4): 56 data bytes
#9 177.7 64 bytes from 140.82.114.4: icmp_seq=0 ttl=45 time=138.745 ms
#9 178.7 64 bytes from 140.82.114.4: icmp_seq=1 ttl=45 time=137.552 ms
#9 179.7 64 bytes from 140.82.114.4: icmp_seq=2 ttl=45 time=140.339 ms
#9 180.7 64 bytes from 140.82.114.4: icmp_seq=3 ttl=45 time=139.510 ms
#9 181.7 64 bytes from 140.82.114.4: icmp_seq=4 ttl=45 time=138.502 ms
#9 181.7 --- github.com ping statistics ---
#9 181.7 5 packets transmitted, 5 packets received, 0% packet loss
#9 181.7 round-trip min/avg/max/stddev = 137.552/138.930/140.339/0.942 ms
#9 181.7 + git clone -b 1.17.2 --single-branch --depth=1 git://anongit.freedesktop.org/gstreamer/gst-build
#9 181.7 Cloning into 'gst-build'...
#9 181.8 fatal: unable to look up anongit.freedesktop.org (port 9418) (Temporary failure in name resolution)
#9 ERROR: executor failed running [/bin/sh -c GST_VERSION=1.17.2 ./install_gst.sh && rm /install_gst.sh]: exit code: 128
patrickelectric
All 7 comments
I don't know if that helps, but I'm getting from dig:
#12 212.1 + dig github.com
#12 212.3 ../../../../lib/isc/unix/net.c:595: probing sendmsg() with IP_TOS=b8 failed: No buffer space available
#12 227.3
#12 227.3 ; <<>> DiG 9.11.5-P4-5.1+deb10u2-Debian <<>> github.com
It appears that the problem is qemu-arm-static 5.2.0, 5.1.2rc works fine.
Traceroute still fails, but git clone works.
I'll close the issue in a couple of days if no one has any necessary information for this issue.
patrickelectric
on 5 Feb 2021
I couldn't reproduce with cloning git clone -b 1.17.2 --single-branch --depth=1 http://github.com/GStreamer/gst-build with 5.2 qemu. Could you test with the qemu from https://github.com/tonistiigi/binfmt that is made for running containers.
Latest image is 5.0 atm, master tag is 5.2. Both work for me.
禄 docker run -it --rm --entrypoint /usr/bin/qemu-arm tonistiigi/binfmt:master --version
qemu-arm version 5.2.0 (v5.2.0)
Copyright (c) 2003-2020 Fabrice Bellard and the QEMU Project developers
禄 docker run -it --rm --entrypoint /usr/bin/qemu-arm tonistiigi/binfmt --version
qemu-arm version 5.0.0 (-dirty)
Copyright (c) 2003-2020 Fabrice Bellard and the QEMU Project developers
If you already have qemu installed make sure to uninstall it with https://github.com/tonistiigi/binfmt#uninstalling-emulators and then install with https://github.com/tonistiigi/binfmt#installing-emulators (but with master tag for 5.2).
tonistiigi
on 9 Feb 2021
Hi @tonistiigi, I did my test with arch-qemu-static from arch AUR repository.
@williangalvani was able to replicate the issue after he did a update to get the same version than I.
I'll try your repository when possible and see if it works with 5.2.
patrickelectric
on 10 Feb 2021
I'm having this exact issue, except it happens with all Docker containers (not just binfmt) and changing the version of qemu doesn't seem to help. I'm on Arch too, and also originally installed qemu-arm-static from the AUR. Perhaps an issue with Docker itself somehow, since it appears to happen with older versions of qemu which originally worked.
Vurich
on 16 Feb 2021
We have reverted qemu back to 5.0.1 https://github.com/docker/buildx/issues/542 in binfmt and in Docker Desktop. If you have a runnable reproducer please post it here or report to qemu directly.
tonistiigi
on 11 Mar 2021
From anyone that's using arch linux, make sure to use for now qemu-arch-extra and not qemu-arm-static.
patrickelectric
on 11 Mar 2021
Related issues
Julio-Guerra
路
4Comments
minusdelta
路
10Comments
kunalkushwaha
路
12Comments
no1melman
路
4Comments
npu21
路
6Comments
Most helpful comment
From anyone that's using arch linux, make sure to use for now
qemu-arch-extraand notqemu-arm-static.