Openjdk-tests: external/jenkins failed with 'Unable to find image 'adoptopenjdk-jenkins-test:11-jdk-ubuntu-hotspot-full' locally

[sophia-guo]

It's intermittent. Happened to openj9 and hotspot:

Unable to find image 'adoptopenjdk-jenkins-test:11-jdk-ubuntu-hotspot-full' locally

https://ci.adoptopenjdk.net/job/Test_openjdk8_j9_extended.external_x86-64_linux_jenkins/26/console
https://ci.adoptopenjdk.net/job/Test_openjdk11_hs_extended.external_x86-64_linux_jenkins/29/console

00:57:30  jenkins_test_0_FAILED
00:57:30  
00:57:30  Error: No such image: adoptopenjdk-jenkins-test:8-jdk-ubuntu-openj9-full
00:57:30  "/home/jenkins/workspace/Test_openjdk8_j9_extended.external_x86-64_linux_jenkins/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:destroyAll; "/home/jenkins/workspace/Test_openjdk8_j9_extended.external_x86-64_linux_jenkins/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";

The reason is image is not built successfully and marked as successful.

06:39:12       [exec] Step 8/21 : RUN apt-get update    && apt-get install -y --no-install-recommends git maven     && rm -rf /var/lib/apt/lists/*
06:39:12       [exec]  ---> Running in 1a20d5e5b650
06:39:12       [exec] no status provided on response: unknown
06:39:12       [exec] Result: 1
06:39:12  
06:39:12  dist:
06:39:12       [copy] Copying 2 files to /home/jenkins/workspace/Test_openjdk11_hs_extended.external_x86-64_linux_jenkins/jvmtest/external/jenkins
06:39:12  
06:39:12  BUILD SUCCESSFUL
06:39:12  Total time: 46 seconds
06:39:12  0

[sophia-guo]

Probably need to update if build_image can't be built successfully exit with error code and message. So build will stop to continue run to test stage.

[smlambert]

I think all external projects need their build files updated to fail immediately, I am seeing this same issue with netty tests and their are likely others.

01:06:21       [exec] Step 8/22 : RUN apt-get update    && apt-get install -y --no-install-recommends git maven autoconf automake libtool make tar gcc-multilib libaio-dev  && rm -rf /var/lib/apt/lists/*
01:06:21       [exec]  ---> Running in 9ad6556f649d
01:06:24       [exec] Get:1 http://ports.ubuntu.com/ubuntu-ports focal InRelease [265 kB]
01:06:25       [exec] Get:2 http://ports.ubuntu.com/ubuntu-ports focal-updates InRelease [114 kB]
01:06:25       [exec] Get:3 http://ports.ubuntu.com/ubuntu-ports focal-backports InRelease [101 kB]
01:06:25       [exec] Get:4 http://ports.ubuntu.com/ubuntu-ports focal-security InRelease [109 kB]
01:06:25       [exec] Get:5 http://ports.ubuntu.com/ubuntu-ports focal/universe ppc64el Packages [11.0 MB]
01:06:26       [exec] Get:6 http://ports.ubuntu.com/ubuntu-ports focal/restricted ppc64el Packages [1,317 B]
01:06:26       [exec] Get:7 http://ports.ubuntu.com/ubuntu-ports focal/main ppc64el Packages [1,229 kB]
01:06:27       [exec] Get:8 http://ports.ubuntu.com/ubuntu-ports focal/multiverse ppc64el Packages [146 kB]
01:06:27       [exec] Get:9 http://ports.ubuntu.com/ubuntu-ports focal-updates/multiverse ppc64el Packages [3,592 B]
01:06:27       [exec] Get:10 http://ports.ubuntu.com/ubuntu-ports focal-updates/restricted ppc64el Packages [2,467 B]
01:06:27       [exec] Get:11 http://ports.ubuntu.com/ubuntu-ports focal-updates/main ppc64el Packages [720 kB]
01:06:27       [exec] Get:12 http://ports.ubuntu.com/ubuntu-ports focal-updates/universe ppc64el Packages [842 kB]
01:06:27       [exec] Get:13 http://ports.ubuntu.com/ubuntu-ports focal-backports/universe ppc64el Packages [4,304 B]
01:06:27       [exec] Get:14 http://ports.ubuntu.com/ubuntu-ports focal-security/universe ppc64el Packages [599 kB]
01:06:27       [exec] Get:15 http://ports.ubuntu.com/ubuntu-ports focal-security/main ppc64el Packages [345 kB]
01:06:27       [exec] Get:16 http://ports.ubuntu.com/ubuntu-ports focal-security/restricted ppc64el Packages [2,010 B]
01:06:28       [exec] Fetched 15.5 MB in 4s (4,307 kB/s)
01:06:29       [exec] Reading package lists...
01:06:30       [exec] Reading package lists...
01:06:30       [exec] Building dependency tree...
01:06:30       [exec] Reading state information...
01:06:30       [exec] Package gcc-multilib is not available, but is referred to by another package.
01:06:30       [exec] This may mean that the package is missing, has been obsoleted, or
01:06:30       [exec] is only available from another source
01:06:30       [exec] 
01:06:30       [exec] E: Package 'gcc-multilib' has no installation candidate
01:06:51       [exec] The command '/bin/sh -c apt-get update    && apt-get install -y --no-install-recommends git maven autoconf automake libtool make tar gcc-multilib libaio-dev  && rm -rf /var/lib/apt/lists/*' returned a non-zero code: 100
01:06:51       [exec] 
01:06:51       [exec] Result: 100
01:06:51  
01:06:51  dist:
01:06:51       [copy] Copying 2 files to /home/jenkins/workspace/Test_openjdk11_hs_extended.external_ppc64le_linux_netty/jvmtest/external/netty
01:06:51  
01:06:51  BUILD SUCCESSFUL

[sophia-guo]

Correct. All external projects use build_image() to generate the image. Code actually checks the return code of docker build command https://github.com/AdoptOpenJDK/openjdk-tests/blob/master/external/build_image.sh#L58.

Target build_image need to be updated with failonerror = true. Will try that.