https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.system_x86-64_linux_xl_Nightly/319
TestIBMJlmRemoteMemoryNoAuth_0
CL1 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
CL1 stderr at net.openj9.test.extensions.MemoryPoolExtensionCommand.execute(MemoryPoolExtensionCommand.java:97)
CL1 stderr at net.openj9.test.jlm.resources.VMData.invokeIBMMemoryPoolBeanTest(VMData.java:179)
CL1 stderr at net.openj9.test.jlm.resources.MemoryData.writeData(MemoryData.java:112)
CL1 stderr at net.openj9.test.jlm.remote.MemoryProfiler.getStatsViaProxy(MemoryProfiler.java:192)
CL1 stderr at net.openj9.test.jlm.remote.MemoryProfiler.main(MemoryProfiler.java:119)
CL1 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
CL1 stderr at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
CL1 stderr at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
CL1 stderr at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
CL1 stderr at java.base/java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:963)
CL1 stderr at java.base/java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:1093)
CL1 stderr ... 5 more
CL1 stderr Caused by: java.lang.NullPointerException
CL1 stderr at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
CL1 stderr at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2911)
CL1 stderr at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2928)
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
CL1 stderr ... 12 more
@cathyzhyi FYI as I see an NPE coming from BruteArgumentMoverHandle
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_extended.system_x86-64_linux_xl_Nightly/331
SharedClasses.SCM01.MultiThread_0
[2020-04-04T04:20:29.818Z] MT4 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
[2020-04-04T04:20:29.818Z] MT4 stderr at net.openj9.test.sc.LoaderSlaveMultiThread.logMessage(LoaderSlaveMultiThread.java:153)
[2020-04-04T04:20:29.818Z] MT4 stderr at net.openj9.test.sc.LoaderSlaveMultiThread.run(LoaderSlaveMultiThread.java:134)
[2020-04-04T04:20:29.818Z] MT4 stderr at net.openj9.test.sc.LoaderSlaveMultiThread.main(LoaderSlaveMultiThread.java:59)
[2020-04-04T04:20:29.818Z] MT4 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:963)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:1093)
[2020-04-04T04:20:29.818Z] MT4 stderr ... 3 more
[2020-04-04T04:20:29.818Z] MT4 stderr Caused by: java.lang.NullPointerException
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2911)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2928)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
[2020-04-04T04:20:29.818Z] MT4 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
[2020-04-04T04:20:29.818Z] MT4 stderr ... 10 more
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/333
SharedClasses.SCM01.MultiThread_0
MT2 stderr Exception in thread "Thread-691" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
MT2 stderr Exception in thread "Thread-701" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
MT2 stderr at net.openj9.sc.classes.Test_Init_0697.makeString(Test_Init_0697.java:37)
MT2 stderr at net.openj9.sc.classes.Test_Init_0697.stringOperations(Test_Init_0697.java:24)
MT2 stderr at net.openj9.sc.classes.Test_Init_0697.getName(Test_Init_0697.java:7)
MT2 stderr at net.openj9.test.sc.LoaderSlaveMultiThread$LoaderThread.run(LoaderSlaveMultiThread.java:213)
MT2 stderr at java.base/java.lang.Thread.run(Thread.java:834)
MT2 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
MT2 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
MT2 stderr at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
MT2 stderr at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
MT2 stderr at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
MT2 stderr at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)Exception in thread "Thread-665" Exception in thread "
I am not able to reproduce this locally or through grinder. It would be very helpful if we could get some coredumps for the failure from nightly build.
@cathyzhyi pls provide the -Xdump options you want, and we can ask @Mesbah-Alam to help modify the test to include them.
@Mesbah-Alam could you help adding the following to the above a failing tests -Xdump:system+java:events=throw,filter=java/lang/NullPointerException#*java/lang/invoke/BruteArgumentMoverHandle.permuteArguments*
The option was added in https://github.com/eclipse/openj9-systemtest/pull/114
Occurred in an internal acceptance build 448411:
[AIX64] 80 SVT_Apps_1.SVT_Octane.NoOptions.1
Exception in thread "main" java.lang.NullPointerException
at java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
at java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2233)
at java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2271)
at jdk.internal.dynalink.ChainedCallSite.makePruneAndInvokeMethod(ChainedCallSite.java:240)
at jdk.internal.dynalink.ChainedCallSite.relinkInternal(ChainedCallSite.java:196)
at jdk.internal.dynalink.ChainedCallSite.relink(ChainedCallSite.java:161)
at jdk.nashorn.internal.runtime.linker.LinkerCallSite.relink(LinkerCallSite.java:154)
at jdk.internal.dynalink.DynamicLinker.relink(DynamicLinker.java:297)
at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
at java.lang.invoke.BruteArgumentMoverHandle.invokeExact_thunkArchetype_X(BruteArgumentMoverHandle.java:404)
at java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
at java.lang.invoke.FoldNonvoidHandle.invokeExact_thunkArchetype_X(FoldHandle.java:123)
at java.lang.invoke.MutableCallSiteDynamicInvokerHandle.invokeExact_thunkArchetype_X(MutableCallSiteDynamicInvokerHandle.java:64)
at jdk.nashorn.internal.scripts.Script$Recompilation$8$5614AA$base.RunSuites(/bluebird/javatest/lib/octane/base.js:144)
at jdk.nashorn.internal.scripts.Script$\^eval\_.:program(<eval>:73)
at jdk.nashorn.internal.runtime.ScriptFunctionData.invoke(ScriptFunctionData.java:649)
at jdk.nashorn.internal.runtime.ScriptFunction.invoke(ScriptFunction.java:506)
at jdk.nashorn.internal.runtime.ScriptRuntime.apply(ScriptRuntime.java:405)
at jdk.nashorn.api.scripting.NashornScriptEngine.evalImpl(NashornScriptEngine.java:461)
at jdk.nashorn.api.scripting.NashornScriptEngine.access$200(NashornScriptEngine.java:85)
at jdk.nashorn.api.scripting.NashornScriptEngine$3.eval(NashornScriptEngine.java:522)
at javax.script.CompiledScript.eval(CompiledScript.java:117)
at com.ibm.octane.test.Octane.runTest(Octane.java:166)
at com.ibm.octane.test.Octane.runAllTests(Octane.java:114)
at com.ibm.octane.test.Octane.main(Octane.java:59)
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_Nightly/90
Caused many failures in this build.
java/lang/String/Supplementary.java.Supplementary
java/lang/String/ToLowerCase.java.ToLowerCase
java/lang/String/ToUpperCase.java.ToUpperCase
java/lang/String/UnicodeCasingTest.java.UnicodeCasingTest
java/lang/StringBuffer/AppendCharSequence.java.AppendCharSequence
java/lang/StringBuffer/AppendSB.java.AppendSB
java/lang/StringBuffer/AppendStringBuilder.java.AppendStringBuilder
java/lang/StringBuffer/BufferForwarding.java.BufferForwarding
java/lang/StringBuffer/Exceptions.java.Exceptions
java/lang/StringBuffer/IndexOf.java.IndexOf
java/lang/StringBuffer/SetLength.java.SetLength
java/lang/StringBuffer/Supplementary.java.Supplementary
java/lang/StringBuilder/AppendStringBuffer.java.AppendStringBuffer
java/lang/StringBuilder/BuilderForwarding.java.BuilderForwarding
java/lang/StringBuilder/Exceptions.java.Exceptions
java/lang/StringBuilder/Supplementary.java.Supplementary
Caused by: java.lang.NullPointerException
at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2912)
at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2929)
at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
... 15 more
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_extended.system_x86-64_linux_Release/37
SharedClasses.SCM01.MultiThread_0
MT4 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.NullPointerException
MT4 stderr at java.management/java.lang.management.ManagementFactory$PlatformMBeanFinder.lambda$static$0(ManagementFactory.java:926)
MT4 stderr at java.management/java.lang.management.ManagementFactory$PlatformMBeanFinder$$Lambda$13/0000000000000000.run(Unknown Source)
MT4 stderr at java.base/java.security.AccessController.doPrivileged(AccessController.java:873)
MT4 stderr at java.management/java.lang.management.ManagementFactory$PlatformMBeanFinder.<clinit>(ManagementFactory.java:922)
MT4 stderr at java.management/java.lang.management.ManagementFactory.getPlatformMXBean(ManagementFactory.java:684)
MT4 stderr at java.management/java.lang.management.ManagementFactory.getRuntimeMXBean(ManagementFactory.java:364)
MT4 stderr at net.openj9.test.sc.LoaderSlaveMultiThread.main(LoaderSlaveMultiThread.java:64)
MT4 stderr Caused by: java.lang.NullPointerException
MT4 stderr at java.base/java.lang.invoke.InnerClassLambdaMetafactory.buildCallSite(InnerClassLambdaMetafactory.java:231)
MT4 stderr at java.base/java.lang.invoke.LambdaMetafactory.metafactory(LambdaMetafactory.java:329)
MT4 stderr at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
MT4 stderr at java.base/java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:969)
MT4 stderr at java.base/java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:1093)
MT4 stderr ... 7 more
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_xl_Nightly/72
java/lang/System/LoggerFinder/internal/api/LoggerFinderAPITest.java
java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
at java.logging/java.util.logging.LogManager$LoggerContext.addLocalLogger(LogManager.java:799)
at java.logging/java.util.logging.LogManager$LoggerContext.ensureDefaultLogger(LogManager.java:749)
at java.logging/java.util.logging.LogManager$LoggerContext.ensureInitialized(LogManager.java:657)
at java.logging/java.util.logging.LogManager$LoggerContext.getLoggerNames(LogManager.java:849)
at java.logging/java.util.logging.LogManager.resetLoggerContext(LogManager.java:1455)
at java.logging/java.util.logging.LogManager.reset(LogManager.java:1445)
at java.logging/java.util.logging.LogManager.readConfiguration(LogManager.java:1575)
at java.logging/java.util.logging.LogManager.readConfiguration(LogManager.java:1378)
at java.logging/java.util.logging.LogManager.readPrimordialConfiguration(LogManager.java:445)
at java.logging/java.util.logging.LogManager$2.run(LogManager.java:394)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:678)
at java.logging/java.util.logging.LogManager.ensureLogManagerInitialized(LogManager.java:382)
at java.logging/java.util.logging.LogManager.getLogManager(LogManager.java:430)
at java.logging/java.util.logging.Logger.demandLogger(Logger.java:648)
at java.logging/java.util.logging.Logger.getLogger(Logger.java:717)
at java.logging/java.util.logging.Logger.getLogger(Logger.java:701)
at LoggerFinderAPITest.<init>(LoggerFinderAPITest.java:183)
at LoggerFinderAPITest.main(LoggerFinderAPITest.java:467)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
at java.base/java.lang.Thread.run(Thread.java:836)
Caused by: java.lang.invoke.StringConcatException: Generator failed
at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
at java.base/java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:963)
at java.base/java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:1093)
... 24 more
Caused by: java.lang.NullPointerException
at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2912)
at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2929)
at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
... 31 more
https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_x86-64_mac_Nightly/101
sun/misc/URLClassPath/ClassnameCharTest.java
java.lang.BootstrapMethodError: java.lang.NullPointerException
at sun.net.www.protocol.http.HttpURLConnection.getNetProperty(HttpURLConnection.java:215)
at sun.net.www.protocol.http.HttpURLConnection.<clinit>(HttpURLConnection.java:247)
at sun.net.www.protocol.http.Handler.openConnection(Handler.java:62)
at sun.net.www.protocol.http.Handler.openConnection(Handler.java:57)
at java.net.URL.openConnection(URL.java:1002)
at sun.applet.AppletClassLoader.getBytes(AppletClassLoader.java:319)
at sun.applet.AppletClassLoader.access$100(AppletClassLoader.java:64)
at sun.applet.AppletClassLoader$1.run(AppletClassLoader.java:206)
at java.security.AccessController.doPrivileged(AccessController.java:770)
at sun.applet.AppletClassLoader.findClass(AppletClassLoader.java:196)
at ClassnameCharTest$MyAppletClassLoader.findClass(ClassnameCharTest.java:99)
at ClassnameCharTest.realMain(ClassnameCharTest.java:81)
at ClassnameCharTest.main(ClassnameCharTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
at java.lang.Thread.run(Thread.java:823)
Caused by: java.lang.NullPointerException
at java.lang.invoke.InnerClassLambdaMetafactory.buildCallSite(InnerClassLambdaMetafactory.java:226)
at java.lang.invoke.LambdaMetafactory.metafactory(LambdaMetafactory.java:304)
at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
at java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:900)
at java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:951)
... 19 more
java.lang.AssertionError: Some tests failed
at ClassnameCharTest.main(ClassnameCharTest.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
at java.lang.Thread.run(Thread.java:823)
@pshipton is this one still happening or is it resolved in later builds?
I haven't seen anything since returning from vacation. @JasonFengJ9 have you seen this occur? Otherwise I'll close it.
@andrewcraik There is one here from a PR build run yesterday.
https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_x86-64_mac_Personal/7
jdk/lambda/ArrayCtorRefTest.java
15:31:21 test ArrayCtorRefTest.testLambdaInference(): failure
15:31:21 java.lang.BootstrapMethodError: java.lang.NullPointerException
15:31:21 at ArrayCtorRefTest.emptyArrayFactory(ArrayCtorRefTest.java:43)
15:31:21 at ArrayCtorRefTest.testLambdaInference(ArrayCtorRefTest.java:61)
15:31:21 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
15:31:21 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
15:31:21 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
15:31:21 at java.lang.reflect.Method.invoke(Method.java:498)
15:31:21 at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:85)
15:31:21 at org.testng.internal.Invoker.invokeMethod(Invoker.java:639)
15:31:21 at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:821)
15:31:21 at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1131)
15:31:21 at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
15:31:21 at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:108)
15:31:21 at org.testng.TestRunner.privateRun(TestRunner.java:773)
15:31:21 at org.testng.TestRunner.run(TestRunner.java:623)
15:31:21 at org.testng.SuiteRunner.runTest(SuiteRunner.java:357)
15:31:21 at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:352)
15:31:21 at org.testng.SuiteRunner.privateRun(SuiteRunner.java:310)
15:31:21 at org.testng.SuiteRunner.run(SuiteRunner.java:259)
15:31:21 at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
15:31:21 at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
15:31:21 at org.testng.TestNG.runSuitesSequentially(TestNG.java:1185)
15:31:21 at org.testng.TestNG.runSuitesLocally(TestNG.java:1110)
15:31:21 at org.testng.TestNG.run(TestNG.java:1018)
15:31:21 at com.sun.javatest.regtest.agent.TestNGRunner.main(TestNGRunner.java:94)
15:31:21 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
15:31:21 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
15:31:21 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
15:31:21 at java.lang.reflect.Method.invoke(Method.java:498)
15:31:21 at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
15:31:21 at java.lang.Thread.run(Thread.java:823)
15:31:21 Caused by: java.lang.NullPointerException
15:31:21 at java.lang.invoke.InnerClassLambdaMetafactory.buildCallSite(InnerClassLambdaMetafactory.java:226)
15:31:21 at java.lang.invoke.LambdaMetafactory.metafactory(LambdaMetafactory.java:304)
15:31:21 at java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:900)
15:31:21 at java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:951)
15:31:21 ... 30 more
@nbhuiyan could you please have a look?
I have been trying to reproduce this on Grinder as well as locally with Xdump options to obtain core dumps I can use for my investigation. Unfortunately, after 100 iterations on Grinder and almost 200 iterations locally of running the failed test target, I could not reproduce this failure. Are there any other recent builds where this happened?
Are there any other recent builds where this happened?
I haven't seen it, but will report here if it shows up again.
I haven't seen anything since returning from vacation. @JasonFengJ9 have you seen this occur? Otherwise I'll close it.
@pshipton no, I haven't seen it for a while, also tried TRSS search in recent builds and no hits either.
Even though I'm not convinced the problem is resolved given https://github.com/eclipse/openj9/issues/8972#issuecomment-696829594, I'll close it. We can reopen if the problem is seen again.
A bunch more here https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_xl_Nightly/162
Caused 19 failures in the same test run.
java/lang/String/Supplementary.java.Supplementary
java/lang/String/ToLowerCase.java.ToLowerCase
java/lang/String/ToUpperCase.java.ToUpperCase
java/lang/String/UnicodeCasingTest.java.UnicodeCasingTest
java/lang/StringBuffer/AppendCharSequence.java.AppendCharSequence
java/lang/StringBuffer/AppendSB.java.AppendSB
java/lang/StringBuffer/AppendStringBuilder.java.AppendStringBuilder
java/lang/StringBuffer/BufferForwarding.java.BufferForwarding
java/lang/StringBuffer/Exceptions.java.Exceptions
java/lang/StringBuffer/IndexOf.java.IndexOf
java/lang/StringBuffer/SetLength.java.SetLength
java/lang/StringBuffer/Supplementary.java.Supplementary
java/lang/StringBuilder/AppendStringBuffer.java.AppendStringBuffer
java/lang/StringBuilder/BuilderForwarding.java.BuilderForwarding
java/lang/StringBuilder/Exceptions.java.Exceptions
java/lang/StringBuilder/Supplementary.java.Supplementary
java/lang/System/Logger/Level/LoggerLevelTest.java.LoggerLevelTest
java/lang/System/Logger/interface/LoggerInterfaceTest.java.LoggerInterfaceTest
java/lang/System/LoggerFinder/internal/api/LoggerFinderAPITest.java.LoggerFinderAPITest
Resuming my investigation into this failure again.
Another one in an internal test
job_output.php?id=657892400 [Linux Hammer]
Another series of failures
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_xl_Nightly/169
java/lang/String/Supplementary.java.Supplementary
java/lang/String/ToUpperCase.java.ToUpperCase
java/lang/String/UnicodeCasingTest.java.UnicodeCasingTest
java/lang/StringBuffer/AppendCharSequence.java.AppendCharSequence
java/lang/StringBuffer/AppendSB.java.AppendSB
java/lang/StringBuffer/AppendStringBuilder.java.AppendStringBuilder
java/lang/StringBuffer/BufferForwarding.java.BufferForwarding
java/lang/StringBuffer/Exceptions.java.Exceptions
java/lang/StringBuffer/IndexOf.java.IndexOf
java/lang/StringBuilder/BuilderForwarding.java.BuilderForwarding
java/lang/StringBuilder/Exceptions.java.Exceptions
java/lang/StringBuilder/Supplementary.java.Supplementary
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_Nightly/192
java/lang/System/Logger/Level/LoggerLevelTest.java.LoggerLevelTest
java/lang/System/LoggerFinder/internal/api/LoggerFinderAPITest.java.LoggerFinderAPITest
I wonder if https://github.com/eclipse/openj9/issues/10759 is related.
After at least 100 iterations of the failing target in each platform this failure surfaced in recently, I have been unable to reproduce it. I am not able to investigate further without being able to reproduce it and obtaining the core dumps. I will continue trying to reproduce this. I am not sure about how long it might take to achieve that.
How about if we modify all the openjdk java/lang testing to have the -Xdump option you need, so the next time it occurs in the nightly builds there will be a core file.
That will be fantastic! Please add the Xdump option in comment above for jdk_lang_j9.
Created https://github.com/AdoptOpenJDK/openjdk-tests/pull/1989
Does the option change the JIT behavior? It's interesting we haven't seen the problem again in the system testing since the option was added (although we might have missing something while I was on vacation).
Does the option change the JIT behavior? It's interesting we haven't seen the problem again in the system testing since the option was added (although we might have missing something while I was on vacation).
I would be really surprised if that was the case. I did perform Grinder runs without the -Xdump option but could not reproduce the failure even then.
Given the lack of progress I am moving this to the next release - we aren't likely to have a fix in time for the release.
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/508
SharedClasses.SCM01.MultiCL_0
STF 01:12:09.888 - +------ Step 6 - Start java processes using LoaderSlaveMultiCL
STF 01:12:09.889 - | Run multiple concurrent foreground processes
STF 01:12:09.889 - | Program: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java
STF 01:12:09.889 - | Mnemonic: MCL
STF 01:12:09.889 - | Instances: 5
STF 01:12:09.889 - | Echo: ECHO_ON
STF 01:12:09.889 - | Expectation: CLEAN_RUN within 2h
STF 01:12:09.889 - |
STF 01:12:09.891 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.891 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL1.stderr
STF 01:12:09.891 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL1.stdout
STF 01:12:09.896 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.896 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL2.stderr
STF 01:12:09.896 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL2.stdout
STF 01:12:09.899 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.899 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL3.stderr
STF 01:12:09.899 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL3.stdout
STF 01:12:09.902 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.902 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL4.stderr
STF 01:12:09.902 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL4.stdout
STF 01:12:09.906 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.906 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL5.stderr
STF 01:12:09.906 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL5.stdout
STF 01:12:09.909 - Monitoring processes: MCL1 MCL2 MCL3 MCL4 MCL5
MCL1 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
MCL1 stderr at net.openj9.sc.classes.Test_Init_0132.stringOperations(Test_Init_0132.java:20)
MCL1 stderr at net.openj9.sc.classes.Test_Init_0132.getName(Test_Init_0132.java:7)
MCL1 stderr at net.openj9.test.sc.LoaderSlaveMultiCL.run(LoaderSlaveMultiCL.java:115)
MCL1 stderr at net.openj9.test.sc.LoaderSlaveMultiCL.main(LoaderSlaveMultiCL.java:52)
MCL1 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
MCL1 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
MCL1 stderr at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
MCL1 stderr at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
MCL1 stderr at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
MCL1 stderr at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
MCL1 stderr at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
MCL1 stderr at java.base/java.lang.invoke.MethodHandleResolver.invokeBsm(MethodHandleResolver.java:175)
MCL1 stderr at java.base/java.lang.invoke.MethodHandleResolver.resolveInvokeDynamic(MethodHandleResolver.java:237)
MCL1 stderr ... 4 more
MCL1 stderr Caused by: java.lang.NullPointerException
MCL1 stderr at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
MCL1 stderr at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2936)
MCL1 stderr at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2953)
MCL1 stderr at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
MCL1 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
MCL1 stderr ... 11 more
STF 01:12:25.119 - **FAILED** Process MCL1 ended with exit code (1) and not the expected exit code/s (0)
STF 01:12:25.120 - Monitoring Report Summary:
STF 01:12:25.120 - o Process MCL1 ended with exit code (1) and not the expected exit code/s (0)
STF 01:12:25.120 - o Process MCL2 is still running
STF 01:12:25.120 - o Process MCL3 is still running
STF 01:12:25.120 - o Process MCL4 is still running
STF 01:12:25.120 - o Process MCL5 is still running
@pshipton Unfortunately, we did not get a core dump from that crash. The dump option was not set for the run:
23:09:17 ===============================================
23:09:17 Running test SharedClasses.SCM01.MultiCL_0 ...
23:09:17 ===============================================
23:09:17 SharedClasses.SCM01.MultiCL_0 Start Time: Mon Oct 19 01:09:09 2020 Epoch Time (ms): 1603084149924
23:09:17 "/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:destroyAll; "/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";
23:09:17 JVMSHRC005I No shared class caches available
23:09:17 JVMSHRC005I No shared class caches available
23:09:17 cache cleanup done
23:09:17 variation: NoOptions
23:09:17 JVM_OPTIONS:
I was under the impression that eclipse/openj9-systemtest#114 would have resulted in this test being run with the -Xdump option set up.
https://github.com/eclipse/openj9-systemtest/pull/114 only modified the MT (MultiThread) scenario, while the NPE occurred in the MultiCL scenario. @Mesbah-Alam can we modify this scenario as well please.
https://github.com/eclipse/openj9-systemtest/pull/120 has modified all the test variants to run with the -Xdump option.
There are NPEs related to InnerClassLambdaMetafactory.buildCallSite reported in https://github.com/eclipse/openj9/issues/10929
Still no luck in reproducing this failure with the dump option set. Seems like the failures do not show up after setting up the -Xdump options. At this time we do not have a way to investigate this further and therefore this issue can not be resolved as part of 0.24.
Given the inability to reproduce this problem with any form of diagnostic aids this is not going to be resolved for 0.24, hence moving this out to JDK16.
However, if the existing diagnostic procedures are not proving to be effective we will have to brainstorm more creative and bespoke approaches for 0.25.
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.system_s390x_linux_Nightly_testList_1/30
TestJlmRemoteThreadNoAuth_0
CL1 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
CL1 stderr at net.adoptopenjdk.test.jlm.resources.ThreadData.writeData(ThreadData.java:269)
CL1 stderr at net.adoptopenjdk.test.jlm.remote.ThreadProfiler.getStatsViaProxy(ThreadProfiler.java:135)
CL1 stderr at net.adoptopenjdk.test.jlm.remote.ThreadProfiler.main(ThreadProfiler.java:97)
CL1 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
CL1 stderr at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
CL1 stderr at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
CL1 stderr at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
CL1 stderr at java.base/java.lang.invoke.MethodHandleResolver.invokeBsm(MethodHandleResolver.java:176)
CL1 stderr at java.base/java.lang.invoke.MethodHandleResolver.resolveInvokeDynamic(MethodHandleResolver.java:238)
CL1 stderr ... 3 more
CL1 stderr Caused by: java.lang.NullPointerException
CL1 stderr at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
CL1 stderr at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2930)
CL1 stderr at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2947)
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
CL1 stderr at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
CL1 stderr ... 10 more
Found 13 failures with the same symptom in my pbuild (the String, StringBuilder and StringBuffer tests)
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_Personal/12/testReport/
https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_mac_Release/23
java/lang/StringBuilder/BuilderForwarding.java.BuilderForwarding
java/lang/System/Logger/Level/LoggerLevelTest.java.LoggerLevelTest
java/lang/System/LoggerFinder/internal/api/LoggerFinderAPITest.java.LoggerFinderAPITest