Openj9: Test-sanity.system-JDK10-linux_x86-64 DaaLoadTest_daa1_0 crash vmState=0x000507ff
https://ci.eclipse.org/openj9/job/Test-sanity.system-JDK10-linux_x86-64/100
===============================================
Running test DaaLoadTest_daa1_0 ...
===============================================
DaaLoadTest_daa1_0 Start Time: Thu Oct 18 07:10:01 2018 Epoch Time (ms): 1539846601869
test with NoOptions
STF 07:10:02.042 - ========================= S T F =========================
systemtest-prereqs has been processed, and set to: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqsRetrieving amount of free space on drive containing /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0
There is 90314 Mb free
STF 07:10:02.048 - ================== G E N E R A T I O N ==================
STF 07:10:02.050 - Checking JVM: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/bin/../
STF 07:10:02.050 - Starting process to generate scripts: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/bin/..//bin/java -Dlog4j.skipJansi=true -Djava.system.class.loader=net.adoptopenjdk.stf.runner.StfClassLoader -classpath /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../../jvmtest/systemtest/systemtest_prereqs/log4j-2.3/log4j-api-2.3.jar:/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../../jvmtest/systemtest/systemtest_prereqs/log4j-2.3/log4j-core-2.3.jar:/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/stf/stf.core/scripts/../bin net.adoptopenjdk.stf.runner.StfRunner -properties "/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/stf_parameters.properties, , /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/stf/stf.core/config/stf.properties" -testDir "/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest"
GEN 07:10:03.288 - Found test. Project: 'openj9.test.load' class: 'DaaLoadTest.class' Dir: '/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/openj9-systemtest/openj9.test.load/bin'
GEN 07:10:03.295 - Found test. Project: 'openj9.test.load' class: 'net.openj9.stf.DaaLoadTest'
GEN Classpath directories used by project 'openj9.test.load':
GEN /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/openj9-systemtest/openj9.test.load/bin
GEN /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/stf/stf.core/bin
GEN /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/stf/stf.load/bin
GEN /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqs/log4j-2.3/log4j-api-2.3.jar
GEN /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqs/log4j-2.3/log4j-core-2.3.jar
GEN /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqs/junit-4.12/junit-4.12.jar
GEN /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqs/junit-4.12/hamcrest-core-1.3.jar
GEN 07:10:03.667 - Using Mode NoOptions. Values = ''
GEN 07:10:03.767 -
GEN 07:10:03.767 - Test command summary:
GEN 07:10:03.769 - Step Stage Command Description
GEN 07:10:03.769 - -----+--------+-----------------+------------
GEN 07:10:03.770 - 1 execute Run java Run daa load test
STF 07:10:03.796 -
STF 07:10:03.796 - Script generation completed
STF 07:10:03.796 -
STF 07:10:03.796 -
STF 07:10:03.796 - ======================= S E T U P =======================
STF 07:10:03.796 - Running setup: perl /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/setUp.pl
STF 07:10:03.866 - SETUP stage completed
STF 07:10:03.871 -
STF 07:10:03.871 - ==================== E X E C U T E - ====================
STF 07:10:03.871 - Running execute: perl /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/execute.pl
STF 07:10:03.938 -
STF 07:10:03.938 - Java version
STF 07:10:03.938 - Running: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/bin/../bin/java -version
openjdk version "10.0.2-internal" 2018-07-17
OpenJDK Runtime Environment (build 10.0.2-internal+0-adhoc.jenkins.Build-JDK10-linuxx86-64)
Eclipse OpenJ9 VM (build master-e448d21, JRE 10 Linux amd64-64-Bit 20181018_459 (JIT enabled, AOT enabled)
OpenJ9 - e448d21
OMR - 2bc0d2a
JCL - 72f6b68 based on jdk-10.0.2+13)
STF 07:10:04.149 -
STF 07:10:04.149 - +------ Step 1 - Run daa load test
STF 07:10:04.149 - | Run foreground process
STF 07:10:04.149 - | Program: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/bin/../bin/java
STF 07:10:04.149 - | Mnemonic: DLT
STF 07:10:04.149 - | Echo: ECHO_ON
STF 07:10:04.149 - | Expectation: CLEAN_RUN within 5h
STF 07:10:04.149 - |
STF 07:10:04.150 - Running command: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/bin/../bin/java -Xnocompressedrefs -classpath /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/stf/stf.load/bin:/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/stf/stf.core/bin:/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqs/log4j-2.3/log4j-api-2.3.jar:/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqs/log4j-2.3/log4j-core-2.3.jar:/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqs/junit-4.12/junit-4.12.jar:/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/systemtest_prereqs/junit-4.12/hamcrest-core-1.3.jar:/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/jvmtest/systemtest/openj9-systemtest/openj9.test.daa/bin net.adoptopenjdk.loadTest.LoadTest -resultsDir /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/results -resultsPrefix 1.DLT. -reportFailureLimit 1 -abortAtFailureLimit 10 -maxTotalLogFileSpace 200M -maxSingleLogSize 1/25 -suite.daa.threadCount 2 -suite.daa.totalNumberTests 1900 -suite.daa.inventoryFile /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/results/1.DLT.inventory/openj9.test.load/config/inventories/daa/daa1.xml -suite.daa.inventoryExcludeFile none -suite.daa.selection random -suite.daa.seed -1 -suite.daa.repeatCount 1 -suite.daa.thinkingTime 0ms..0ms
STF 07:10:04.150 - Redirecting stderr to /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/results/1.DLT.stderr
STF 07:10:04.150 - Redirecting stdout to /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/results/1.DLT.stdout
STF 07:10:04.160 - Monitoring processes: DLT
DLT 07:10:05.392 - Load test parameters
DLT 07:10:05.395 - Time limited = false
DLT 07:10:05.396 - abortIfOutOfMemory = true
DLT 07:10:05.396 - reportFailureLimit = 1
DLT 07:10:05.397 - abortAtFailureLimit = 10
DLT 07:10:05.399 - maxTotalLogFileSpace = 209715200
DLT 07:10:05.400 - maxSingleLogSize = 8388608
DLT 07:10:05.400 - Parameters for suite 0
DLT 07:10:05.401 - Suite name = daa
DLT 07:10:05.402 - Number threads = 2
DLT 07:10:05.403 - Supplied seed = -1
DLT 07:10:05.404 - Inventory file = /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/results/1.DLT.inventory/openj9.test.load/config/inventories/daa/daa1.xml
DLT 07:10:05.404 - Exclude file = none
DLT 07:10:05.405 - Number tests = 1900
DLT 07:10:05.406 - Repeat count = 1
DLT 07:10:05.407 - Thinking time = 0ms..0ms
DLT 07:10:05.407 - Selection mode = random
DLT 07:10:05.409 - Actual seed = 1541935198988
DLT 07:10:05.423 - Parsing inventory file. Root=/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdk-tests/TestConfig/scripts/testKitGen/../../../TestConfig/test_output_15398463188030/DaaLoadTest_daa1_0/20181018-071002-DaaLoadTest/results/1.DLT.inventory File=openj9.test.load/config/inventories/daa/daa1.xml
DLT 07:10:05.438 - Final test list:
DLT 07:10:05.442 - 0 ArbitraryJava[net.openj9.test.simple.ConvertDecimal invokeTest] Weighting=1
DLT 07:10:05.442 - 1 ArbitraryJava[net.openj9.test.simple.MarshalUnmarshalBinary invokeTest] Weighting=1
DLT 07:10:05.443 - 2 JUnit[net.openj9.test.arithmetics.TestArithmeticOperations] Weighting=1
DLT 07:10:05.443 - 3 JUnit[net.openj9.test.arithmetics.TestArithmeticInline] Weighting=1
DLT 07:10:05.443 - 4 JUnit[net.openj9.test.arithmetics.TestArithmetics] Weighting=1
DLT 07:10:05.443 - 5 JUnit[net.openj9.test.arithmetics.TestComparisonEquals] Weighting=1
DLT 07:10:05.444 - 6 JUnit[net.openj9.test.arithmetics.TestPDComparisons] Weighting=1
DLT 07:10:05.444 - 7 JUnit[net.openj9.test.arithmetics.TestPerformance] Weighting=1
DLT 07:10:05.444 - 8 JUnit[net.openj9.test.arithmetics.TestSubExceptions] Weighting=1
DLT 07:10:05.444 - 9 JUnit[net.openj9.test.arithmetics.TestValidityChecking] Weighting=1
DLT 07:10:05.444 - 10 JUnit[net.openj9.test.binaryData.LongIntegerComparison] Weighting=1
DLT 07:10:05.444 - 11 JUnit[net.openj9.test.binaryData.TestOptimizer] Weighting=1
DLT 07:10:05.445 - 12 JUnit[net.openj9.test.decimals.TestBD2PD2BD] Weighting=1
DLT 07:10:05.445 - 13 JUnit[net.openj9.test.decimals.TestDecimalData] Weighting=1
DLT 07:10:05.445 - 14 JUnit[net.openj9.test.decimals.TestDecimalData2] Weighting=1
DLT 07:10:05.445 - 15 JUnit[net.openj9.test.PD2Primitive.TestPD2Primitives2PD] Weighting=1
DLT 07:10:05.445 - 16 JUnit[net.openj9.test.PDMoveShifts.TestShiftsAndConvert] Weighting=1
DLT 07:10:05.445 - 17 JUnit[net.openj9.test.PDMoveShifts.TestPDMove] Weighting=1
DLT 07:10:05.445 - 18 ArbitraryJava[net.openj9.test.PDMoveShifts.ShiftTestRunner invokeTest] Weighting=1
DLT 07:10:05.491 - Starting thread. Suite=0 thread=0
DLT 07:10:05.493 - Starting thread. Suite=0 thread=1
DLT stderr #0: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x6be706) [0x7fcb2dc02706]
DLT stderr #1: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x6cbd1d) [0x7fcb2dc0fd1d]
DLT stderr #2: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x1247e9) [0x7fcb2d6687e9]
DLT stderr #3: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9prt29.so(+0x1f42d) [0x7fcb2f0f542d]
DLT stderr #4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390) [0x7fcb34eac390]
DLT stderr #5: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x5afdbc) [0x7fcb2daf3dbc]
DLT stderr #6: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x580fad) [0x7fcb2dac4fad]
DLT stderr #7: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x58104b) [0x7fcb2dac504b]
DLT stderr #8: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x5810f6) [0x7fcb2dac50f6]
DLT stderr #9: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x5811de) [0x7fcb2dac51de]
DLT stderr #10: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x58163b) [0x7fcb2dac563b]
DLT stderr #11: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x57ce25) [0x7fcb2dac0e25]
DLT stderr #12: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x57df32) [0x7fcb2dac1f32]
DLT stderr #13: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x3d85bd) [0x7fcb2d91c5bd]
DLT stderr #14: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x131c5a) [0x7fcb2d675c5a]
DLT stderr #15: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x132c16) [0x7fcb2d676c16]
DLT stderr #16: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9prt29.so(+0x204f7) [0x7fcb2f0f64f7]
DLT stderr #17: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x1344b1) [0x7fcb2d6784b1]
DLT stderr #18: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x134951) [0x7fcb2d678951]
DLT stderr #19: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x135000) [0x7fcb2d679000]
DLT stderr #20: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x1352da) [0x7fcb2d6792da]
DLT stderr #21: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x13538f) [0x7fcb2d67938f]
DLT stderr #22: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9prt29.so(+0x204f7) [0x7fcb2f0f64f7]
DLT stderr #23: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x1356d6) [0x7fcb2d6796d6]
DLT stderr #24: /home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9thr29.so(+0xdf63) [0x7fcb2fa5ef63]
DLT stderr #25: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7fcb34ea26ba]
DLT stderr #26: function clone+0x6d [0x7fcb355dd41d]
DLT stderr Unhandled exception
DLT stderr Type=Segmentation error vmState=0x000507ff
DLT stderr J9Generic_Signal_Number=00000004 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
DLT stderr Handler1=00007FCB2FD05D40 Handler2=00007FCB2F0F51F0 InaccessibleAddress=0000000000000000
DLT stderr RDI=00007FCA340FD390 RSI=00007FCA34198E50 RAX=0000000000000000 RBX=00007FCA340FD390
DLT stderr RCX=0000000000000254 RDX=00007FCA35D80020 R8=0000000000000000 R9=0000000000000000
DLT stderr R10=0000000000000000 R11=00007FCA34206C20 R12=00007FCA34198E50 R13=000000000000324A
DLT stderr R14=00007FCA34198E50 R15=0000000000000000
DLT stderr RIP=00007FCB2DAF3DBC GS=0000 FS=0000 RSP=00007FCA9480DE40
DLT stderr EFlags=0000000000010206 CS=0033 RBP=00007FCA35D80020 ERR=0000000000000004
DLT stderr TRAPNO=000000000000000E OLDMASK=0000000000000000 CR2=0000000000000000
DLT stderr xmm0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm1 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm2 00007fca32268c90 (f: 841387136.000000, d: 6.941939e-310)
DLT stderr xmm3 00007fca3226f690 (f: 841414272.000000, d: 6.941939e-310)
DLT stderr xmm4 00007fca35d764b0 (f: 903308480.000000, d: 6.941942e-310)
DLT stderr xmm5 00007fca3226f690 (f: 841414272.000000, d: 6.941939e-310)
DLT stderr xmm6 00007fca8cd941f8 (f: 2363048448.000000, d: 6.942014e-310)
DLT stderr xmm7 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm8 00007fca322f6280 (f: 841966208.000000, d: 6.941939e-310)
DLT stderr xmm9 00007fca322f2120 (f: 841949440.000000, d: 6.941939e-310)
DLT stderr xmm10 00007fca322f7b40 (f: 841972544.000000, d: 6.941939e-310)
DLT stderr xmm11 00007fca323848a0 (f: 842549376.000000, d: 6.941939e-310)
DLT stderr xmm12 00007fca322ffce0 (f: 842005760.000000, d: 6.941939e-310)
DLT stderr xmm13 00007fca35d787c0 (f: 903317440.000000, d: 6.941942e-310)
DLT stderr xmm14 00007fca35e3a820 (f: 904112128.000000, d: 6.941942e-310)
DLT stderr xmm15 00007fca35e318a0 (f: 904075392.000000, d: 6.941942e-310)
DLT stderr Module=/home/jenkins/workspace/Test-sanity.system-JDK10-linux_x86-64/openjdkbinary/j2sdk-image/lib/default/libj9jit29.so
DLT stderr Module_base_address=00007FCB2D544000
DLT stderr
DLT stderr Method_being_compiled=net/openj9/test/decimals/TestDecimalData2.testConvertBigDecimalNormals()V
DLT stderr Target=2_90_20181018_459 (Linux 4.4.0-134-generic)
DLT stderr CPU=amd64 (4 logical CPUs) (0x1f2ae3000 RAM)
DLT stderr ----------- Stack Backtrace -----------
DLT stderr (0x00007FCB2DAF3DBC [libj9jit29.so+0x5afdbc])
DLT stderr (0x00007FCB2DAC4FAD [libj9jit29.so+0x580fad])
DLT stderr (0x00007FCB2DAC504B [libj9jit29.so+0x58104b])
DLT stderr (0x00007FCB2DAC50F6 [libj9jit29.so+0x5810f6])
DLT stderr (0x00007FCB2DAC51DE [libj9jit29.so+0x5811de])
DLT stderr (0x00007FCB2DAC563B [libj9jit29.so+0x58163b])
DLT stderr (0x00007FCB2DAC0E25 [libj9jit29.so+0x57ce25])
DLT stderr (0x00007FCB2DAC1F32 [libj9jit29.so+0x57df32])
DLT stderr (0x00007FCB2D91C5BD [libj9jit29.so+0x3d85bd])
DLT stderr (0x00007FCB2D675C5A [libj9jit29.so+0x131c5a])
DLT stderr (0x00007FCB2D676C16 [libj9jit29.so+0x132c16])
DLT stderr (0x00007FCB2F0F64F7 [libj9prt29.so+0x204f7])
DLT stderr (0x00007FCB2D6784B1 [libj9jit29.so+0x1344b1])
DLT stderr (0x00007FCB2D678951 [libj9jit29.so+0x134951])
DLT stderr (0x00007FCB2D679000 [libj9jit29.so+0x135000])
DLT stderr (0x00007FCB2D6792DA [libj9jit29.so+0x1352da])
DLT stderr (0x00007FCB2D67938F [libj9jit29.so+0x13538f])
DLT stderr (0x00007FCB2F0F64F7 [libj9prt29.so+0x204f7])
DLT stderr (0x00007FCB2D6796D6 [libj9jit29.so+0x1356d6])
DLT stderr (0x00007FCB2FA5EF63 [libj9thr29.so+0xdf63])
DLT stderr (0x00007FCB34EA26BA [libpthread.so.0+0x76ba])
DLT stderr clone+0x6d (0x00007FCB355DD41D [libc.so.6+0x10741d])
pshipton
All 40 comments
@andrewcraik
pshipton
on 18 Oct 2018
@cathyzhyi could you take a look? probably a recent issue...
andrewcraik
on 18 Oct 2018
Can't reproduce locally.
backtrace from coredump:
0x00007fcb2daf3dbc in nullchkSimplifier(TR::Node, TR::Block, TR::Simplifier) ()
0x00007fcb2dac4fad in OMR::Simplifier::simplify(TR::Node, TR::Block) ()
0x00007fcb2dac504b in OMR::Simplifier::simplify(TR::TreeTop, TR::Block) ()
0x00007fcb2dac50f6 in OMR::Simplifier::simplify(TR::Block) () from sdk/lib/default/libj9jit29.so
0x00007fcb2dac51de in OMR::Simplifier::simplifyExtendedBlock(TR::TreeTop*) ()
cathyzhyi
on 18 Oct 2018
Seems we have a jitdump but it's empty :/ we really ought to fix the logic to reproduce these issues. Anything we can extract from the core file using TR Extract from Irwin's instructions on RT Talk?
fjeremic
on 18 Oct 2018
@pshipton @andrewcraik Stop ship (or potential stop ship) for 0.11 ?
vij-singh
on 18 Oct 2018
@cathyzhyi is still looking - until we understand the problem it is hard to say. It is the only crash like this we have seen so far.
andrewcraik
on 18 Oct 2018
Thanks to Filip's suggestion and I was able to dig out some more info with jextract. The crash was because the following lines https://github.com/eclipse/omr/blob/ea548a66bf35e8638e4f0ea379f26c2f2897766b/compiler/optimizer/OMRSimplifierHandlers.cpp#L16386-L16390 in nullchkSimplifier didn't consider the case where the null check doesn't have a grandchild.
In this case, the child of the nullchk was changed from a virtual call java/math/BigDecimal.unscaledValue()Ljava/math/BigInteger; to a load of auto.
cathyzhyi
on 18 Oct 2018
I think the bug should be fixed in the code that converted that virtual call to an auto. Typically when this kind of "folding" (to an auto or a constant) occurs, the code that does the transformation is responsible for changing the treetop from a null check (for example) to a treetop opcode.
vijaysun-omr
on 18 Oct 2018
I don't know what the failure rate was for this failure with 0.11 but maybe we can try the same test with 0.10 to see if it's a new problem ? I don't know of new changes specifically done to handle BigDecimal better and so it's possible it was a pre-existing intermittent bug.
vijaysun-omr
on 18 Oct 2018
I agree with @vijaysun-omr that the source of the fold should be fixed. If we can get a log etc we should try to find the source of the folding and make sure that point fixes the treetop if necessary. Given that the compiler fell over some defensive code to handle this case in simplifier with an ASSERT stating we shouldn't have to handle the case because whoever folded the first grandchild of the NULLCHK away should have done so as an additional safety measure (and if finding the source is hard this may be the only fix for now while we try to find it).
I agree that determining a reproduction rate on 0.10 and 0.11 will help judge the urgency of the fix - I'm not sure how often this can happen...
andrewcraik
on 18 Oct 2018
https://github.com/AdoptOpenJDK/openjdk-tests/issues/663 is opened to fix the grinder issue so that we can figure out the failure rate.
cathyzhyi
on 31 Oct 2018
@cathyzhyi any further progress?
andrewcraik
on 2 Nov 2018
https://ci.eclipse.org/openj9/job/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/141
DaaLoadTest_daa1_0
DLT stderr #0: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x78db18) [0x7f61129a7b18]
DLT stderr #1: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x798d6d) [0x7f61129b2d6d]
DLT stderr #2: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x1229f1) [0x7f611233c9f1]
DLT stderr #3: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9prt29.so(+0x1f56f) [0x7f6113dbb56f]
DLT stderr #4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390) [0x7f6119d54390]
DLT stderr #5: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x630f5c) [0x7f611284af5c]
DLT stderr #6: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x5f9a2d) [0x7f6112813a2d]
DLT stderr #7: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x5f9ac7) [0x7f6112813ac7]
DLT stderr #8: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x5f9b76) [0x7f6112813b76]
DLT stderr #9: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x5f9c8d) [0x7f6112813c8d]
DLT stderr #10: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x5fa0eb) [0x7f61128140eb]
DLT stderr #11: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x5f26d0) [0x7f611280c6d0]
DLT stderr #12: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x5f34eb) [0x7f611280d4eb]
DLT stderr #13: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x3f455d) [0x7f611260e55d]
DLT stderr #14: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x1301fc) [0x7f611234a1fc]
DLT stderr #15: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x1310bc) [0x7f611234b0bc]
DLT stderr #16: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9prt29.so(+0x20360) [0x7f6113dbc360]
DLT stderr #17: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x132a89) [0x7f611234ca89]
DLT stderr #18: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x132fa2) [0x7f611234cfa2]
DLT stderr #19: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x1338ba) [0x7f611234d8ba]
DLT stderr #20: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x133bea) [0x7f611234dbea]
DLT stderr #21: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x133cc0) [0x7f611234dcc0]
DLT stderr #22: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9prt29.so(+0x20360) [0x7f6113dbc360]
DLT stderr #23: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so(+0x134169) [0x7f611234e169]
DLT stderr #24: /home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9thr29.so(+0xe2a9) [0x7f611891e2a9]
DLT stderr #25: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f6119d4a6ba]
DLT stderr #26: function clone+0x6d [0x7f611a48541d]
DLT stderr Unhandled exception
DLT stderr Type=Segmentation error vmState=0x000507ff
DLT stderr J9Generic_Signal_Number=00000004 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
DLT stderr Handler1=00007F6118BC9CC0 Handler2=00007F6113DBB3C0 InaccessibleAddress=0000000000000000
DLT stderr RDI=00007F608E865A50 RSI=00007F608E8C0450 RAX=0000000000000000 RBX=00007F608E865A50
DLT stderr RCX=0000000000000260 RDX=00007F609FD80020 R8=0000000000000000 R9=0000000000000000
DLT stderr R10=00007F608E8C0580 R11=0000000000000003 R12=00007F608E8C0450 R13=00007F608E8C0450
DLT stderr R14=00007F608E8C0450 R15=00007F608E8C0410
DLT stderr RIP=00007F611284AF5C GS=0000 FS=0000 RSP=00007F60F728FF70
DLT stderr EFlags=0000000000010202 CS=0033 RBP=00007F609FD80020 ERR=0000000000000004
DLT stderr TRAPNO=000000000000000E OLDMASK=0000000000000000 CR2=0000000000000000
DLT stderr xmm0 00007f608e86f5a0 (f: 2391209472.000000, d: 6.919522e-310)
DLT stderr xmm1 3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
DLT stderr xmm2 000000003ccad60e (f: 1019926016.000000, d: 5.039104e-315)
DLT stderr xmm3 000000003a005032 (f: 973099072.000000, d: 4.807748e-315)
DLT stderr xmm4 3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
DLT stderr xmm5 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm6 00000000000000ff (f: 255.000000, d: 1.259867e-321)
DLT stderr xmm7 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm8 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm9 6f6f6f6f6f6b6f6f (f: 1869311872.000000, d: 5.957503e+228)
DLT stderr xmm10 6f6f6f6f6f6b6f6f (f: 1869311872.000000, d: 5.957503e+228)
DLT stderr xmm11 0000000049d70a38 (f: 1238829568.000000, d: 6.120632e-315)
DLT stderr xmm12 000000004689a022 (f: 1183424512.000000, d: 5.846894e-315)
DLT stderr xmm13 0000000047ac082f (f: 1202456576.000000, d: 5.940925e-315)
DLT stderr xmm14 0000000048650dc0 (f: 1214582272.000000, d: 6.000833e-315)
DLT stderr xmm15 0000000046b73e38 (f: 1186414080.000000, d: 5.861665e-315)
DLT stderr Module=/home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so
DLT stderr Module_base_address=00007F611221A000
DLT stderr
DLT stderr Method_being_compiled=net/openj9/test/decimals/TestDecimalData2.testConvertBigDecimalNormals()V
DLT stderr Target=2_90_20190112_424 (Linux 4.4.0-134-generic)
DLT stderr CPU=amd64 (4 logical CPUs) (0x1f2ae3000 RAM)
DLT stderr ----------- Stack Backtrace -----------
DLT stderr (0x00007F611284AF5C [libj9jit29.so+0x630f5c])
DLT stderr (0x00007F6112813A2D [libj9jit29.so+0x5f9a2d])
DLT stderr (0x00007F6112813AC7 [libj9jit29.so+0x5f9ac7])
DLT stderr (0x00007F6112813B76 [libj9jit29.so+0x5f9b76])
DLT stderr (0x00007F6112813C8D [libj9jit29.so+0x5f9c8d])
DLT stderr (0x00007F61128140EB [libj9jit29.so+0x5fa0eb])
DLT stderr (0x00007F611280C6D0 [libj9jit29.so+0x5f26d0])
DLT stderr (0x00007F611280D4EB [libj9jit29.so+0x5f34eb])
DLT stderr (0x00007F611260E55D [libj9jit29.so+0x3f455d])
DLT stderr (0x00007F611234A1FC [libj9jit29.so+0x1301fc])
DLT stderr (0x00007F611234B0BC [libj9jit29.so+0x1310bc])
DLT stderr (0x00007F6113DBC360 [libj9prt29.so+0x20360])
DLT stderr (0x00007F611234CA89 [libj9jit29.so+0x132a89])
DLT stderr (0x00007F611234CFA2 [libj9jit29.so+0x132fa2])
DLT stderr (0x00007F611234D8BA [libj9jit29.so+0x1338ba])
DLT stderr (0x00007F611234DBEA [libj9jit29.so+0x133bea])
DLT stderr (0x00007F611234DCC0 [libj9jit29.so+0x133cc0])
DLT stderr (0x00007F6113DBC360 [libj9prt29.so+0x20360])
DLT stderr (0x00007F611234E169 [libj9jit29.so+0x134169])
DLT stderr (0x00007F611891E2A9 [libj9thr29.so+0xe2a9])
DLT stderr (0x00007F6119D4A6BA [libpthread.so.0+0x76ba])
DLT stderr clone+0x6d (0x00007F611A48541D [libc.so.6+0x10741d])
https://ci.eclipse.org/openj9/job/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/147
DLT stderr #25: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7faf38d336ba]
DLT stderr #26: function clone+0x6d [0x7faf3946e41d]
DLT stderr Unhandled exception
DLT stderr Type=Segmentation error vmState=0x000507ff
DLT stderr J9Generic_Signal_Number=00000004 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
DLT stderr Handler1=00007FAF33AF4C50 Handler2=00007FAF32EDF2F0 InaccessibleAddress=0000000000000000
DLT stderr RDI=00007FAEAF8A0960 RSI=00007FAEAF8B0D70 RAX=0000000000000000 RBX=00007FAEAF8A0960
DLT stderr RCX=0000000000000260 RDX=00007FAEADAA0120 R8=0000000000000158 R9=00007FAEADB04E70
DLT stderr R10=00007FAEAF8B0EA0 R11=00007FAE9B000078 R12=00007FAEAF8B0D70 R13=00007FAEAF8B0D70
DLT stderr R14=00007FAEAF8B0D70 R15=00007FAEAF8B0D30
DLT stderr RIP=00007FAF318C1ACC GS=0000 FS=0000 RSP=00007FAF15133F70
DLT stderr EFlags=0000000000010202 CS=0033 RBP=00007FAEADAA0120 ERR=0000000000000004
DLT stderr TRAPNO=000000000000000E OLDMASK=0000000000000000 CR2=0000000000000000
DLT stderr xmm0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm1 00007faeada22260 (f: 2913083904.000000, d: 6.936099e-310)
DLT stderr xmm2 00007faeec8d0fd0 (f: 3968667648.000000, d: 6.936152e-310)
DLT stderr xmm3 00007faeec910f40 (f: 3968929536.000000, d: 6.936152e-310)
DLT stderr xmm4 00007faeab5c6900 (f: 2874960128.000000, d: 6.936097e-310)
DLT stderr xmm5 00007faeec910f40 (f: 3968929536.000000, d: 6.936152e-310)
DLT stderr xmm6 00007fae9b0001f8 (f: 2600468992.000000, d: 6.936084e-310)
DLT stderr xmm7 00007faeada22260 (f: 2913083904.000000, d: 6.936099e-310)
DLT stderr xmm8 00007faeab3ce7b0 (f: 2872895488.000000, d: 6.936097e-310)
DLT stderr xmm9 00007faeec9d7260 (f: 3969741312.000000, d: 6.936152e-310)
DLT stderr xmm10 00007faeab3ce170 (f: 2872893696.000000, d: 6.936097e-310)
DLT stderr xmm11 00007faeab3cda80 (f: 2872891904.000000, d: 6.936097e-310)
DLT stderr xmm12 00007faeab3cb9e0 (f: 2872883712.000000, d: 6.936097e-310)
DLT stderr xmm13 00007faeedec5590 (f: 3991688704.000000, d: 6.936153e-310)
DLT stderr xmm14 00007faeeded0680 (f: 3991733760.000000, d: 6.936153e-310)
DLT stderr xmm15 00007faeedf091c0 (f: 3991966208.000000, d: 6.936153e-310)
DLT stderr Module=/home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so
DLT stderr Module_base_address=00007FAF31290000
DLT stderr
DLT stderr Method_being_compiled=net/openj9/test/arithmetics/TestArithmeticOperations.testMultiplyPackedDecimal()V
DLT stderr Target=2_90_20190117_451 (Linux 4.4.0-134-generic)
DLT stderr CPU=amd64 (4 logical CPUs) (0x1f2ae3000 RAM)
DLT stderr ----------- Stack Backtrace -----------
DLT stderr (0x00007FAF318C1ACC [libj9jit29.so+0x631acc])
DLT stderr (0x00007FAF3188A59D [libj9jit29.so+0x5fa59d])
DLT stderr (0x00007FAF3188A637 [libj9jit29.so+0x5fa637])
DLT stderr (0x00007FAF3188A6E6 [libj9jit29.so+0x5fa6e6])
DLT stderr (0x00007FAF3188A7FD [libj9jit29.so+0x5fa7fd])
DLT stderr (0x00007FAF3188AC5B [libj9jit29.so+0x5fac5b])
DLT stderr (0x00007FAF31883240 [libj9jit29.so+0x5f3240])
DLT stderr (0x00007FAF3188405B [libj9jit29.so+0x5f405b])
DLT stderr (0x00007FAF316854ED [libj9jit29.so+0x3f54ed])
DLT stderr (0x00007FAF313C02DC [libj9jit29.so+0x1302dc])
DLT stderr (0x00007FAF313C119C [libj9jit29.so+0x13119c])
DLT stderr (0x00007FAF32EE0290 [libj9prt29.so+0x20290])
DLT stderr (0x00007FAF313C2B69 [libj9jit29.so+0x132b69])
DLT stderr (0x00007FAF313C3082 [libj9jit29.so+0x133082])
DLT stderr (0x00007FAF313C399A [libj9jit29.so+0x13399a])
DLT stderr (0x00007FAF313C3CCA [libj9jit29.so+0x133cca])
DLT stderr (0x00007FAF313C3DA0 [libj9jit29.so+0x133da0])
DLT stderr (0x00007FAF32EE0290 [libj9prt29.so+0x20290])
DLT stderr (0x00007FAF313C4249 [libj9jit29.so+0x134249])
DLT stderr (0x00007FAF338492A9 [libj9thr29.so+0xe2a9])
DLT stderr (0x00007FAF38D336BA [libpthread.so.0+0x76ba])
DLT stderr clone+0x6d (0x00007FAF3946E41D [libc.so.6+0x10741d])
https://ci.eclipse.org/openj9/job/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/149
DaaLoadTest_daa2_0
OpenJ9: 162393f
OMR: 7e6db88
OpenJDK8: 7a39023 - openj9-openjdk-jdk8
OpenJDK11: 007fb48 - openj9-openjdk-jdk11
previous build was:
OpenJ9: 57442bd
OMR: 1d03bfd
OpenJDK8: ​1069649 ​- ​openj9-openjdk-jdk8
OpenJDK11: 17d1371
https://github.com/eclipse/openj9/compare/57442bd...162393f
https://github.com/eclipse/openj9-omr/compare/1d03bfd...7e6db88
https://github.com/ibmruntimes/openj9-openjdk-jdk11/compare/17d1371...007fb48
DLT stderr Unhandled exception
DLT stderr Type=Segmentation error vmState=0x000507ff
DLT stderr J9Generic_Signal_Number=00000004 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
DLT stderr Handler1=00007FB074944C50 Handler2=00007FB06FBB32F0 InaccessibleAddress=0000000000000000
DLT stderr RDI=00007FAFEACE6D10 RSI=00007FAFEADBC890 RAX=0000000000000000 RBX=00007FAFEACE6D10
DLT stderr RCX=0000000000000260 RDX=00007FAFE7AA0120 R8=0000000000000158 R9=00007FAFE7A17B70
DLT stderr R10=00007FAFEADBC9C0 R11=00007FB00B000078 R12=00007FAFEADBC890 R13=00007FAFEADBC890
DLT stderr R14=00007FAFEADBC890 R15=00007FAFEADBC850
DLT stderr RIP=00007FB06E642E3C GS=0000 FS=0000 RSP=00007FB052FB2F70
DLT stderr EFlags=0000000000010202 CS=0033 RBP=00007FAFE7AA0120 ERR=0000000000000004
DLT stderr TRAPNO=000000000000000E OLDMASK=0000000000000000 CR2=0000000000000000
DLT stderr xmm0 00007fafe77defb0 (f: 3883790336.000000, d: 6.936360e-310)
DLT stderr xmm1 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm2 00007faff63a42a0 (f: 4131013376.000000, d: 6.936372e-310)
DLT stderr xmm3 00007faff63e8500 (f: 4131292416.000000, d: 6.936372e-310)
DLT stderr xmm4 00007fafe25d50f0 (f: 3797766400.000000, d: 6.936355e-310)
DLT stderr xmm5 00007faff63e8500 (f: 4131292416.000000, d: 6.936372e-310)
DLT stderr xmm6 00007fb00b0001f8 (f: 184549888.000000, d: 6.936389e-310)
DLT stderr xmm7 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm8 00007fafe24596b0 (f: 3796211456.000000, d: 6.936355e-310)
DLT stderr xmm9 00007fb0093065d0 (f: 154166736.000000, d: 6.936387e-310)
DLT stderr xmm10 00007faff6522150 (f: 4132577536.000000, d: 6.936372e-310)
DLT stderr xmm11 00007faff654a1d0 (f: 4132741632.000000, d: 6.936372e-310)
DLT stderr xmm12 00007faff65b0a90 (f: 4133161728.000000, d: 6.936372e-310)
DLT stderr xmm13 00007faff7a34330 (f: 4154671872.000000, d: 6.936373e-310)
DLT stderr xmm14 00007fafe25d2b50 (f: 3797756672.000000, d: 6.936355e-310)
DLT stderr xmm15 00007faff79fdd80 (f: 4154449408.000000, d: 6.936373e-310)
DLT stderr Module=/home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so
DLT stderr Module_base_address=00007FB06E011000
DLT stderr
DLT stderr Method_being_compiled=net/openj9/test/arithmetics/TestArithmeticOperations.testMultiplyPackedDecimal()V
DLT stderr Target=2_90_20190118_457 (Linux 4.4.0-139-generic)
DLT stderr CPU=amd64 (4 logical CPUs) (0x1f2e41000 RAM)
DLT stderr ----------- Stack Backtrace -----------
DLT stderr (0x00007FB06E642E3C [libj9jit29.so+0x631e3c])
DLT stderr (0x00007FB06E60B90D [libj9jit29.so+0x5fa90d])
DLT stderr (0x00007FB06E60B9A7 [libj9jit29.so+0x5fa9a7])
DLT stderr (0x00007FB06E60BA56 [libj9jit29.so+0x5faa56])
DLT stderr (0x00007FB06E60BB6D [libj9jit29.so+0x5fab6d])
DLT stderr (0x00007FB06E60BFCB [libj9jit29.so+0x5fafcb])
DLT stderr (0x00007FB06E6045B0 [libj9jit29.so+0x5f35b0])
DLT stderr (0x00007FB06E6053CB [libj9jit29.so+0x5f43cb])
DLT stderr (0x00007FB06E4064ED [libj9jit29.so+0x3f54ed])
DLT stderr (0x00007FB06E1412DC [libj9jit29.so+0x1302dc])
DLT stderr (0x00007FB06E14219C [libj9jit29.so+0x13119c])
DLT stderr (0x00007FB06FBB4290 [libj9prt29.so+0x20290])
DLT stderr (0x00007FB06E143B69 [libj9jit29.so+0x132b69])
DLT stderr (0x00007FB06E144082 [libj9jit29.so+0x133082])
DLT stderr (0x00007FB06E14499A [libj9jit29.so+0x13399a])
DLT stderr (0x00007FB06E144CCA [libj9jit29.so+0x133cca])
DLT stderr (0x00007FB06E144DA0 [libj9jit29.so+0x133da0])
DLT stderr (0x00007FB06FBB4290 [libj9prt29.so+0x20290])
DLT stderr (0x00007FB06E145249 [libj9jit29.so+0x134249])
DLT stderr (0x00007FB0746992A9 [libj9thr29.so+0xe2a9])
DLT stderr (0x00007FB075AC66BA [libpthread.so.0+0x76ba])
DLT stderr clone+0x6d (0x00007FB07620141D [libc.so.6+0x10741d])
DaaLoadTest_daa2_ConcurrentScavenge_0
DLT stderr Unhandled exception
DLT stderr Type=Segmentation error vmState=0x000507ff
DLT stderr J9Generic_Signal_Number=00000004 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
DLT stderr Handler1=00007F522C21EC50 Handler2=00007F52274892F0 InaccessibleAddress=0000000000000000
DLT stderr RDI=00007F519FCC8750 RSI=00007F519FDBC890 RAX=0000000000000000 RBX=00007F519FCC8750
DLT stderr RCX=0000000000000260 RDX=00007F519EB70120 R8=0000000000000158 R9=00007F519EBD65E0
DLT stderr R10=00007F519FDBC9C0 R11=00007F51C1AE5078 R12=00007F519FDBC890 R13=00007F519FDBC890
DLT stderr R14=00007F519FDBC890 R15=00007F519FDBC850
DLT stderr RIP=00007F5225F18E3C GS=0000 FS=0000 RSP=00007F520A888F70
DLT stderr EFlags=0000000000010202 CS=0033 RBP=00007F519EB70120 ERR=0000000000000004
DLT stderr TRAPNO=000000000000000E OLDMASK=0000000000000000 CR2=0000000000000000
DLT stderr xmm0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
DLT stderr xmm1 00007f519eb12580 (f: 2662409728.000000, d: 6.916352e-310)
DLT stderr xmm2 00007f516c3c42a0 (f: 1815888512.000000, d: 6.916311e-310)
DLT stderr xmm3 00007f516c4322e0 (f: 1816339200.000000, d: 6.916311e-310)
DLT stderr xmm4 00007f519b7b50f0 (f: 2608550144.000000, d: 6.916350e-310)
DLT stderr xmm5 00007f516c4322e0 (f: 1816339200.000000, d: 6.916311e-310)
DLT stderr xmm6 00007f51c1ae51f8 (f: 3249426944.000000, d: 6.916381e-310)
DLT stderr xmm7 00007f519eb12580 (f: 2662409728.000000, d: 6.916352e-310)
DLT stderr xmm8 00007f519b6296b0 (f: 2606929664.000000, d: 6.916350e-310)
DLT stderr xmm9 00007f51970265d0 (f: 2533516800.000000, d: 6.916346e-310)
DLT stderr xmm10 00007f516c552150 (f: 1817518464.000000, d: 6.916311e-310)
DLT stderr xmm11 00007f516c57a1d0 (f: 1817682432.000000, d: 6.916311e-310)
DLT stderr xmm12 00007f516c5d0a90 (f: 1818036864.000000, d: 6.916311e-310)
DLT stderr xmm13 00007f516da44330 (f: 1839481600.000000, d: 6.916312e-310)
DLT stderr xmm14 00007f519b7b2b50 (f: 2608540416.000000, d: 6.916350e-310)
DLT stderr xmm15 00007f516da12f60 (f: 1839280000.000000, d: 6.916312e-310)
DLT stderr Module=/home/jenkins/workspace/Test-sanity.system-JDK11-linux_x86-64_cmprssptrs/openjdkbinary/j2sdk-image/lib/compressedrefs/libj9jit29.so
DLT stderr Module_base_address=00007F52258E7000
DLT stderr
DLT stderr Method_being_compiled=net/openj9/test/arithmetics/TestArithmeticOperations.testMultiplyPackedDecimal()V
DLT stderr Target=2_90_20190118_457 (Linux 4.4.0-139-generic)
DLT stderr CPU=amd64 (4 logical CPUs) (0x1f2e41000 RAM)
DLT stderr ----------- Stack Backtrace -----------
DLT stderr (0x00007F5225F18E3C [libj9jit29.so+0x631e3c])
DLT stderr (0x00007F5225EE190D [libj9jit29.so+0x5fa90d])
DLT stderr (0x00007F5225EE19A7 [libj9jit29.so+0x5fa9a7])
DLT stderr (0x00007F5225EE1A56 [libj9jit29.so+0x5faa56])
DLT stderr (0x00007F5225EE1B6D [libj9jit29.so+0x5fab6d])
DLT stderr (0x00007F5225EE1FCB [libj9jit29.so+0x5fafcb])
DLT stderr (0x00007F5225EDA5B0 [libj9jit29.so+0x5f35b0])
DLT stderr (0x00007F5225EDB3CB [libj9jit29.so+0x5f43cb])
DLT stderr (0x00007F5225CDC4ED [libj9jit29.so+0x3f54ed])
DLT stderr (0x00007F5225A172DC [libj9jit29.so+0x1302dc])
DLT stderr (0x00007F5225A1819C [libj9jit29.so+0x13119c])
DLT stderr (0x00007F522748A290 [libj9prt29.so+0x20290])
DLT stderr (0x00007F5225A19B69 [libj9jit29.so+0x132b69])
DLT stderr (0x00007F5225A1A082 [libj9jit29.so+0x133082])
DLT stderr (0x00007F5225A1A99A [libj9jit29.so+0x13399a])
DLT stderr (0x00007F5225A1ACCA [libj9jit29.so+0x133cca])
DLT stderr (0x00007F5225A1ADA0 [libj9jit29.so+0x133da0])
DLT stderr (0x00007F522748A290 [libj9prt29.so+0x20290])
DLT stderr (0x00007F5225A1B249 [libj9jit29.so+0x134249])
DLT stderr (0x00007F5227DF32A9 [libj9thr29.so+0xe2a9])
DLT stderr (0x00007F522D3A06BA [libpthread.so.0+0x76ba])
DLT stderr clone+0x6d (0x00007F522DADB41D [libc.so.6+0x10741d])
https://ci.eclipse.org/openj9/job/Test-extended.system-JDK11-linux_x86-64_cmprssptrs/149
https://ci.eclipse.org/openj9/job/Test-sanity.system-JDK11-linux_390-64_cmprssptrs/140
https://ci.eclipse.org/openj9/job/Test-extended.system-JDK11-linux_x86-64/143
pshipton
on 18 Jan 2019
@cathyzhyi where did this get to in terms of the fix?
andrewcraik
on 18 Jan 2019
Wasn't able to reproduce. I will take a look again soon since the failure rate seems to be higher now.
cathyzhyi
on 18 Jan 2019
https://ci.eclipse.org/openj9/job/Test-extended.system-JDK11-linux_ppc-64_cmprssptrs_le/148
https://ci.eclipse.org/openj9/job/Test-sanity.system-JDK11-linux_390-64_cmprssptrs/143
https://ci.eclipse.org/openj9/job/Test-extended.system-JDK11-linux_390-64_cmprssptrs/143
pshipton
on 21 Jan 2019
The crashing continues, I'm not going to keep updating with new links.
pshipton
on 22 Jan 2019
Still can't reproduce locally but managed to reproduce on grinder with help from test team and the failure rate is quite high. I still can't manage to pass jit option to grinder to get a tracing log though. Tried to add -Xjit:{net/openj9/test/arithmetics/TestArithmeticOperations.testMultiplyPackedDecimal()V}(log=log,tracefull) to grinder with both double quote and single quote but neither worked.
cathyzhyi
on 23 Jan 2019
@cathyzhyi Can you pass that option using the OPENJ9_JAVA_OPTIONS env variable?
DanHeidinga
on 23 Jan 2019
@DanHeidinga which field in the grinder page can I pass the env variable? I am using the internal grinder page.
cathyzhyi
on 23 Jan 2019
Managed to pass jit tracing option to grinder but test stops failing with tracefull. Need to look at passing log but I don't know where do we keep test results for passing runs. @Mesbah-Alam @llxia Do you have any idea?
cathyzhyi
on 23 Jan 2019
We only archive test results if the test fails. I updated my personal branch to archive test results regardless. For now, please use my personal branch for debugging.
https://github.com/llxia/openjdk-tests/tree/test6
If this feature is important for debugging, maybe we should add it.
llxia
on 24 Jan 2019
If this feature is important for debugging, maybe we should add it.
Seems a grinder option to enable it would be useful.
pshipton
on 24 Jan 2019
Seems a grinder option to enable it would be useful.
Issue created: https://github.com/AdoptOpenJDK/openjdk-tests/issues/829
llxia
on 24 Jan 2019
👍1
@cathyzhyi any update - this is still a 0.12 release blocker so we need to try and figure out the impact and if it is truly release blocking and what we might do about it.
andrewcraik
on 28 Jan 2019
The false transformation is done by inliner which somehow didn't put the call in the slow path block. I still need to add more tracing to figure out the problem.
cathyzhyi
on 28 Jan 2019
This issue has existed since before 0.11.0 [1] but the failure rate appears to have increased [2].
We need to make a determination on whether this is stop ship today so that we'll be able to get the release out by Jan 31.
[1] https://github.com/eclipse/openj9/issues/3340#issuecomment-431171993
[2] https://github.com/eclipse/openj9/issues/3340#issuecomment-455612580
DanHeidinga
on 29 Jan 2019
This is being deferred from 0.12.0 as the failure has only been seen in DAA testing. The code in question is quite general and is exercised by many of the tests. As there is something specific in the DAA case triggering the failure, and the issue has existed since the 0.11.0 release, we believe that shipping with this issue won't affect non-DAA users.
DanHeidinga
on 29 Jan 2019
👍3
Inliner and several local transformations inside Inliner are using visitcount to track visited nodes or call nodes that has already been inlined and the code logic interferes with each other. In this issue, the problematic compiling method has7000+ bytecodes and inlines a lot of calls which makes it more likely to hit the problem. Visitcount has been notorious for causing subtle bugs and is intended to be replaced with the cleaner NodeChecklist. Changing the local transformations to use NodeChecklist can make the failure happen less often. Fixing the global use of visitcount to NodeChecklist in Inliner needs more investigation.
cathyzhyi
on 30 Jan 2019
Marked as comp:jit:x since it's common team who is looking at it.
gita-omr
on 6 Feb 2019
@andrewcraik since testing regularly fails due to this problem, is there something we can do to the test code in order to avoid causing the problem?
pshipton
on 14 Feb 2019
@pshipton the fix is open at OMR - we should just try to get that moved along because it will make all of this go away. There isn't a simple work around.
andrewcraik
on 14 Feb 2019
The OMR fix is fully approved so I've @'d a few committers in the hope someone can merge for us and we can pick-up the fix today (assuming acceptance is flowing)
andrewcraik
on 14 Feb 2019
@andrewcraik what is the fix PR please.
pshipton
on 14 Feb 2019
https://github.com/eclipse/omr/pull/3540 I assume?
pshipton
on 14 Feb 2019
It is mentioned above eclipse/omr#3540
andrewcraik
on 14 Feb 2019
eclipse/omr#3540 is merged and promoted so in theory this is fixed. I'll close it now and re-open if the problem is seen again.
pshipton
on 15 Feb 2019
Was this page helpful?
0 / 5 - 0 ratings
Related issues
andrew-m-leonard
·
52Comments
markehammons
·
63Comments
pshipton
·
64Comments
gacholio
·
80Comments
ChengJin01
·
238Comments
Most helpful comment
This is being deferred from
0.12.0as the failure has only been seen in DAA testing. The code in question is quite general and is exercised by many of the tests. As there is something specific in the DAA case triggering the failure, and the issue has existed since the0.11.0release, we believe that shipping with this issue won't affect non-DAA users.