JITServer crypto failures on ppc64le

[mpirvu]

Recently, JITServer nightly tests started to show some errors for crypto tests

CryptoTests_0
===============================================
===============================================
CryptoTests_0 Start Time: Mon Feb 13 02:00:59 2023 Epoch Time (ms): 1676282459146
variation: NoOptions
JVM_OPTIONS: -XX:+UseJITServer 

TEST SETUP:
JVMSHRC005I No shared class caches available
JVMSHRC005I No shared class caches available
cache cleanup done

TESTING:
Directory "/home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/aqa-tests/TKG/../TKG/output_16762818467204/CryptoTests_0/work" not found: creating
Directory "/home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/aqa-tests/TKG/../TKG/output_16762818467204/CryptoTests_0/report" not found: creating
XML output  to /home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/aqa-tests/TKG/output_16762818467204/CryptoTests_0/work
--------------------------------------------------
TEST: cryptotest/tests/SignatureTests.java
TEST JDK: /home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/openjdkbinary/j2sdk-image

ACTION: build -- Passed. Build successful
REASON: User specified action: run build cryptotest.tests.SignatureTests cryptotest.Settings cryptotest.utils.AlgorithmInstantiationException cryptotest.utils.AlgorithmRunException cryptotest.utils.AlgorithmTest cryptotest.utils.KeysNaiveGenerator cryptotest.utils.TestResult 
TIME:   2.615 seconds
........
ACTION: build -- Passed. All files up to date
REASON: Named class compiled on demand
TIME:   0.0 seconds
messages:
command: build cryptotest.tests.SignatureTests
reason: Named class compiled on demand
elapsed time (seconds): 0.0

ACTION: main -- Error. Program `/home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/openjdkbinary/j2sdk-image/bin/java' timed out (timeout set to 120000ms, elapsed time including timeout handling was 121338ms).
REASON: User specified action: run main/othervm cryptotest.tests.SignatureTests 
TIME:   121.353 seconds
....
TEST RESULT: Error. Program `/home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/openjdkbinary/j2sdk-image/bin/java' timed out (timeout set to 120000ms, elapsed time including timeout handling was 121338ms).
--------------------------------------------------
Test results: passed: 30; error: 1
Report written to /home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/aqa-tests/TKG/output_16762818467204/CryptoTests_0/report/html/report.html
Results written to /home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/aqa-tests/TKG/output_16762818467204/CryptoTests_0/work
Error: Some tests failed or other problems occurred.
-----------------------------------
CryptoTests_0_FAILED

Links to failures:
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal/511/
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk11_j9_extended.functional_ppc64le_linux_jit_Personal/604/
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk11_j9_extended.functional_ppc64le_linux_jit_Personal/603/
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal/510/
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal/509/

[mpirvu]

@SajinaKandy Could you please grind this and see if this is JITServer specific? Thanks

[pshipton]

It's a new test which we are having all sorts of problems with. At least parts of it will be excluded. Looks like you are hitting timeout problems. @llxia fyi more timeouts.

#16710 CryptoTests SunMSCAPI failing on Windows due to Access is denied

#16711 CryptoTests cryptotest/tests/SignatureTests.java timeout in java.math.BigInteger.implSquareToLen

#16712 jdk19 CryptoTests cryptotest/tests/CipherTests.java IllegalBlockSizeException: data should be at least 16 bytes and multiples of 8

[SajinaKandy]

Hopefully fixed by rh-openjdk/CryptoTest#31 as discussed in one of the PRs listed above.

[llxia]

Yes, it fixed IllegalBlockSizeException (see #16712 (comment))

[mpirvu]

More failure from last night:
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk11_j9_extended.functional_ppc64le_linux_jit_Personal/606/tapResults/
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal/513/tapResults/

[SajinaKandy]

I see the following error in the logs:
ACTION: main -- Error. Program /home/jenkins/workspace/Test_openjdk11_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/openjdkbinary/j2sdk-image/bin/java' timed out (timeout set to 120000ms, elapsed time including timeout handling was 120938ms).
So could be related to the timeout as discussed in #16711

[SajinaKandy]

@llxia The Crypto tests failed again with a similar timeout error:
TEST RESULT: Error. Program /home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_1/openjdkbinary/j2sdk-image/bin/java' timed out (timeout set to 240000ms, elapsed time including timeout handling was 241281ms).

https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal/514/tapResults/

[SajinaKandy]

@llxia The Crypto tests keeps failing with timeout:
TEST RESULT: Error. Program /home/jenkins/workspace/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal_testList_0/openjdkbinary/j2sdk-image/bin/java' timed out (timeout set to 240000ms, elapsed time including timeout handling was 241272ms).
https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk17_j9_extended.functional_ppc64le_linux_jit_Personal/544/tapResults/

[llxia]

#16720 CryptoTests timeout in SeedGenerator reading /dev/random