ISPN testsuite fails randomly with OOM or VM is terminated with JDK6 -------------------------------------------------------------------- Key: ISPN-4308 URL: https://issues.jboss.org/browse/ISPN-4308 Project: Infinispan Issue Type: Bug Components: Build process Affects Versions: 7.0.0.Alpha1, 7.0.0.Alpha2, 7.0.0.Alpha3, 7.0.0.Alpha4 Environment: All Reporter: Vitalii Chepeliuk Assignee: Dan Berindei Priority: Critical Labels: testsuite_stability Fix For: 7.0.0.Final *Following error is randomly ocurred with JDK6* {noformat} [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test (default-test) on project infinispan-core: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test failed: There was an error in the forked process [ERROR] java.lang.OutOfMemoryError: Java heap space [ERROR] at java.io.BufferedWriter.<init>(BufferedWriter.java:116) [ERROR] at java.io.BufferedWriter.<init>(BufferedWriter.java:99) [ERROR] at org.testng.internal.Utils.writeFile(Utils.java:190) [ERROR] at org.testng.internal.Utils.writeFile(Utils.java:165) [ERROR] at org.testng.internal.Utils.appendToFile(Utils.java:142) [ERROR] at org.testng.reporters.SuiteHTMLReporter.generateMethodsChronologically(SuiteHTMLReporter.java:442) [ERROR] at org.testng.reporters.SuiteHTMLReporter.generateReport(SuiteHTMLReporter.java:72) [ERROR] at org.testng.TestNG.generateReports(TestNG.java:1089) [ERROR] at org.testng.TestNG.run(TestNG.java:1048) [ERROR] at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:77) [ERROR] at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeMulti(TestNGDirectoryTestSuite.java:189) [ERROR] at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:105) [ERROR] at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:117) [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:94) [ERROR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) [ERROR] at java.lang.reflect.Method.invoke(Method.java:619) [ERROR] at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray2(ReflectionUtils.java:208) [ERROR] at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:159) [ERROR] at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:87) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:95) [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. {noformat} Problem is in surefire plugin as it does not inherit JAVA_OPTS or MAVEN_OPTS. Heap settings should be set through argLine in maven-surefire-plugin. *Other problem is during JVM crashes with IBM JDK6* {noformat} [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Infinispan BOM .................................... SUCCESS [9.628s] [INFO] Infinispan Common Parent .......................... SUCCESS [15.729s] [INFO] Infinispan Commons ................................ SUCCESS [21.244s] [INFO] Infinispan Core ................................... FAILURE [17:33.465s] [INFO] Parent pom for server modules ..................... SKIPPED [INFO] Infinispan Server - Core Components ............... SKIPPED [INFO] Infinispan Query DSL API .......................... SUCCESS [2.886s] [INFO] Parent pom for cachestore modules ................. SKIPPED [INFO] Infinispan JDBC CacheStore ........................ SKIPPED [INFO] Parent pom for the Lucene integration modules ..... SKIPPED [INFO] Infinispan integration with Lucene v.3.x .......... SKIPPED [INFO] Infinispan Lucene Directory Implementation ........ SKIPPED [INFO] Infinispan Query API .............................. SKIPPED [INFO] Infinispan Tools .................................. SKIPPED [INFO] Infinispan Remote Query Client .................... SUCCESS [2.294s] [INFO] Infinispan Remote Query Server .................... SKIPPED [INFO] Infinispan JPA CacheStore ......................... SKIPPED [INFO] Infinispan Hot Rod Server ......................... SKIPPED [INFO] Infinispan Hot Rod Client ......................... SKIPPED [INFO] Parent pom for compatibility modules .............. SUCCESS [0.746s] [INFO] infinispan-custom52x-store ........................ SUCCESS [29.063s] [INFO] infinispan-adaptor52x ............................. SKIPPED [INFO] Infinispan remote CacheStore ...................... SKIPPED [INFO] Infinispan LevelDB CacheStore ..................... SKIPPED [INFO] Infinispan REST Server ............................ SKIPPED [INFO] Infinispan REST CacheStore ........................ SKIPPED [INFO] Infinispan Memcached Server ....................... SKIPPED [INFO] Infinispan RHQ Plugin ............................. SKIPPED [INFO] Infinispan CLI Server ............................. SKIPPED [INFO] Infinispan CLI Client ............................. SKIPPED [INFO] Infinispan CDI support ............................ SKIPPED [INFO] Infinispan AS/EAP modules for library ............. SKIPPED [INFO] Infinispan AS/EAP modules for remote client ....... SKIPPED [INFO] Integration tests: Security Tests ................. SKIPPED [INFO] Integration tests: SecurityManager tests .......... SKIPPED [INFO] Integration tests: AS Module Integration Tests .... SKIPPED [INFO] Integration tests: AS Remote Client Module Integration Tests SKIPPED [INFO] Integration tests: Lucene Directory with Infinispan Query SKIPPED [INFO] Integration tests: Infinispan compatibility mode .. SKIPPED [INFO] Infinispan Distribution ........................... SUCCESS [0.731s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 19:19.507s [INFO] Finished at: Fri May 23 06:57:38 EDT 2014 [INFO] Final Memory: 116M/673M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test (default-test) on project infinispan-core: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test failed: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ? [ERROR] Command was/bin/sh -c cd /qa/local/hudson_workspace/workspace/edg-60-ispn-testsuite-rhel/60d44850/infinispan/core && /qa/tools/opt/x86_64/ibm-java-x86_64-71/jre/bin/java -Xmx1536m -XX:MaxPermSize=384m -Dsun.nio.ch.bugLevel -jar /qa/local/hudson_workspace/workspace/edg-60-ispn-testsuite-rhel/60d44850/infinispan/core/target/surefire/surefirebooter3785551388447098930.jar /qa/local/hudson_workspace/workspace/edg-60-ispn-testsuite-rhel/60d44850/infinispan/core/target/surefire/surefire9185431433470028767tmp /qa/local/hudson_workspace/workspace/edg-60-ispn-testsuite-rhel/60d44850/infinispan/core/target/surefire/surefire_03233110064338503349tmp [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :infinispan-core {noformat} Jenkins job can be found here https://jenkins.mw.lab.eng.bos.redhat.com/hudson/view/JDG/view/FUNC/job/e...