[JBoss JIRA] (JBTM-1638) QA suite failure: connection refused in JTSRemote_DistributedHammerTest3
by Michael Musgrove (JIRA)
[ https://issues.jboss.org/browse/JBTM-1638?page=com.atlassian.jira.plugin.... ]
Michael Musgrove updated JBTM-1638:
-----------------------------------
Fix Version/s: 4.17.6
(was: 4.17.5)
This issue looks similar to the issue that affected DistributedHammerTest2 on master. The fixes for JBTM-1350 should be backported and targeted the next 4.17 point release
> QA suite failure: connection refused in JTSRemote_DistributedHammerTest3
> ------------------------------------------------------------------------
>
> Key: JBTM-1638
> URL: https://issues.jboss.org/browse/JBTM-1638
> Project: JBoss Transaction Manager
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Testing
> Affects Versions: 4.17.4
> Reporter: Gytis Trikleris
> Assignee: Michael Musgrove
> Priority: Minor
> Fix For: 4.17.6
>
>
> http://172.17.131.2/view/Narayana+BlackTie/job/jbossts-EAP61/1760
> client_0_output.txt:
> {code}
> starting command: /usr/local/jdk1.6.0_37/bin/java -classpath dist/jbossts-full-4.17.4.Final-SNAPSHOT/etc/:dist/jbossts-full-4.17.4.Final-SNAPSHOT/lib/*:dist/jbossts-full-4.17.4.Final-SNAPSHOT/lib/ext/*:ext/fscontext.jar:ext/providerutil.jar:ext/jboss-profiler-jvmti.jar:ext/jboss-logging-spi.jar:tests/build/classes/:dbdrivers/selected_dbdriver/*:dbdrivers/DB2_v9.7/db2jcc.jar:dbdrivers/jConnect-6_0/classes/jconn3.jar:dbdrivers/mssql2005_sqljdbc_2.0/enu/sqljdbc4.jar:dbdrivers/mysql-connector-java-5.1.8-bin.jar:dbdrivers/oracle_10_2_0_4/ojdbc14.jar:dbdrivers/postgresql-8.3-605.jdbc4.jar:ext/netty.jar -Dqa.debug=true -Djava.naming.provider.url=file:///tmp -Djava.naming.factory.initial=com.sun.jndi.fscontext.RefFSContextFactory -Dperformanceprofilestore.dir=config/perf_profiles/ -Djdbcprofilestore.dir=config/jdbc_profiles -Dmemorytestprofilestore.dir=config/memory_profiles/ -Dots.server.bindname=value_1 -DCoordinatorEnvironmentBean.maintainHeuristics=NO -DRecoveryEnvironmentBean.recoveryBackoffPeriod=5 -DCoreEnvironmentBean.timeoutFactor=2 -DCoordinatorEnvironmentBean.defaultTimeout=240 -Demma.coverage.out.file=./testoutput/jtsremote/JTSRemote_DistributedHammerTest3/client_0-coverage.ec -DportOffsetId=4 -DObjectStoreBaseDir=/home/hudson/workspace/jbossts-EAP61/qa/testoutput/jtsremote/JTSRemote_DistributedHammerTest3/client_0 -DRecoveryEnvironmentBean.recoveryListener=true com.hp.mwtests.ts.jts.remote.hammer.DistributedHammer3 value_1 value_2
> 2013-04-16 17:55:29,152 err: log4j:WARN No appenders could be found for logger (org.jboss.logging).
> 2013-04-16 17:55:29,152 err: log4j:WARN Please initialize the log4j system properly.
> 2013-04-16 17:55:29,717 out: 0 begin get12
> 2013-04-16 17:55:29,803 out: 0 part1 get12 : true
> 2013-04-16 17:55:29,864 out: 0 part2 get12 : true
> 2013-04-16 17:55:29,928 out: 0 end 0 get12 : true : true : true : 10 : 101
> 2013-04-16 17:55:29,929 out: 0 begin get21
> 2013-04-16 17:55:29,954 out: 0 part1 get21 : true
> 2013-04-16 17:55:29,983 out: 0 part2 get21 : true
> 2013-04-16 17:55:30,034 out: 0 end 0 get21 : true : true : true : 101 : 10
> 2013-04-16 17:55:30,035 out: Tripling the timeout from: 240
> 2013-04-16 17:55:30,035 out: 1 fork
> 2013-04-16 17:55:30,035 out: Tripling the timeout from: 240
> 2013-04-16 17:55:30,036 out: 2 begin incr21
> 2013-04-16 17:55:30,051 out: 3 begin
> 2013-04-16 17:55:30,053 out: 3 begin
> 2013-04-16 17:55:30,070 out: 2 part1 incr21 : true
> 2013-04-16 17:55:30,088 out: 3 begin get21
> 2013-04-16 17:55:30,100 out: 3 begin get12
> 2013-04-16 17:55:30,135 out: 2 part2 incr21 : true
> 2013-04-16 17:55:30,163 out: 2 end 3 part1 get21 : false
> 2013-04-16 17:55:30,167 out: 3 abort 3 get21 : false : false : false : 0 : 0
> 2013-04-16 17:55:30,178 out: 3 3 part1 get12 : false
> 2013-04-16 17:55:30,182 out: 3 abort 3 get12 : false : false : false : 0 : 0
> 2013-04-16 17:55:30,184 out: begin incr21
> 2013-04-16 17:55:30,210 out: 3 begin incr12
> 2013-04-16 17:55:30,222 out: 3 part1 incr21 : false
> 2013-04-16 17:55:30,239 out: 3 abort 3 incr21 : false : false : false : 3
> 2013-04-16 17:55:30,244 out: 3 abort
> 2013-04-16 17:55:30,250 out: 3 part1 incr12 : false
> 2013-04-16 17:55:30,254 out: 3 abort 3 incr12 : false : false : false : -12
> 2013-04-16 17:55:30,258 out: 3 end
> 2013-04-16 17:55:30,258 out: 1 join
> 2013-04-16 17:55:30,258 out: Tripling the timeout from: 720
> 2013-04-16 17:55:30,259 out: Tripling the timeout from: 2160
> 2013-04-16 17:55:30,259 out: 1 begin get12
> 2013-04-16 17:55:30,280 out: 1 part1 get12 : false
> 2013-04-16 17:55:30,284 out: 1 abort 1 get12 : false : false : false : 0 : 0
> 2013-04-16 17:55:30,284 out: Tripling the timeout from: 6480
> 2013-04-16 17:55:30,284 out: Tripling the timeout from: 19440
> 2013-04-16 17:55:30,284 out: 1 begin get12
> 2013-04-16 17:55:30,303 out: 1 part1 get12 : false
> 2013-04-16 17:55:30,311 out: 1 abort 1 get12 : false : false : false : 0 : 0
> 2013-04-16 17:55:30,311 out: Tripling the timeout from: 58320
> 2013-04-16 17:55:30,311 out: 1 begin incr21
> 2013-04-16 17:55:30,337 out: 1 part1 incr21 : false
> 2013-04-16 17:55:30,342 out: 1 abort 1 incr21 : false : false : false : -4
> 2013-04-16 17:55:30,342 out: Tripling the timeout from: 174960
> 2013-04-16 17:55:30,342 out: 1 begin
> 2013-04-16 17:55:30,348 out: 1 begin get12
> 2013-04-16 17:55:30,374 out: 1 part1 get12 : false
> 2013-04-16 17:55:30,378 out: 1 abort 1 get12 : false : false : false : 0 : 0
> 2013-04-16 17:55:30,381 out: 1 end
> 2013-04-16 17:55:30,381 out: Tripling the timeout from: 524880
> 2013-04-16 17:55:30,381 out: Tripling the timeout from: 1574640
> 2013-04-16 17:55:30,382 out: 1 begin
> 2013-04-16 17:55:30,389 out: 1 begin get21
> 2013-04-16 17:55:30,416 out: 2 incr21 : true : true : true : 9
> 2013-04-16 17:55:30,417 out: Tripling the timeout from: 720
> 2013-04-16 17:55:30,417 out: Tripling the timeout from: 2160
> 2013-04-16 17:55:30,417 out: 2 fork
> 2013-04-16 17:55:30,419 out: 4 begin
> 2013-04-16 17:55:30,422 out: 5 begin
> 2013-04-16 17:55:30,426 out: 5 abort
> 2013-04-16 17:55:30,429 out: 1 part1 get21 : true
> 2013-04-16 17:55:30,442 out: 4 begin get21
> 2013-04-16 17:55:30,485 out: 1 part2 get21 : true
> 2013-04-16 17:59:30,420 out: 1 end 2013-04-16 17:59:30,420 [Transaction Reaper] WARN com.arjuna.ats.arjuna - ARJUNA012117: TransactionReaper::check timeout for TX 0:ffffac118314:baef:516d8281:46 in state RUN
> 2013-04-16 17:59:30,422 out: 2013-04-16 17:59:30,420 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012095: Abort of action id 0:ffffac118314:baef:516d8281:46 invoked while multiple threads active within it.
> 2013-04-16 17:59:30,422 out: 2013-04-16 17:59:30,421 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012108: CheckedAction::check - atomic action 0:ffffac118314:baef:516d8281:46 aborting with 1 threads active!
> 2013-04-16 17:59:30,422 out: 2013-04-16 17:59:30,421 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012098: Abort of action id 0:ffffac118314:baef:516d8281:46 invoked while child actions active
> 2013-04-16 17:59:30,422 out: 2013-04-16 17:59:30,421 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012099: Aborting child: 0:ffffac118314:baef:516d8281:47
> 2013-04-16 17:59:30,422 out: 2013-04-16 17:59:30,421 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012095: Abort of action id 0:ffffac118314:baef:516d8281:47 invoked while multiple threads active within it.
> 2013-04-16 17:59:30,422 out: 2013-04-16 17:59:30,421 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012108: CheckedAction::check - atomic action 0:ffffac118314:baef:516d8281:47 aborting with 1 threads active!
> 2013-04-16 17:59:30,920 out: 2013-04-16 17:59:30,920 [Transaction Reaper] WARN com.arjuna.ats.arjuna - ARJUNA012117: TransactionReaper::check timeout for TX 0:ffffac118314:baef:516d8281:46 in state CANCEL
> 2013-04-16 17:59:31,421 out: 2013-04-16 17:59:31,420 [Transaction Reaper] WARN com.arjuna.ats.arjuna - ARJUNA012117: TransactionReaper::check timeout for TX 0:ffffac118314:baef:516d8281:46 in state CANCEL_INTERRUPTED
> 2013-04-16 17:59:31,421 out: 2013-04-16 17:59:31,421 [Transaction Reaper] WARN com.arjuna.ats.arjuna - ARJUNA012120: TransactionReaper::check worker Thread[Transaction Reaper Worker 0,5,main] not responding to interrupt when cancelling TX 0:ffffac118314:baef:516d8281:46 -- worker marked as zombie and TX scheduled for mark-as-rollback
> 2013-04-16 17:59:31,421 out: 2013-04-16 17:59:31,421 [Transaction Reaper] WARN com.arjuna.ats.arjuna - ARJUNA012110: TransactionReaper::check successfuly marked TX 0:ffffac118314:baef:516d8281:46 as rollback only
> 2013-04-16 18:03:28,719 out: 2013-04-16 18:03:28,719 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012092: Nested abort of action 0:ffffac118314:baef:516d8281:47 received TwoPhaseOutcome.FINISH_ERROR from com.arjuna.ats.internal.jts.resources.ResourceRecord
> 2013-04-16 18:03:28,719 err: DistributedHammerWorker3.get21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 208 completed: Maybe
> 2013-04-16 18:03:28,720 out: 4 get21 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,720 out: 2013-04-16 18:03:28,719 [Thread-3] WARN com.arjuna.ats.arjuna - ARJUNA012073: BasicAction.End() - prepare phase of action-id 0:ffffac118314:baef:516d8281:40 failed.
> 2013-04-16 18:03:28,720 out: 2013-04-16 18:03:28,720 [Thread-3] WARN com.arjuna.ats.arjuna - ARJUNA012075: Action Aborting
> 2013-04-16 18:03:28,722 err: org.omg.CORBA.INVALID_TRANSACTION: vmcid: 0x0 minor code: 0 completed: No
> 2013-04-16 18:03:28,722 out: 2 join
> 2013-04-16 18:03:28,723 out: Tripling the timeout from: 6480
> 2013-04-16 18:03:28,723 out: Tripling the timeout from: 19440
> 2013-04-16 18:03:28,723 out: 2 begin incr12
> 2013-04-16 18:03:28,729 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,729 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,729 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,729 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,729 err: at org.omg.CosTransactions._SubtransactionAwareResourceStub.rollback_subtransaction(_SubtransactionAwareResourceStub.java:37)
> 2013-04-16 18:03:28,729 err: at com.arjuna.ats.internal.jts.resources.ResourceRecord.nestedAbort(ResourceRecord.java:274)
> 2013-04-16 18:03:28,729 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2855)
> 2013-04-16 18:03:28,729 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2832)
> 2013-04-16 18:03:28,729 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Abort(BasicAction.java:1917)
> 2013-04-16 18:03:28,729 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1494)
> 2013-04-16 18:03:28,729 err: at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.commit(ArjunaTransactionImple.java:375)
> 2013-04-16 18:03:28,729 err: at com.arjuna.ats.internal.jts.ControlWrapper.commit(ControlWrapper.java:243)
> 2013-04-16 18:03:28,729 err: at com.arjuna.ats.internal.jts.orbspecific.CurrentImple.commit(CurrentImple.java:247)
> 2013-04-16 18:03:28,729 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:274)
> 2013-04-16 18:03:28,729 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:320)
> 2013-04-16 18:03:28,729 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:356)
> 2013-04-16 18:03:28,729 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:54)
> 2013-04-16 18:03:28,729 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,729 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,729 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,729 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,729 err: ... 18 more
> 2013-04-16 18:03:28,729 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,729 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,729 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,729 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,729 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,729 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.incr(_HammerStub.java:18)
> 2013-04-16 18:03:28,729 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.incr12(DistributedHammerWorker3.java:62)
> 2013-04-16 18:03:28,729 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:302)
> 2013-04-16 18:03:28,729 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:54)
> 2013-04-16 18:03:28,729 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,730 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,730 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,730 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,730 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,730 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,730 err: ... 9 more
> 2013-04-16 18:03:28,730 err: DistributedHammerWorker3.incr12: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,730 out: 2 incr12 : false : false : false : -13
> 2013-04-16 18:03:28,730 out: Tripling the timeout from: 58320
> 2013-04-16 18:03:28,730 out: Tripling the timeout from: 174960
> 2013-04-16 18:03:28,730 out: Tripling the timeout from: 524880
> 2013-04-16 18:03:28,730 out: Tripling the timeout from: 1574640
> 2013-04-16 18:03:28,730 out: 2 fork
> 2013-04-16 18:03:28,731 out: 2013-04-16 18:03:28,731 [Thread-3] WARN com.arjuna.ats.arjuna - ARJUNA012092: Nested abort of action 0:ffffac118314:baef:516d8281:40 received TwoPhaseOutcome.FINISH_ERROR from com.arjuna.ats.internal.jts.resources.ResourceRecord
> 2013-04-16 18:03:28,733 out: 4 begin
> 2013-04-16 18:03:28,734 out: 4 end
> 2013-04-16 18:03:28,735 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,735 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,736 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,736 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,736 err: at org.omg.CosTransactions._SubtransactionAwareResourceStub.rollback_subtransaction(_SubtransactionAwareResourceStub.java:37)
> 2013-04-16 18:03:28,736 err: at com.arjuna.ats.internal.jts.resources.ResourceRecord.nestedAbort(ResourceRecord.java:274)
> 2013-04-16 18:03:28,736 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2855)
> 2013-04-16 18:03:28,736 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2832)
> 2013-04-16 18:03:28,736 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.phase2Abort(BasicAction.java:1917)
> 2013-04-16 18:03:28,736 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1494)
> 2013-04-16 18:03:28,736 err: at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.commit(ArjunaTransactionImple.java:375)
> 2013-04-16 18:03:28,736 err: at com.arjuna.ats.internal.jts.ControlWrapper.commit(ControlWrapper.java:243)
> 2013-04-16 18:03:28,736 err: at com.arjuna.ats.internal.jts.orbspecific.CurrentImple.commit(CurrentImple.java:247)
> 2013-04-16 18:03:28,736 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:274)
> 2013-04-16 18:03:28,736 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:320)
> 2013-04-16 18:03:28,736 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:356)
> 2013-04-16 18:03:28,736 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:54)
> 2013-04-16 18:03:28,736 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,736 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,736 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,736 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,736 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,736 err: ... 18 more
> 2013-04-16 18:03:28,736 err: DistributedHammerWorker3.get21: org.omg.CORBA.TRANSACTION_ROLLEDBACK: vmcid: 0xc000 minor code: 849 completed: No
> 2013-04-16 18:03:28,738 out: 2013-04-16 18:03:28,735 [Thread-3] WARN com.arjuna.ats.arjuna - ARJUNA012092: Nested abort of action 0:ffffac118314:baef:516d8281:40 received TwoPhaseOutcome.FINISH_ERROR from com.arjuna.ats.internal.jts.resources.ResourceRecord
> 2013-04-16 18:03:28,738 out: 1 get21 : false : false : false : 110 : 1
> 2013-04-16 18:03:28,738 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,738 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,738 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,738 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,738 err: at org.omg.CosTransactions._ResourceStub.rollback(_ResourceStub.java:42)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.internal.jts.resources.ResourceRecord.topLevelAbort(ResourceRecord.java:391)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2853)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2832)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.Abort(BasicAction.java:1625)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.rollback(ArjunaTransactionImple.java:482)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.internal.jts.ControlWrapper.rollback(ControlWrapper.java:282)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.internal.jts.ControlWrapper.cancel(ControlWrapper.java:182)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.arjuna.coordinator.TransactionReaper.doCancellations(TransactionReaper.java:370)
> 2013-04-16 18:03:28,738 err: at com.arjuna.ats.internal.arjuna.coordinator.ReaperWorkerThread.run(ReaperWorkerThread.java:78)
> 2013-04-16 18:03:28,738 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,738 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,738 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,738 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,738 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,738 err: ... 15 more
> 2013-04-16 18:03:28,739 out: 2013-04-16 18:03:28,738 [Transaction Reaper Worker 0] WARN com.arjuna.ats.jts - ARJUNA022230: ResourceRecord.topLevelAbort caught exception
> 2013-04-16 18:03:28,739 out: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,739 out: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,739 out: at org.omg.CosTransactions._ResourceStub.rollback(_ResourceStub.java:42)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.internal.jts.resources.ResourceRecord.topLevelAbort(ResourceRecord.java:391)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2853)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2832)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.Abort(BasicAction.java:1625)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.rollback(ArjunaTransactionImple.java:482)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.internal.jts.ControlWrapper.rollback(ControlWrapper.java:282)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.internal.jts.ControlWrapper.cancel(ControlWrapper.java:182)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.arjuna.coordinator.TransactionReaper.doCancellations(TransactionReaper.java:370)
> 2013-04-16 18:03:28,739 out: at com.arjuna.ats.internal.arjuna.coordinator.ReaperWorkerThread.run(ReaperWorkerThread.java:78)
> 2013-04-16 18:03:28,739 out: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,739 out: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,739 out: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,739 out: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,739 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,739 out: ... 15 more
> 2013-04-16 18:03:28,740 out: 2013-04-16 18:03:28,740 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012091: Top-level abort of action 0:ffffac118314:baef:516d8281:46 received TwoPhaseOutcome.FINISH_ERROR from com.arjuna.ats.internal.jts.resources.ResourceRecord
> 2013-04-16 18:03:28,741 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,741 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,741 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,741 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,741 err: at org.omg.CosTransactions._ResourceStub.rollback(_ResourceStub.java:42)
> 2013-04-16 18:03:28,741 err: at com.arjuna.ats.internal.jts.resources.ResourceRecord.topLevelAbort(ResourceRecord.java:391)
> 2013-04-16 18:03:28,741 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2853)
> 2013-04-16 18:03:28,741 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2832)
> 2013-04-16 18:03:28,741 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.Abort(BasicAction.java:1625)
> 2013-04-16 18:03:28,741 err: at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.rollback(ArjunaTransactionImple.java:482)
> 2013-04-16 18:03:28,741 err: at com.arjuna.ats.internal.jts.ControlWrapper.rollback(ControlWrapper.java:282)
> 2013-04-16 18:03:28,741 err: at com.arjuna.ats.internal.jts.orbspecific.CurrentImple.rollback(CurrentImple.java:321)
> 2013-04-16 18:03:28,741 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:359)
> 2013-04-16 18:03:28,741 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:54)
> 2013-04-16 18:03:28,741 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,741 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,741 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,741 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,741 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,741 err: ... 15 more
> 2013-04-16 18:03:28,742 out: 2013-04-16 18:03:28,742 [Transaction Reaper Worker 0] WARN com.arjuna.ats.arjuna - ARJUNA012113: TransactionReaper::doCancellations worker Thread[Transaction Reaper Worker 0,5,main] missed interrupt when cancelling TX 0:ffffac118314:baef:516d8281:46 -- exiting as zombie (zombie count decremented to 0)
> 2013-04-16 18:03:28,742 out: 2013-04-16 18:03:28,742 [Thread-3] WARN com.arjuna.ats.jts - ARJUNA022230: ResourceRecord.topLevelAbort caught exception
> 2013-04-16 18:03:28,742 out: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,742 out: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,742 out: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,742 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,742 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,743 out: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,743 out: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,743 out: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,743 out: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,743 out: at org.omg.CosTransactions._ResourceStub.rollback(_ResourceStub.java:42)
> 2013-04-16 18:03:28,743 out: at com.arjuna.ats.internal.jts.resources.ResourceRecord.topLevelAbort(ResourceRecord.java:391)
> 2013-04-16 18:03:28,743 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2853)
> 2013-04-16 18:03:28,743 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2832)
> 2013-04-16 18:03:28,743 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.Abort(BasicAction.java:1625)
> 2013-04-16 18:03:28,743 out: at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.rollback(ArjunaTransactionImple.java:482)
> 2013-04-16 18:03:28,743 out: at com.arjuna.ats.internal.jts.ControlWrapper.rollback(ControlWrapper.java:282)
> 2013-04-16 18:03:28,743 out: at com.arjuna.ats.internal.jts.orbspecific.CurrentImple.rollback(CurrentImple.java:321)
> 2013-04-16 18:03:28,743 out: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:359)
> 2013-04-16 18:03:28,743 out: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:54)
> 2013-04-16 18:03:28,743 out: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,743 out: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,743 out: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,743 out: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,743 out: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,743 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,743 out: ... 15 more
> 2013-04-16 18:03:28,743 out: 2013-04-16 18:03:28,743 [Thread-3] WARN com.arjuna.ats.arjuna - ARJUNA012091: Top-level abort of action 0:ffffac118314:baef:516d8281:3f received TwoPhaseOutcome.FINISH_ERROR from com.arjuna.ats.internal.jts.resources.ResourceRecord
> 2013-04-16 18:03:28,743 out: 5 begin
> 2013-04-16 18:03:28,754 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,754 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,754 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,754 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,754 err: at org.omg.CosTransactions._ResourceStub.rollback(_ResourceStub.java:42)
> 2013-04-16 18:03:28,754 err: at com.arjuna.ats.internal.jts.resources.ResourceRecord.topLevelAbort(ResourceRecord.java:391)
> 2013-04-16 18:03:28,754 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2853)
> 2013-04-16 18:03:28,754 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2832)
> 2013-04-16 18:03:28,754 err: at com.arjuna.ats.arjuna.coordinator.BasicAction.Abort(BasicAction.java:1625)
> 2013-04-16 18:03:28,754 err: at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.rollback(ArjunaTransactionImple.java:482)
> 2013-04-16 18:03:28,754 err: at com.arjuna.ats.internal.jts.ControlWrapper.rollback(ControlWrapper.java:282)
> 2013-04-16 18:03:28,754 err: at com.arjuna.ats.internal.jts.orbspecific.CurrentImple.rollback(CurrentImple.java:321)
> 2013-04-16 18:03:28,754 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:359)
> 2013-04-16 18:03:28,754 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:54)
> 2013-04-16 18:03:28,754 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,754 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,754 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,754 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,754 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,754 err: ... 15 more
> 2013-04-16 18:03:28,755 out: 5 2013-04-16 18:03:28,754 [Thread-3] WARN com.arjuna.ats.jts - ARJUNA022230: ResourceRecord.topLevelAbort caught exception
> 2013-04-16 18:03:28,755 out: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,755 out: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,755 out: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,755 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,755 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,755 out: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,755 out: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,755 out: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,755 out: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,755 out: at org.omg.CosTransactions._ResourceStub.rollback(_ResourceStub.java:42)
> 2013-04-16 18:03:28,755 out: at com.arjuna.ats.internal.jts.resources.ResourceRecord.topLevelAbort(ResourceRecord.java:391)
> 2013-04-16 18:03:28,755 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2853)
> 2013-04-16 18:03:28,755 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.doAbort(BasicAction.java:2832)
> 2013-04-16 18:03:28,755 out: at com.arjuna.ats.arjuna.coordinator.BasicAction.Abort(BasicAction.java:1625)
> 2013-04-16 18:03:28,755 out: at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.rollback(ArjunaTransactionImple.java:482)
> 2013-04-16 18:03:28,756 out: at com.arjuna.ats.internal.jts.ControlWrapper.rollback(ControlWrapper.java:282)
> 2013-04-16 18:03:28,756 out: at com.arjuna.ats.internal.jts.orbspecific.CurrentImple.rollback(CurrentImple.java:321)
> 2013-04-16 18:03:28,756 out: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:359)
> 2013-04-16 18:03:28,756 out: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:54)
> 2013-04-16 18:03:28,756 out: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,756 out: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,756 out: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,756 out: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,756 out: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,756 out: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,756 out: ... 15 more
> 2013-04-16 18:03:28,756 out: 2013-04-16 18:03:28,755 [Thread-3] WARN com.arjuna.ats.arjuna - ARJUNA012091: Top-level abort of action 0:ffffac118314:baef:516d8281:3f received TwoPhaseOutcome.FINISH_ERROR from com.arjuna.ats.internal.jts.resources.ResourceRecord
> 2013-04-16 18:03:28,756 out: 1 abort
> 2013-04-16 18:03:28,757 out: Tripling the timeout from: 4723920
> 2013-04-16 18:03:28,757 out: 1 begin
> 2013-04-16 18:03:28,757 out: 1 abort
> 2013-04-16 18:03:28,757 out: Tripling the timeout from: 14171760
> 2013-04-16 18:03:28,757 out: 1 begin incr12
> 2013-04-16 18:03:28,758 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,758 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,758 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,758 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,758 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.incr(_HammerStub.java:18)
> 2013-04-16 18:03:28,758 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.incr12(DistributedHammerWorker3.java:62)
> 2013-04-16 18:03:28,758 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:302)
> 2013-04-16 18:03:28,758 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:54)
> 2013-04-16 18:03:28,758 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,758 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,758 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,758 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,758 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,758 err: ... 9 more
> 2013-04-16 18:03:28,759 err: DistributedHammerWorker3.incr12: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,759 out: 1 incr12 : false : false : false : -3
> 2013-04-16 18:03:28,759 out: begin get21
> 2013-04-16 18:03:28,760 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,760 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,760 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,760 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,760 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,760 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:249)
> 2013-04-16 18:03:28,760 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:320)
> 2013-04-16 18:03:28,760 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:63)
> 2013-04-16 18:03:28,760 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,760 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,760 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,760 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,760 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,760 err: ... 9 more
> 2013-04-16 18:03:28,760 err: DistributedHammerWorker3.get21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,760 out: 5 get21 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,761 out: Tripling the timeout from: 42515280
> 2013-04-16 18:03:28,761 out: 1 fork
> 2013-04-16 18:03:28,762 out: 5 end
> 2013-04-16 18:03:28,762 out: 2 join
> 2013-04-16 18:03:28,762 out: Tripling the timeout from: 4723920
> 2013-04-16 18:03:28,762 out: 2 fork
> 2013-04-16 18:03:28,766 out: 6 begin
> 2013-04-16 18:03:28,766 out: 7 begin
> 2013-04-16 18:03:28,772 out: 6 begin
> 2013-04-16 18:03:28,773 out: 8 begin
> 2013-04-16 18:03:28,784 out: 7 begin get21
> 2013-04-16 18:03:28,784 out: 6 begin incr21
> 2013-04-16 18:03:28,784 out: 6 begin get12
> 2013-04-16 18:03:28,785 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,785 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,785 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,785 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,785 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,785 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get12(DistributedHammerWorker3.java:187)
> 2013-04-16 18:03:28,785 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:314)
> 2013-04-16 18:03:28,785 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:62)
> 2013-04-16 18:03:28,785 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,785 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,785 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,785 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,785 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,785 err: ... 9 more
> 2013-04-16 18:03:28,785 err: DistributedHammerWorker3.get12: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,785 out: 6 get12 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,787 out: 6 end
> 2013-04-16 18:03:28,788 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,788 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,788 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,788 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,788 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,788 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:249)
> 2013-04-16 18:03:28,788 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:320)
> 2013-04-16 18:03:28,788 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:63)
> 2013-04-16 18:03:28,788 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,788 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,788 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,788 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,788 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,788 err: ... 9 more
> 2013-04-16 18:03:28,789 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,789 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,789 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,789 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,789 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.incr(_HammerStub.java:18)
> 2013-04-16 18:03:28,789 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.incr21(DistributedHammerWorker3.java:125)
> 2013-04-16 18:03:28,789 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:308)
> 2013-04-16 18:03:28,789 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:62)
> 2013-04-16 18:03:28,789 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,789 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,789 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,789 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,789 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,789 err: ... 9 more
> 2013-04-16 18:03:28,789 err: DistributedHammerWorker3.incr21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,790 out: 6 incr21 : false : false : false : -14
> 2013-04-16 18:03:28,790 err: DistributedHammerWorker3.get21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,790 out: 6 abort
> 2013-04-16 18:03:28,790 out: 1 join
> 2013-04-16 18:03:28,790 out: Tripling the timeout from: 127545840
> 2013-04-16 18:03:28,791 out: Tripling the timeout from: 382637520
> 2013-04-16 18:03:28,791 out: 1 fork
> 2013-04-16 18:03:28,791 out: 8 begin get21
> 2013-04-16 18:03:28,791 out: 7 get21 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,792 out: 7 end
> 2013-04-16 18:03:28,792 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,792 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,792 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,792 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,792 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,792 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:249)
> 2013-04-16 18:03:28,792 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:320)
> 2013-04-16 18:03:28,792 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:62)
> 2013-04-16 18:03:28,792 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,792 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,792 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,792 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,792 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,792 err: ... 9 more
> 2013-04-16 18:03:28,793 err: DistributedHammerWorker3.get21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,793 out: 8 get21 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,802 out: 9 begin
> 2013-04-16 18:03:28,803 out: 7 begin
> 2013-04-16 18:03:28,811 out: 9 begin get12
> 2013-04-16 18:03:28,811 out: 8 begin get21
> 2013-04-16 18:03:28,812 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,812 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,812 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,812 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,812 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,812 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:249)
> 2013-04-16 18:03:28,812 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:320)
> 2013-04-16 18:03:28,812 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:63)
> 2013-04-16 18:03:28,812 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,812 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,812 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,812 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,812 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,812 err: ... 9 more
> 2013-04-16 18:03:28,813 out: 7 begin
> 2013-04-16 18:03:28,813 err: DistributedHammerWorker3.get21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,814 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,814 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,814 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,814 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,814 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,814 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get12(DistributedHammerWorker3.java:187)
> 2013-04-16 18:03:28,814 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:314)
> 2013-04-16 18:03:28,814 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:62)
> 2013-04-16 18:03:28,814 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,814 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,814 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,814 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,814 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,814 err: ... 9 more
> 2013-04-16 18:03:28,814 err: DistributedHammerWorker3.get12: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,814 out: 8 get21 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,815 out: 8 end
> 2013-04-16 18:03:28,815 out: 9 get12 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,819 out: 2 join
> 2013-04-16 18:03:28,819 out: Tripling the timeout from: 14171760
> 2013-04-16 18:03:28,819 out: Tripling the timeout from: 42515280
> 2013-04-16 18:03:28,819 out: 2 fork
> 2013-04-16 18:03:28,826 out: 10 begin
> 2013-04-16 18:03:28,828 out: 8 begin
> 2013-04-16 18:03:28,834 out: 9 begin get21
> 2013-04-16 18:03:28,835 out: 7 begin get12
> 2013-04-16 18:03:28,835 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,835 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,835 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,835 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,835 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,835 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,835 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,835 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,835 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,835 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,835 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,836 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,836 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:249)
> 2013-04-16 18:03:28,836 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:320)
> 2013-04-16 18:03:28,836 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:63)
> 2013-04-16 18:03:28,836 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,836 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,836 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,836 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,836 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,836 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,836 err: ... 9 more
> 2013-04-16 18:03:28,836 err: DistributedHammerWorker3.get21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,836 out: 9 get21 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,836 out: 9 end
> 2013-04-16 18:03:28,837 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,837 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,837 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,837 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,837 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,837 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get12(DistributedHammerWorker3.java:187)
> 2013-04-16 18:03:28,837 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:314)
> 2013-04-16 18:03:28,837 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:356)
> 2013-04-16 18:03:28,837 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:62)
> 2013-04-16 18:03:28,837 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,837 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,837 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,837 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,837 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,837 err: ... 10 more
> 2013-04-16 18:03:28,841 err: DistributedHammerWorker3.get12: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,841 out: 7 get12 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,844 out: 10 begin
> 2013-04-16 18:03:28,852 out: 8 begin get21
> 2013-04-16 18:03:28,853 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,853 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,853 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,853 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,853 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,853 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:249)
> 2013-04-16 18:03:28,853 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:320)
> 2013-04-16 18:03:28,853 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:62)
> 2013-04-16 18:03:28,853 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,853 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,853 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,853 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,853 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,853 err: ... 9 more
> 2013-04-16 18:03:28,853 err: DistributedHammerWorker3.get21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,853 out: 8 get21 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,854 out: 8 abort
> 2013-04-16 18:03:28,858 out: 7 begin incr21
> 2013-04-16 18:03:28,858 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,858 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,858 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,858 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,858 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,858 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,858 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,858 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,858 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,858 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,858 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,858 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.incr(_HammerStub.java:18)
> 2013-04-16 18:03:28,858 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.incr21(DistributedHammerWorker3.java:125)
> 2013-04-16 18:03:28,858 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:308)
> 2013-04-16 18:03:28,858 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:357)
> 2013-04-16 18:03:28,858 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:62)
> 2013-04-16 18:03:28,858 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,858 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,859 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,859 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,859 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,859 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,859 err: ... 10 more
> 2013-04-16 18:03:28,860 err: DistributedHammerWorker3.incr21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,860 out: 10 begin incr12
> 2013-04-16 18:03:28,861 out: 7 incr21 : false : false : false : -12
> 2013-04-16 18:03:28,861 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,862 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,862 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,862 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,862 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.incr(_HammerStub.java:18)
> 2013-04-16 18:03:28,862 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.incr12(DistributedHammerWorker3.java:62)
> 2013-04-16 18:03:28,862 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:302)
> 2013-04-16 18:03:28,862 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:357)
> 2013-04-16 18:03:28,862 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:62)
> 2013-04-16 18:03:28,862 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,862 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,862 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,862 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,862 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,862 err: ... 10 more
> 2013-04-16 18:03:28,862 out: 7 abort
> 2013-04-16 18:03:28,863 err: DistributedHammerWorker3.incr12: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,863 out: 10 incr12 : false : false : false : -2
> 2013-04-16 18:03:28,865 out: 10 abort
> 2013-04-16 18:03:28,866 out: 10 end
> 2013-04-16 18:03:28,866 out: 2 join
> 2013-04-16 18:03:28,866 out: Tripling the timeout from: 127545840
> 2013-04-16 18:03:28,866 out: Tripling the timeout from: 382637520
> 2013-04-16 18:03:28,867 err: Exception in thread "Thread-4" org.omg.CORBA.BAD_PARAM: vmcid: 0xa000 minor code: 4041 completed: No
> 2013-04-16 18:03:28,867 err: at com.arjuna.ats.internal.jts.orbspecific.CurrentImple.set_timeout(CurrentImple.java:443)
> 2013-04-16 18:03:28,867 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:52)
> 2013-04-16 18:03:28,867 out: Tripling the timeout from: 1147912560
> 2013-04-16 18:03:28,872 out: 7 begin incr21
> 2013-04-16 18:03:28,872 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,872 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,872 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,872 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,872 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.incr(_HammerStub.java:18)
> 2013-04-16 18:03:28,872 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.incr21(DistributedHammerWorker3.java:125)
> 2013-04-16 18:03:28,872 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.randomOperation(DistributedHammerWorker3.java:308)
> 2013-04-16 18:03:28,872 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3a.run(DHThreadObject3a.java:63)
> 2013-04-16 18:03:28,872 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,872 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,872 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,872 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,872 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,872 err: ... 9 more
> 2013-04-16 18:03:28,873 err: DistributedHammerWorker3.incr21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,873 out: 7 incr21 : false : false : false : 4
> 2013-04-16 18:03:28,873 out: 7 abort
> 2013-04-16 18:03:28,874 out: 1 join
> 2013-04-16 18:03:28,874 err: Exception in thread "Thread-3" org.omg.CORBA.BAD_PARAM: vmcid: 0xa000 minor code: 4041 completed: No
> 2013-04-16 18:03:28,874 err: at com.arjuna.ats.internal.jts.orbspecific.CurrentImple.set_timeout(CurrentImple.java:443)
> 2013-04-16 18:03:28,874 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DHThreadObject3b.run(DHThreadObject3b.java:52)
> 2013-04-16 18:03:28,874 out: Tripling the timeout from: 1147912560
> 2013-04-16 18:03:28,874 out: 0 begin get12
> 2013-04-16 18:03:28,876 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,876 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,876 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,876 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,876 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,876 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,876 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,876 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,876 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,876 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,876 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,876 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,876 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get12(DistributedHammerWorker3.java:187)
> 2013-04-16 18:03:28,876 err: at com.hp.mwtests.ts.jts.remote.hammer.DistributedHammer3.main(DistributedHammer3.java:106)
> 2013-04-16 18:03:28,877 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,877 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,877 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,877 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,877 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,877 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,877 err: ... 8 more
> 2013-04-16 18:03:28,877 err: DistributedHammerWorker3.get12: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,877 out: 0 get12 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,879 out: 0 begin get21
> 2013-04-16 18:03:28,880 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,880 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,880 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,880 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,880 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,880 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get21(DistributedHammerWorker3.java:249)
> 2013-04-16 18:03:28,880 err: at com.hp.mwtests.ts.jts.remote.hammer.DistributedHammer3.main(DistributedHammer3.java:107)
> 2013-04-16 18:03:28,880 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,880 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,880 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,880 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,880 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,880 err: ... 8 more
> 2013-04-16 18:03:28,880 err: DistributedHammerWorker3.get21: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,880 out: 0 get21 : false : false : false : 0 : 0
> 2013-04-16 18:03:28,886 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,886 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 48872"
> 2013-04-16 18:03:28,886 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,886 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,886 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,886 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get1(DistributedHammerWorker3.java:466)
> 2013-04-16 18:03:28,886 err: at com.hp.mwtests.ts.jts.remote.hammer.DistributedHammer3.main(DistributedHammer3.java:112)
> 2013-04-16 18:03:28,886 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,886 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,886 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,886 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,886 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,886 err: ... 8 more
> 2013-04-16 18:03:28,886 err: DistributedHammerWorker1.get1: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,890 err: Apr 16, 2013 6:03:28 PM com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl <init>
> 2013-04-16 18:03:28,890 err: WARNING: "IOP00410201: (COMM_FAILURE) Connection failure: socketType: IIOP_CLEAR_TEXT; hostname: 172.17.131.20; port: 38267"
> 2013-04-16 18:03:28,891 err: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2200)
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.logging.ORBUtilSystemException.connectFailure(ORBUtilSystemException.java:2221)
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:205)
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:218)
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.transport.SocketOrChannelContactInfoImpl.createConnection(SocketOrChannelContactInfoImpl.java:101)
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.protocol.CorbaClientRequestDispatcherImpl.beginRequest(CorbaClientRequestDispatcherImpl.java:171)
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.protocol.CorbaClientDelegateImpl.request(CorbaClientDelegateImpl.java:118)
> 2013-04-16 18:03:28,891 err: at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:431)
> 2013-04-16 18:03:28,891 err: at com.hp.mwtests.ts.jts.TestModule._HammerStub.get(_HammerStub.java:60)
> 2013-04-16 18:03:28,891 err: at com.hp.mwtests.ts.jts.orbspecific.resources.DistributedHammerWorker3.get2(DistributedHammerWorker3.java:496)
> 2013-04-16 18:03:28,891 err: at com.hp.mwtests.ts.jts.remote.hammer.DistributedHammer3.main(DistributedHammer3.java:112)
> 2013-04-16 18:03:28,891 err: Caused by: java.net.ConnectException: Connection refused
> 2013-04-16 18:03:28,891 err: at sun.nio.ch.Net.connect(Native Method)
> 2013-04-16 18:03:28,891 err: at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
> 2013-04-16 18:03:28,891 err: at java.nio.channels.SocketChannel.open(SocketChannel.java:146)
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.transport.DefaultSocketFactoryImpl.createSocket(DefaultSocketFactoryImpl.java:60)
> 2013-04-16 18:03:28,891 err: at com.sun.corba.se.impl.transport.SocketOrChannelConnectionImpl.<init>(SocketOrChannelConnectionImpl.java:188)
> 2013-04-16 18:03:28,891 err: ... 8 more
> 2013-04-16 18:03:28,891 err: DistributedHammerWorker1.get2: org.omg.CORBA.COMM_FAILURE: vmcid: SUN minor code: 201 completed: No
> 2013-04-16 18:03:28,891 out: failing: assertionFailed
> 2013-04-16 18:03:28,891 out: Failed
> 2013-04-16 18:03:28,891 out: failing: assertionFailed
> 2013-04-16 18:03:28,891 out: Failed
> 2013-04-16 18:03:28,892 out: Passed
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 5 months
[JBoss JIRA] (JBTM-1611) Failing qa testcase org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery09, 10, 12 with jacorb and HornetQ object store enabled
by Michael Musgrove (JIRA)
[ https://issues.jboss.org/browse/JBTM-1611?page=com.atlassian.jira.plugin.... ]
Michael Musgrove updated JBTM-1611:
-----------------------------------
Status: Pull Request Sent (was: Pull Request Sent)
Git Pull Request: https://github.com/jbosstm/narayana/pull/357
Pull request for the 4.17 branch
> Failing qa testcase org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery09,10,12 with jacorb and HornetQ object store enabled
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: JBTM-1611
> URL: https://issues.jboss.org/browse/JBTM-1611
> Project: JBoss Transaction Manager
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Testing
> Affects Versions: 4.17.3
> Reporter: Ondřej Chaloupka
> Assignee: Michael Musgrove
> Fix For: 4.17.5, 5.0.0.M4
>
> Attachments: 0001-JBTM-1611-Make-recovery-passes-configurable.patch
>
> Original Estimate: 3 days
> Remaining Estimate: 3 days
>
> During testing EAP 6.1.0.ER3 I'm hitting problem on QA tests of narayana project for branch 4.17 when running qa tests with jacorb and hornetq object store (happening for NIO and AIO).
> Tests which are failing:
> org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery09
> - CrashRecovery09_Test01
> - CrashRecovery09_Test03
> - CrashRecovery09_Test05
> org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery10
> - CrashRecovery10_Test01
> - CrashRecovery10_Test03
> - CrashRecovery10_Test05
> org.jboss.jbossts.qa.junit.testgroup.TestGroup_crashrecovery12
> - CrashRecovery12_Test03
> - CrashRecovery12_Test06
> Detailed log could be found in job:
> https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/eap-61-jbossts-qa-te...
> I was trying to get more info on the test CrashRecovery09 but I can say just that the value honlder has value 0 instead of 1 on org.jboss.jbossts.qa.CrashRecovery09Clients.Client01a (line 84).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 5 months
[JBoss JIRA] (JBTM-1790) If xaNodeName is not set then a nullpointerexception is raised rather than an informative exception
by Gytis Trikleris (JIRA)
[ https://issues.jboss.org/browse/JBTM-1790?page=com.atlassian.jira.plugin.... ]
Work on JBTM-1790 stopped by Gytis Trikleris.
> If xaNodeName is not set then a nullpointerexception is raised rather than an informative exception
> ---------------------------------------------------------------------------------------------------
>
> Key: JBTM-1790
> URL: https://issues.jboss.org/browse/JBTM-1790
> Project: JBoss Transaction Manager
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: JTA, JTS
> Affects Versions: 5.0.0.M3
> Reporter: Tom Jenkinson
> Assignee: Gytis Trikleris
> Fix For: 5.0.0.M4
>
> Original Estimate: 30 minutes
> Remaining Estimate: 30 minutes
>
> TxControl needs a static initialization block reintroducing/similar such that if CoordinatorEnvironmentBean::getNodeIdentifier() returns null it should log a fatal error and fail to initialize.
> Currently for JTS an obscure stack trace is printed:
> [INFO] --- exec-maven-plugin:1.2.1:java (default-cli) @ iiop-jts-client ---
> Jun 21, 2013 6:08:11 PM com.arjuna.orbportability.internal.utils.InitLoader createInstance
> INFO: ARJUNA021027: Loading PreInitLoader class - com.arjuna.ats.internal.jts.context.ContextPropagationManager
> Jun 21, 2013 6:08:11 PM org.jacorb.config.JacORBConfiguration init
> WARNING: jacorb.home unset! Will use '.'
> Jun 21, 2013 6:08:11 PM org.jacorb.config.JacORBConfiguration init
> WARNING: File ./jacorb.properties for configuration jacorb not found
> Jun 21, 2013 6:08:11 PM org.jacorb.config.JacORBConfiguration init
> INFO: configuration jacorb loaded from classpath
> Jun 21, 2013 6:08:11 PM com.arjuna.orbportability.internal.utils.InitLoader createInstance
> INFO: ARJUNA021027: Loading PostInitLoader class - com.arjuna.ats.internal.jts.recovery.RecoveryInit
> Jun 21, 2013 6:08:11 PM com.arjuna.orbportability.internal.utils.InitLoader createInstance
> INFO: ARJUNA021027: Loading PostInitLoader class - com.arjuna.ats.jts.utils.ORBSetup
> Jun 21, 2013 6:08:11 PM com.arjuna.ats.arjuna.recovery.TransactionStatusManager addService
> INFO: ARJUNA012163: Starting service com.arjuna.ats.arjuna.recovery.ActionStatusService on port 43728
> Jun 21, 2013 6:08:11 PM com.arjuna.ats.internal.arjuna.recovery.TransactionStatusManagerItem <init>
> INFO: ARJUNA012337: TransactionStatusManagerItem host: 127.0.0.1 port: 43728
> Jun 21, 2013 6:08:11 PM com.arjuna.ats.arjuna.recovery.TransactionStatusManager start
> INFO: ARJUNA012170: TransactionStatusManager started on port 43728 and host 127.0.0.1 with service com.arjuna.ats.arjuna.recovery.ActionStatusService
> java.rmi.RemoteException: CORBA UNKNOWN 30001 No; nested exception is:
> org.omg.CORBA.UNKNOWN: java.lang.NullPointerException vmcid: 0x7000 minor code: 1329 completed: No
> at com.sun.corba.se.impl.javax.rmi.CORBA.Util.mapSystemException(Util.java:315)
> at javax.rmi.CORBA.Util.mapSystemException(Util.java:83)
> at com.sun.corba.se.impl.presentation.rmi.StubInvocationHandlerImpl.invoke(StubInvocationHandlerImpl.java:164)
> at com.sun.corba.se.spi.orbutil.proxy.CompositeInvocationHandlerImpl.invoke(CompositeInvocationHandlerImpl.java:79)
> at com.sun.proxy.$Proxy7.hello(Unknown Source)
> at org.jboss.qa.IIOPTesting.main(IIOPTesting.java:27)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:297)
> at java.lang.Thread.run(Thread.java:722)
> Caused by: org.omg.CORBA.UNKNOWN: java.lang.NullPointerException vmcid: 0x7000 minor code: 1329 completed: No
> at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.get_txcontext(ArjunaTransactionImple.java:1300)
> at com.arjuna.ArjunaOTS.ArjunaTransactionPOATie.get_txcontext(ArjunaTransactionPOATie.java:129)
> at com.arjuna.ArjunaOTS._ArjunaTransactionStub.get_txcontext(_ArjunaTransactionStub.java:788)
> at com.arjuna.ats.jts.orbspecific.jacorb.interceptors.interposition.InterpositionClientRequestInterceptorImpl.send_request(InterpositionClientRequestInterceptorImpl.java:196)
> at org.jacorb.orb.portableInterceptor.ClientInterceptorIterator.invoke(ClientInterceptorIterator.java:95)
> at org.jacorb.orb.portableInterceptor.AbstractInterceptorIterator.iterate(AbstractInterceptorIterator.java:67)
> at org.jacorb.orb.portableInterceptor.ClientInterceptorIterator.iterate(ClientInterceptorIterator.java:68)
> at org.jacorb.orb.ClientInterceptorHandler.invokeInterceptors(ClientInterceptorHandler.java:265)
> at org.jacorb.orb.ClientInterceptorHandler.handle_send_request(ClientInterceptorHandler.java:99)
> at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:996)
> at org.jacorb.orb.Delegate.invoke(Delegate.java:957)
> at com.sun.corba.se.impl.presentation.rmi.StubInvocationHandlerImpl.invoke(StubInvocationHandlerImpl.java:151)
> ... 9 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 5 months
[JBoss JIRA] (JBTM-1790) If xaNodeName is not set then a nullpointerexception is raised rather than an informative exception
by Gytis Trikleris (JIRA)
[ https://issues.jboss.org/browse/JBTM-1790?page=com.atlassian.jira.plugin.... ]
Work on JBTM-1790 started by Gytis Trikleris.
> If xaNodeName is not set then a nullpointerexception is raised rather than an informative exception
> ---------------------------------------------------------------------------------------------------
>
> Key: JBTM-1790
> URL: https://issues.jboss.org/browse/JBTM-1790
> Project: JBoss Transaction Manager
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: JTA, JTS
> Affects Versions: 5.0.0.M3
> Reporter: Tom Jenkinson
> Assignee: Gytis Trikleris
> Fix For: 5.0.0.M4
>
> Original Estimate: 30 minutes
> Remaining Estimate: 30 minutes
>
> TxControl needs a static initialization block reintroducing/similar such that if CoordinatorEnvironmentBean::getNodeIdentifier() returns null it should log a fatal error and fail to initialize.
> Currently for JTS an obscure stack trace is printed:
> [INFO] --- exec-maven-plugin:1.2.1:java (default-cli) @ iiop-jts-client ---
> Jun 21, 2013 6:08:11 PM com.arjuna.orbportability.internal.utils.InitLoader createInstance
> INFO: ARJUNA021027: Loading PreInitLoader class - com.arjuna.ats.internal.jts.context.ContextPropagationManager
> Jun 21, 2013 6:08:11 PM org.jacorb.config.JacORBConfiguration init
> WARNING: jacorb.home unset! Will use '.'
> Jun 21, 2013 6:08:11 PM org.jacorb.config.JacORBConfiguration init
> WARNING: File ./jacorb.properties for configuration jacorb not found
> Jun 21, 2013 6:08:11 PM org.jacorb.config.JacORBConfiguration init
> INFO: configuration jacorb loaded from classpath
> Jun 21, 2013 6:08:11 PM com.arjuna.orbportability.internal.utils.InitLoader createInstance
> INFO: ARJUNA021027: Loading PostInitLoader class - com.arjuna.ats.internal.jts.recovery.RecoveryInit
> Jun 21, 2013 6:08:11 PM com.arjuna.orbportability.internal.utils.InitLoader createInstance
> INFO: ARJUNA021027: Loading PostInitLoader class - com.arjuna.ats.jts.utils.ORBSetup
> Jun 21, 2013 6:08:11 PM com.arjuna.ats.arjuna.recovery.TransactionStatusManager addService
> INFO: ARJUNA012163: Starting service com.arjuna.ats.arjuna.recovery.ActionStatusService on port 43728
> Jun 21, 2013 6:08:11 PM com.arjuna.ats.internal.arjuna.recovery.TransactionStatusManagerItem <init>
> INFO: ARJUNA012337: TransactionStatusManagerItem host: 127.0.0.1 port: 43728
> Jun 21, 2013 6:08:11 PM com.arjuna.ats.arjuna.recovery.TransactionStatusManager start
> INFO: ARJUNA012170: TransactionStatusManager started on port 43728 and host 127.0.0.1 with service com.arjuna.ats.arjuna.recovery.ActionStatusService
> java.rmi.RemoteException: CORBA UNKNOWN 30001 No; nested exception is:
> org.omg.CORBA.UNKNOWN: java.lang.NullPointerException vmcid: 0x7000 minor code: 1329 completed: No
> at com.sun.corba.se.impl.javax.rmi.CORBA.Util.mapSystemException(Util.java:315)
> at javax.rmi.CORBA.Util.mapSystemException(Util.java:83)
> at com.sun.corba.se.impl.presentation.rmi.StubInvocationHandlerImpl.invoke(StubInvocationHandlerImpl.java:164)
> at com.sun.corba.se.spi.orbutil.proxy.CompositeInvocationHandlerImpl.invoke(CompositeInvocationHandlerImpl.java:79)
> at com.sun.proxy.$Proxy7.hello(Unknown Source)
> at org.jboss.qa.IIOPTesting.main(IIOPTesting.java:27)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:297)
> at java.lang.Thread.run(Thread.java:722)
> Caused by: org.omg.CORBA.UNKNOWN: java.lang.NullPointerException vmcid: 0x7000 minor code: 1329 completed: No
> at com.arjuna.ats.internal.jts.orbspecific.coordinator.ArjunaTransactionImple.get_txcontext(ArjunaTransactionImple.java:1300)
> at com.arjuna.ArjunaOTS.ArjunaTransactionPOATie.get_txcontext(ArjunaTransactionPOATie.java:129)
> at com.arjuna.ArjunaOTS._ArjunaTransactionStub.get_txcontext(_ArjunaTransactionStub.java:788)
> at com.arjuna.ats.jts.orbspecific.jacorb.interceptors.interposition.InterpositionClientRequestInterceptorImpl.send_request(InterpositionClientRequestInterceptorImpl.java:196)
> at org.jacorb.orb.portableInterceptor.ClientInterceptorIterator.invoke(ClientInterceptorIterator.java:95)
> at org.jacorb.orb.portableInterceptor.AbstractInterceptorIterator.iterate(AbstractInterceptorIterator.java:67)
> at org.jacorb.orb.portableInterceptor.ClientInterceptorIterator.iterate(ClientInterceptorIterator.java:68)
> at org.jacorb.orb.ClientInterceptorHandler.invokeInterceptors(ClientInterceptorHandler.java:265)
> at org.jacorb.orb.ClientInterceptorHandler.handle_send_request(ClientInterceptorHandler.java:99)
> at org.jacorb.orb.Delegate.invoke_internal(Delegate.java:996)
> at org.jacorb.orb.Delegate.invoke(Delegate.java:957)
> at com.sun.corba.se.impl.presentation.rmi.StubInvocationHandlerImpl.invoke(StubInvocationHandlerImpl.java:151)
> ... 9 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 5 months
[JBoss JIRA] (JBTM-1728) Use a global environment variable in CI for version numbers of Narayana and WildFly
by Gytis Trikleris (JIRA)
[ https://issues.jboss.org/browse/JBTM-1728?focusedWorklogId=12429426&page=... ]
Gytis Trikleris logged work on JBTM-1728:
-----------------------------------------
Author: Gytis Trikleris
Created on: 28/Jun/13 8:37 AM
Start Date: 28/Jun/13 8:37 AM
Worklog Time Spent: 40 minutes
Issue Time Tracking
-------------------
Time Spent: 55 minutes (was: 15 minutes)
Worklog Id: (was: 12429426)
> Use a global environment variable in CI for version numbers of Narayana and WildFly
> -----------------------------------------------------------------------------------
>
> Key: JBTM-1728
> URL: https://issues.jboss.org/browse/JBTM-1728
> Project: JBoss Transaction Manager
> Issue Type: Enhancement
> Security Level: Public(Everyone can see)
> Components: Build System, Testing
> Reporter: Paul Robinson
> Assignee: Gytis Trikleris
> Fix For: 5.0.0.M4
>
> Original Estimate: 2 hours
> Time Spent: 55 minutes
> Remaining Estimate: 0 minutes
>
> We have "8.0.0.Alpha2-SNAPSHOT" scattered over many jobs. This is a pain to change every time we have a new release of Wildfly. We also have the same issue with jboss-as-7.2.0.Final.
> We should use global env variables instead. See the following for how to do it. Notice that I have already added one for Narayana.
> http://172.17.131.2/configure
> Call the variables:
> WILDFLY_MASTER_VERSION=8.0.0.Alpha2-SNAPSHOT
> JBOSS_7_2_VERSION=7.2.0.Final
> Ask paul to update the sanity check job before this is done. This will blacklist the usage of hardcoded wildfly/jboss version numbers. It will make it a lot easier to find all the places it is used.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 5 months