[jboss-jira] [JBoss JIRA] (WFLY-3778) Tests in Manualmode test suite fail occasionally

[Tomaz Cerar (JIRA)]

     [ https://issues.jboss.org/browse/WFLY-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tomaz Cerar updated WFLY-3778:
------------------------------
    Description: 
I always see failures in one or few test of manualmode test suite on this platform. I not remember to have seen them on Windows 7.
But I saw a very similar failure today on Linux first time for PR 6638.
See https://github.com/wildfly/wildfly/pull/6638.

Last failure on my machine:
{noformat}
Running org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase
Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 72.186 sec <<< FAILURE! - in org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase
testRightVaultPassword(org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase)  Time elapsed: 6.23 sec  <<< FAILURE!
java.lang.AssertionError: Password should be right and authentication successful
Expected: a string containing "\"outcome\" => \"success\""
     but: was "0: INFO  [org.jboss.modules] JBoss Modules version 1.3.4.Final
INFO  [org.jboss.security] PBOX000361: Default Security Vault Implementation Initialized and Ready
INFO  [org.xnio] XNIO version 3.3.0.Beta1
INFO  [org.xnio.nio] XNIO NIO Implementation Version 3.3.0.Beta1
INFO  [org.jboss.remoting] JBoss Remoting version 4.0.3.Final
"
        at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
        at org.junit.Assert.assertThat(Assert.java:865)
        at org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase.testRightVaultPassword(VaultPasswordsInCLITestCase.java:158)
{noformat}

  was:
I always see failures in one or few test of manualmode test suite on this platform. I not remember to have seen them on Windows 7.
But I saw a very similar failure today on Linux first time for PR 6638.
See https://github.com/wildfly/wildfly/pull/6638.

Last failure on my machine:
Running org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase
Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 72.186 sec <<< FAILURE! - in org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase
testRightVaultPassword(org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase)  Time elapsed: 6.23 sec  <<< FAILURE!
java.lang.AssertionError: Password should be right and authentication successful
Expected: a string containing "\"outcome\" => \"success\""
     but: was "0: INFO  [org.jboss.modules] JBoss Modules version 1.3.4.Final
INFO  [org.jboss.security] PBOX000361: Default Security Vault Implementation Initialized and Ready
INFO  [org.xnio] XNIO version 3.3.0.Beta1
INFO  [org.xnio.nio] XNIO NIO Implementation Version 3.3.0.Beta1
INFO  [org.jboss.remoting] JBoss Remoting version 4.0.3.Final
"
        at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
        at org.junit.Assert.assertThat(Assert.java:865)
        at org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase.testRightVaultPassword(VaultPasswordsInCLITestCase.java:158)




> Tests in Manualmode test suite fail occasionally
> ------------------------------------------------
>
>                 Key: WFLY-3778
>                 URL: https://issues.jboss.org/browse/WFLY-3778
>             Project: WildFly
>          Issue Type: Bug
>      Security Level: Public(Everyone can see) 
>          Components: Remoting, Test Suite
>    Affects Versions: 9.0.0.Beta1
>         Environment: Oracle Solaris SPARC 10, Oracle JDK 1.7.0_67.
>            Reporter: Frank Langelage
>            Assignee: David Lloyd
>         Attachments: org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase-output.txt, org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase.txt, TEST-org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase.xml
>
>
> I always see failures in one or few test of manualmode test suite on this platform. I not remember to have seen them on Windows 7.
> But I saw a very similar failure today on Linux first time for PR 6638.
> See https://github.com/wildfly/wildfly/pull/6638.
> Last failure on my machine:
> {noformat}
> Running org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase
> Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 72.186 sec <<< FAILURE! - in org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase
> testRightVaultPassword(org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase)  Time elapsed: 6.23 sec  <<< FAILURE!
> java.lang.AssertionError: Password should be right and authentication successful
> Expected: a string containing "\"outcome\" => \"success\""
>      but: was "0: INFO  [org.jboss.modules] JBoss Modules version 1.3.4.Final
> INFO  [org.jboss.security] PBOX000361: Default Security Vault Implementation Initialized and Ready
> INFO  [org.xnio] XNIO version 3.3.0.Beta1
> INFO  [org.xnio.nio] XNIO NIO Implementation Version 3.3.0.Beta1
> INFO  [org.jboss.remoting] JBoss Remoting version 4.0.3.Final
> "
>         at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
>         at org.junit.Assert.assertThat(Assert.java:865)
>         at org.jboss.as.test.manualmode.management.cli.VaultPasswordsInCLITestCase.testRightVaultPassword(VaultPasswordsInCLITestCase.java:158)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.1#6329)