<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    FYI<br>
    <br>
    There is
<a class="moz-txt-link-freetext" href="https://keycloak-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/keycloak-deploy/">https://keycloak-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/keycloak-deploy/</a><br>
    <br>
    It checkouts 1.9.x branch and builds keycloak daily. If it succeeds
    artifacts are deployed to nexus staging repo and
    <a class="moz-txt-link-freetext" href="https://keycloak-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/keycloak-parent/">https://keycloak-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/keycloak-parent/</a>
    job is triggered. This is multi-job and one of its jobs is
    <a class="moz-txt-link-freetext" href="https://keycloak-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/keycloak-wildfly/">https://keycloak-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/keycloak-wildfly/</a>.
    It run base testsuite on wildfly. <br>
    <br>
    So if you want you can check test results of the job regularly to be
    kept informed.<br>
    <br>
    <div class="moz-cite-prefix">On 05/12/2016 10:38 AM, Marko Strukelj
      wrote:<br>
    </div>
    <blockquote
cite="mid:CA+1OW+geCj0JpjrTBAQBnZtig_aLtQ6ijrS0_X-fOK5V+UahXA@mail.gmail.com"
      type="cite">
      <div dir="ltr">I fixed the tests: <a moz-do-not-send="true"
          href="https://issues.jboss.org/browse/KEYCLOAK-2993"
          target="_blank">https://issues.jboss.org/browse/KEYCLOAK-2993</a>
        <div><br>
        </div>
        <div>There were two basic issues:
          <div><br>
          </div>
          <div>1) Usage of Time object on the client. We added a
            mechanism to set offset on the server - it's done by using
            setTimeOffset() of AbstractKeycloakTest rather than
            Time.setOffset().</div>
          <div>However, we forgot that client can also sometimes
            directly rely on Time object - for one, admin-client uses it
            to check if token needs to be refreshed before doing a
            remote call. Also, JsonWebToken has validation methods that
            rely on Time object, and is also used inside tests. Thus,
            client-side Time.offset, and server-side Time.offset have to
            be in sync for things to work properly. Since Undertow runs
            embedded in the same JVM where tests execute there was no
            problem, but for Wildfly there are two JVMs then, and any
            Time.offset mismatch starts wreaking havoc.</div>
          <div><br>
          </div>
          <div>2) Installation of some testing providers was not done
            through testsuite-providers module, but instead used
            tests/base directly - which works for embedded Undertow
            which loads from classpath, but not for running with Wildfly
            which loads from modules.</div>
          <div><br>
          </div>
          <div><br>
          </div>
          <div><br>
          </div>
        </div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Wed, May 11, 2016 at 2:33 PM, Marko
          Strukelj <span dir="ltr">&lt;<a moz-do-not-send="true"
              href="mailto:mstrukel@redhat.com" target="_blank">mstrukel@redhat.com</a>&gt;</span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div dir="ltr">
              <div>There are currently many tests failing when running:</div>
              <div><br>
              </div>
              <div>mvn clean install -Pdistribution -DskipTests</div>
              <div>cd testsuite/integration-arquillian</div>
              <div>mvn clean install -Pauth-server-wildfly</div>
              <div><br>
              </div>
              Failed tests: <br>
               
              ProvidersTest.testClientAuthenticatorProviders:85-&gt;compareProviders:178
              Providers count expected:&lt;3&gt; but was:&lt;2&gt;<br>
               
              ProvidersTest.testInitialAuthenticationProviders:130-&gt;compareProviders:178
              Providers count expected:&lt;20&gt; but was:&lt;18&gt;<br>
                ProvidersTest.testPerClientConfigDescriptions:93 null<br>
               
              CustomFlowTest.clientAuthTest:209-&gt;grantAccessToken:235
              expected:&lt;200&gt; but was:&lt;400&gt;<br>
                CustomFlowTest.grantTest:202-&gt;grantAccessToken:235
              expected:&lt;200&gt; but was:&lt;400&gt;<br>
                RefreshTokenTest.refreshTokenRequest:154 
              <div>Expected: (a value equal to or greater than
                &lt;1799&gt; and a value less than or equal to
                &lt;1800&gt;)<br>
                     but: a value equal to or greater than &lt;1799&gt;
                &lt;1798&gt; was less than &lt;1799&gt;<br>
                 
                RefreshTokenTest.refreshTokenReuseTokenWithRefreshTokensRevoked:261
                expected:&lt;400&gt; but was:&lt;200&gt;<br>
                 
                RefreshTokenTest.refreshTokenUserSessionMaxLifespan:456
                expected:&lt;400&gt; but was:&lt;200&gt;<br>
                  RefreshTokenTest.testUserSessionRefreshAndIdle:398
                Values should be different. Actual: 1462968567<br>
                <br>
                Tests in error: <br>
                  CustomFlowTest.loginSuccess:193 » IllegalArgument No
                enum constant org.keycloa...<br>
                  CustomRegistrationFlowTest.registerUserSuccess:98 »
                IllegalArgument No enum co...<br>
                  ResetPasswordTest.resetPasswordExpiredCode:386 »
                NotAuthorized HTTP 401 Unauth...<br>
                  ResetPasswordTest.resetPasswordExpiredCodeShort:430 »
                NotAuthorized HTTP 401 U...<br>
                 
                ResetPasswordTest.resetPasswordWithPasswordHisoryPolicy:575-&gt;resetPassword:267
                » NotAuthorized<br>
                 
                OfflineTokenTest.offlineTokenAllowedWithCompositeRole:428-&gt;offlineTokenDirectGrantFlow:290
                » Runtime<br>
                  OfflineTokenTest.offlineTokenBrowserFlow:210 » Runtime
                Failed to verify token<br>
                 
                OfflineTokenTest.offlineTokenDirectGrantFlow:311-&gt;testRefreshWithOfflineToken:255
                » Runtime<br>
                 
                OfflineTokenTest.offlineTokenDirectGrantFlowWithRefreshTokensRevoked:325
                » Runtime<br>
                  OfflineTokenTest.offlineTokenServiceAccountFlow:371 »
                Runtime Failed to verify...<br>
                <br>
                Tests run: 480, Failures: 9, Errors: 10, Skipped: 3</div>
              <div><br>
              </div>
              <div>It's probably just server-side changes that require
                maintenance in the tests themselves.</div>
              <div><br>
              </div>
              <div>We should maybe configure Travis CI with
                -Pauth-server-wildfly option so that we detect these
                right away.<br>
              </div>
              <div><br>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
keycloak-dev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:keycloak-dev@lists.jboss.org">keycloak-dev@lists.jboss.org</a>
<a class="moz-txt-link-freetext" href="https://lists.jboss.org/mailman/listinfo/keycloak-dev">https://lists.jboss.org/mailman/listinfo/keycloak-dev</a></pre>
    </blockquote>
    <br>
  </body>
</html>