[keycloak-user] Problem running keycloak cluster on EC2 with S3_ping

Alan Field afield at redhat.com
Fri Dec 18 10:55:51 EST 2015


Hey Charles, 

I modified the standalone-ha.xml similar to your file to add the S3_PING protocol, and I was able to get two KeyCloak nodes to cluster. I did have to set the jboss.bind.address and jboss.bind.address.management. From your logs I can see that these addresses are both set in your environment as well. How are you setting these? My log is included below. 

Thanks, 
Alan 

[ec2-user at ip-172-31-4-165 keycloak-1.7.0.Final]$ bin/standalone.sh -c standalone-ha.xml -Djboss.socket.binding.port-offset=0 -Djboss.node.name=node0 -Djboss.bind.address=$IP -Djboss.bind.address.management=$IP 

========================================================================= 

JBoss Bootstrap Environment 

JBOSS_HOME: /radargun/keycloak-1.7.0.Final 

JAVA: java 

JAVA_OPTS: -server -XX:+UseCompressedOops -server -XX:+UseCompressedOops -Xms64m -Xmx512m -XX:MaxPermSize=256m -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -Djava.awt.headless=true 

========================================================================= 

Picked up _JAVA_OPTIONS: -Djgroups.s3.secret_access_key=ndWrqybZHIaFsEWEuMlWf5fJVffEapbu7DJgcYTd -Djgroups.s3.access_key=AKIAIVP76RKVWTPN6S6Q -Djgroups.s3.bucket=jdg-jgroups 
10:49:41,196 INFO [org.jboss.modules] (main) JBoss Modules version 1.4.3.Final 
10:49:41,418 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final 
10:49:41,497 INFO [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: Keycloak 1.7.0.Final (WildFly Core 1.0.2.Final) starting 
10:49:42,524 INFO [org.jboss.as.controller.management-deprecated] (ServerService Thread Pool -- 19) WFLYCTL0028: Attribute 'default-stack' in the resource at address '/subsystem=jgroups' is deprecated, and may be removed in future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation. 
10:49:42,525 INFO [org.jboss.as.controller.management-deprecated] (ServerService Thread Pool -- 21) WFLYCTL0028: Attribute 'job-repository-type' in the resource at address '/subsystem=batch' is deprecated, and may be removed in future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation. 
10:49:42,531 INFO [org.jboss.as.controller.management-deprecated] (ServerService Thread Pool -- 25) WFLYCTL0028: Attribute 'enabled' in the resource at address '/subsystem=datasources/data-source=ExampleDS' is deprecated, and may be removed in future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation. 
10:49:42,534 INFO [org.jboss.as.controller.management-deprecated] (ServerService Thread Pool -- 25) WFLYCTL0028: Attribute 'enabled' in the resource at address '/subsystem=datasources/data-source=KeycloakDS' is deprecated, and may be removed in future version. See the attribute description in the output of the read-resource-description operation to learn more about the deprecation. 
10:49:42,707 INFO [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0039: Creating http management service using socket-binding (management-http) 
10:49:42,741 INFO [org.xnio] (MSC service thread 1-2) XNIO version 3.3.1.Final 
10:49:42,750 INFO [org.xnio.nio] (MSC service thread 1-2) XNIO NIO Implementation Version 3.3.1.Final 
10:49:42,782 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 39) WFLYCLINF0001: Activating Infinispan subsystem. 
10:49:42,782 INFO [org.wildfly.extension.io] (ServerService Thread Pool -- 38) WFLYIO001: Worker 'default' has auto-configured to 16 core threads with 128 task threads based on your 8 available processors 
10:49:42,784 INFO [org.jboss.remoting] (MSC service thread 1-2) JBoss Remoting version 4.0.9.Final 
10:49:42,800 INFO [org.jboss.as.clustering.jgroups] (ServerService Thread Pool -- 43) WFLYCLJG0001: Activating JGroups subsystem. 
10:49:42,819 INFO [org.jboss.as.security] (ServerService Thread Pool -- 56) WFLYSEC0002: Activating Security Subsystem 
10:49:42,824 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 57) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique. 
10:49:42,843 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 49) WFLYNAM0001: Activating Naming Subsystem 
10:49:42,841 INFO [org.jboss.as.jsf] (ServerService Thread Pool -- 46) WFLYJSF0007: Activated the following JSF Implementations: [main] 
10:49:42,859 INFO [org.jboss.as.security] (MSC service thread 1-3) WFLYSEC0001: Current PicketBox version=4.9.2.Final 
10:49:42,922 INFO [org.jboss.as.connector] (MSC service thread 1-8) WFLYJCA0009: Starting JCA Subsystem (IronJacamar 1.2.5.Final) 
10:49:42,976 INFO [org.jboss.as.webservices] (ServerService Thread Pool -- 59) WFLYWS0002: Activating WebServices Extension 
10:49:42,986 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 58) WFLYUT0003: Undertow 1.2.9.Final starting 
10:49:42,986 INFO [org.wildfly.extension.undertow] (MSC service thread 1-5) WFLYUT0003: Undertow 1.2.9.Final starting 
10:49:42,991 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 35) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3) 
10:49:42,994 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-2) WFLYJCA0018: Started Driver service with driver-name = h2 
10:49:43,118 INFO [org.jboss.as.naming] (MSC service thread 1-7) WFLYNAM0003: Starting Naming Service 
10:49:43,119 INFO [org.jboss.as.mail.extension] (MSC service thread 1-6) WFLYMAIL0001: Bound mail session [java:jboss/mail/Default] 
10:49:43,168 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 58) WFLYUT0014: Creating file handler for path /radargun/keycloak-1.7.0.Final/welcome-content 
10:49:43,181 INFO [org.wildfly.extension.undertow] (MSC service thread 1-7) WFLYUT0012: Started server default-server. 
10:49:43,213 INFO [org.wildfly.extension.undertow] (MSC service thread 1-7) WFLYUT0018: Host default-host starting 
10:49:43,294 INFO [org.wildfly.extension.undertow] (MSC service thread 1-8) WFLYUT0006: Undertow AJP listener ajp listening on /172.31.4.165:8009 
10:49:43,303 INFO [org.jboss.modcluster] (ServerService Thread Pool -- 62) MODCLUSTER000001: Initializing mod_cluster version 1.3.1.Final 
10:49:43,307 INFO [org.wildfly.extension.undertow] (MSC service thread 1-2) WFLYUT0006: Undertow HTTP listener default listening on /172.31.4.165:8080 
10:49:43,333 INFO [org.jboss.modcluster] (ServerService Thread Pool -- 62) MODCLUSTER000032: Listening to proxy advertisements on /224.0.1.105:23364 
10:49:43,480 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-3) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS] 
10:49:43,480 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-4) WFLYJCA0001: Bound data source [java:jboss/datasources/KeycloakDS] 
10:49:43,739 INFO [org.jboss.as.server.deployment] (MSC service thread 1-3) WFLYSRV0027: Starting deployment of "keycloak-server.war" (runtime-name: "keycloak-server.war") 
10:49:43,784 INFO [org.jboss.ws.common.management] (MSC service thread 1-8) JBWS022052: Starting JBoss Web Services - Stack CXF Server 5.0.0.Final 
10:49:44,786 INFO [stdout] (MSC service thread 1-1) 
10:49:44,786 INFO [stdout] (MSC service thread 1-1) ------------------------------------------------------------------- 
10:49:44,786 INFO [stdout] (MSC service thread 1-1) GMS: address=node0, cluster=ee, physical address=172.31.4.165:7600 
10:49:44,786 INFO [stdout] (MSC service thread 1-1) ------------------------------------------------------------------- 
10:49:45,049 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService Thread Pool -- 64) ISPN000078: Starting JGroups channel keycloak 
10:49:45,055 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService Thread Pool -- 64) ISPN000094: Received new cluster view for channel keycloak: [node0|0] (1) [node0] 
10:49:45,064 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService Thread Pool -- 64) ISPN000079: Channel keycloak local address is node0, physical addresses are [172.31.4.165:7600] 
10:49:45,067 INFO [org.infinispan.factories.GlobalComponentRegistry] (ServerService Thread Pool -- 64) ISPN000128: Infinispan version: Infinispan 'Insanely Bad Elf' 7.2.3.Final 
10:49:45,242 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 64) WFLYCLINF0002: Started users cache from keycloak container 
10:49:45,242 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 65) WFLYCLINF0002: Started realms cache from keycloak container 
10:49:45,243 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 66) WFLYCLINF0002: Started sessions cache from keycloak container 
10:49:45,243 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 62) WFLYCLINF0002: Started loginFailures cache from keycloak container 
10:49:45,846 INFO [org.keycloak.services.resources.KeycloakApplication] (ServerService Thread Pool -- 63) Load config from /radargun/keycloak-1.7.0.Final/standalone/configuration/keycloak-server.json 
10:49:46,642 INFO [org.hibernate.jpa.internal.util.LogHelper] (ServerService Thread Pool -- 63) HHH000204: Processing PersistenceUnitInfo [ 
name: keycloak-default 
...] 
10:49:46,695 INFO [org.hibernate.Version] (ServerService Thread Pool -- 63) HHH000412: Hibernate Core {4.3.10.Final} 
10:49:46,696 INFO [org.hibernate.cfg.Environment] (ServerService Thread Pool -- 63) HHH000206: hibernate.properties not found 
10:49:46,697 INFO [org.hibernate.cfg.Environment] (ServerService Thread Pool -- 63) HHH000021: Bytecode provider name : javassist 
10:49:46,856 INFO [org.hibernate.annotations.common.Version] (ServerService Thread Pool -- 63) HCANN000001: Hibernate Commons Annotations {4.0.5.Final} 
10:49:46,906 INFO [org.hibernate.dialect.Dialect] (ServerService Thread Pool -- 63) HHH000400: Using dialect: org.hibernate.dialect.H2Dialect 
10:49:46,912 WARN [org.hibernate.dialect.H2Dialect] (ServerService Thread Pool -- 63) HHH000431: Unable to determine H2 database version, certain features may not work 
10:49:47,191 INFO [org.hibernate.hql.internal.ast.ASTQueryTranslatorFactory] (ServerService Thread Pool -- 63) HHH000397: Using ASTQueryTranslatorFactory 
10:49:47,223 INFO [org.hibernate.validator.internal.util.Version] (ServerService Thread Pool -- 63) HV000001: Hibernate Validator 5.1.3.Final 
10:49:49,112 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 63) WFLYCLINF0002: Started offlineSessions cache from keycloak container 
10:49:49,147 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Deploying javax.ws.rs.core.Application: class org.keycloak.services.resources.KeycloakApplication 
10:49:49,149 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding class resource org.keycloak.services.resources.ThemeResource from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,149 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding class resource org.keycloak.services.resources.JsResource from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,150 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding class resource org.keycloak.services.resources.WelcomeResource from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,150 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding class resource org.keycloak.services.resources.QRCodeResource from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,150 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding singleton resource org.keycloak.services.resources.ServerVersionResource from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,151 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding provider singleton org.keycloak.services.util.ObjectMapperResolver from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,151 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding provider singleton org.keycloak.services.resources.ModelExceptionMapper from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,151 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding singleton resource org.keycloak.services.resources.admin.AdminRoot from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,152 INFO [org.jboss.resteasy.spi.ResteasyDeployment] (ServerService Thread Pool -- 63) Adding singleton resource org.keycloak.services.resources.RealmsResource from Application class org.keycloak.services.resources.KeycloakApplication 
10:49:49,229 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 63) WFLYUT0021: Registered web context: /auth 
10:49:49,277 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61) WFLYSRV0010: Deployed "keycloak-server.war" (runtime-name : "keycloak-server.war") 
10:49:49,572 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://172.31.4.165:9990/management 
10:49:49,573 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://172.31.4.165:9990 
10:49:49,573 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: Keycloak 1.7.0.Final (WildFly Core 1.0.2.Final) started in 8688ms - Started 344 of 593 services (339 services are lazy, passive or on-demand) 
10:50:16,178 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-2,ee,node0) ISPN000094: Received new cluster view for channel keycloak: [node0|1] (2) [node0, node1] 
10:50:16,650 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t2) ISPN000310: Starting cluster-wide rebalance for cache users, topology CacheTopology{id=1, rebalanceId=1, currentCH=ReplicatedConsistentHash{ns = 60, owners = (1)[node0: 60]}, pendingCH=ReplicatedConsistentHash{ns = 60, owners = (2)[node0: 30, node1: 30]}, unionCH=null, actualMembers=[node0, node1]} 
10:50:16,650 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t4) ISPN000310: Starting cluster-wide rebalance for cache realms, topology CacheTopology{id=1, rebalanceId=1, currentCH=ReplicatedConsistentHash{ns = 60, owners = (1)[node0: 60]}, pendingCH=ReplicatedConsistentHash{ns = 60, owners = (2)[node0: 30, node1: 30]}, unionCH=null, actualMembers=[node0, node1]} 
10:50:16,652 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t1) ISPN000310: Starting cluster-wide rebalance for cache sessions, topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=80, owners = (1)[node0: 80+0]}, pendingCH=DefaultConsistentHash{ns=80, owners = (2)[node0: 40+0, node1: 40+0]}, unionCH=null, actualMembers=[node0, node1]} 
10:50:16,652 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t3) ISPN000310: Starting cluster-wide rebalance for cache loginFailures, topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=80, owners = (1)[node0: 80+0]}, pendingCH=DefaultConsistentHash{ns=80, owners = (2)[node0: 40+0, node1: 40+0]}, unionCH=null, actualMembers=[node0, node1]} 
10:50:16,712 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t4) ISPN000336: Finished cluster-wide rebalance for cache users, topology id = 1 
10:50:16,712 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t1) ISPN000336: Finished cluster-wide rebalance for cache realms, topology id = 1 
10:50:16,758 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t1) ISPN000336: Finished cluster-wide rebalance for cache sessions, topology id = 1 
10:50:16,761 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t4) ISPN000336: Finished cluster-wide rebalance for cache loginFailures, topology id = 1 
10:50:22,061 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t4) ISPN000310: Starting cluster-wide rebalance for cache offlineSessions, topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=80, owners = (1)[node0: 80+0]}, pendingCH=DefaultConsistentHash{ns=80, owners = (2)[node0: 40+0, node1: 40+0]}, unionCH=null, actualMembers=[node0, node1]} 
10:50:22,085 INFO [org.infinispan.CLUSTER] (remote-thread--p3-t4) ISPN000336: Finished cluster-wide rebalance for cache offlineSessions, topology id = 1 

----- Original Message -----

> From: "Alan Field" <afield at redhat.com>
> To: "charles-edouard gagnaire" <c.gagnaire at kreactive.com>
> Cc: keycloak-user at lists.jboss.org
> Sent: Friday, December 18, 2015 10:21:54 AM
> Subject: Re: [keycloak-user] Problem running keycloak cluster on EC2 with
> S3_ping

> Hey Charles,

> Thanks for the logs. I'm not sure what is wrong, but it looks like each
> server is creating a cluster of 1. I'll try it with my AWS account to see if
> I can figure out what is wrong.

> Alan

> ----- Original Message -----

> > From: "charles-edouard gagnaire" <c.gagnaire at kreactive.com>
> 
> > To: "Alan Field" <afield at redhat.com>
> 
> > Cc: keycloak-user at lists.jboss.org
> 
> > Sent: Friday, December 18, 2015 10:04:53 AM
> 
> > Subject: Re: [keycloak-user] Problem running keycloak cluster on EC2 with
> > S3_ping
> 

> > First i want to thank you guys for the quick answers, i was still reading
> > the
> > "Replace use of Infinispan with User Sessions SPI ?" discussion.
> 

> > Yes of course i can send all the logs. You'll find them below.
> 

> > The JGroups version is the one shipping with keycloak 1.7, but the problem
> > was the same with Keycloak 1.6.
> 
> > Looking at the config file, it looks like i'm using : <subsystem
> > xmlns="urn:jboss:domain:jgroups:3.0">
> 

> > I didn't mention it but i use the archive i found on Keycloak website. The
> > archive is "keycloak-1.7.0.Final.tar.gz".
> 
> > I just untar and modify the config files, then i launched it using :
> > /opt/keycloak-1.7.0.Final/bin/standalone.sh -c standalone-ha.xml
> 

> > Thank you again for your help
> 

> > The logs for server 1 are :
> 
> > =========================================================================
> 

> > JBoss Bootstrap Environment
> 

> > JBOSS_HOME: /opt/keycloak-1.7.0.Final
> 

> > JAVA: /usr/lib/jvm/jre/bin/java
> 

> > JAVA_OPTS: -server -XX:+UseCompressedOops -server -XX:+UseCompressedOops
> > -Xms64m -Xmx512m -XX:MaxPermSize=256m -Djava.net.preferIPv4Stack=true
> > -Djboss.modules.system.pkgs=org.jboss.byteman -Djava.awt.headless=true
> 

> > =========================================================================
> 

> > OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support
> > was removed in 8.0
> 
> > 14:38:44,910 INFO [org.jboss.modules] (main) JBoss Modules version
> > 1.4.3.Final
> 
> > 14:38:45,091 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
> 
> > 14:38:45,163 INFO [ org.jboss.as ] (MSC service thread 1-2) WFLYSRV0049:
> > Keycloak 1.7.0.Final (WildFly Core 1.0.2.Final) starting
> 
> > 14:38:46,358 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 24) WFLYCTL0028: Attribute
> > 'job-repository-type' in the resource at address '/subsystem=batch' is
> > deprecated, and may be removed in future version. See the attribute
> > description in the output of the read-resource-description operation to
> > learn more about the deprecation.
> 
> > 14:38:46,360 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 14) WFLYCTL0028: Attribute 'enabled' in the
> > resource at address '/subsystem=datasources/data-source=PgDskeycloak' is
> > deprecated, and may be removed in future version. See the attribute
> > description in the output of the read-resource-description operation to
> > learn more about the deprecation.
> 
> > 14:38:46,362 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 14) WFLYCTL0028: Attribute 'enabled' in the
> > resource at address '/subsystem=datasources/data-source=ExampleDS' is
> > deprecated, and may be removed in future version. See the attribute
> > description in the output of the read-resource-description operation to
> > learn more about the deprecation.
> 
> > 14:38:46,362 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 14) WFLYCTL0028: Attribute 'enabled' in the
> > resource at address '/subsystem=datasources/data-source=KeycloakDS' is
> > deprecated, and may be removed in future version. See the attribute
> > description in the output of the read-resource-description operation to
> > learn more about the deprecation.
> 
> > 14:38:46,370 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 21) WFLYCTL0028: Attribute 'default-stack' in
> > the resource at address '/subsystem=jgroups' is deprecated, and may be
> > removed in future version. See the attribute description in the output of
> > the read-resource-description operation to learn more about the
> > deprecation.
> 
> > 14:38:46,572 INFO [org.jboss.as.server] (Controller Boot Thread)
> > WFLYSRV0039:
> > Creating http management service using socket-binding (management-http)
> 
> > 14:38:46,589 INFO [org.xnio] (MSC service thread 1-4) XNIO version
> > 3.3.1.Final
> 
> > 14:38:46,607 INFO [org.xnio.nio] (MSC service thread 1-4) XNIO NIO
> > Implementation Version 3.3.1.Final
> 
> > 14:38:46,655 INFO [org.jboss.remoting] (MSC service thread 1-4) JBoss
> > Remoting version 4.0.9.Final
> 
> > 14:38:46,687 INFO [ org.wildfly.extension.io ] (ServerService Thread Pool
> > --
> > 38) WFLYIO001: Worker 'default' has auto-configured to 4 core threads with
> > 32 task threads based on your 2 available processors
> 
> > 14:38:46,685 INFO [org.jboss.as.connector.subsystems.datasources]
> > (ServerService Thread Pool -- 35) WFLYJCA0005: Deploying non-JDBC-compliant
> > driver class org.postgresql.Driver (version 9.4)
> 
> > 14:38:46,715 INFO [org.jboss.as.clustering.jgroups] (ServerService Thread
> > Pool -- 43) WFLYCLJG0001: Activating JGroups subsystem.
> 
> > 14:38:46,724 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 39) WFLYCLINF0001: Activating Infinispan subsystem.
> 
> > 14:38:46,744 INFO [org.jboss.as.connector] (MSC service thread 1-4)
> > WFLYJCA0009: Starting JCA Subsystem (IronJacamar 1.2.5.Final)
> 
> > 14:38:46,746 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service
> > thread
> > 1-2) WFLYJCA0018: Started Driver service with driver-name = postgresql
> 
> > 14:38:46,767 INFO [org.jboss.as.connector.subsystems.datasources]
> > (ServerService Thread Pool -- 35) WFLYJCA0004: Deploying JDBC-compliant
> > driver class org.h2.Driver (version 1.3)
> 
> > 14:38:46,769 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service
> > thread
> > 1-2) WFLYJCA0018: Started Driver service with driver-name = h2
> 
> > 14:38:46,781 INFO [org.jboss.as.jsf] (ServerService Thread Pool -- 46)
> > WFLYJSF0007: Activated the following JSF Implementations: [main]
> 
> > 14:38:46,772 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 49)
> > WFLYNAM0001: Activating Naming Subsystem
> 
> > 14:38:46,914 INFO [org.jboss.as.security] (ServerService Thread Pool -- 56)
> > WFLYSEC0002: Activating Security Subsystem
> 
> > 14:38:46,916 INFO [org.jboss.as.security] (MSC service thread 1-1)
> > WFLYSEC0001: Current PicketBox version=4.9.2.Final
> 
> > 14:38:46,932 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 57)
> > WFLYTX0013: Node identifier property is set to the default value. Please
> > make sure it is unique.
> 
> > 14:38:46,957 INFO [org.jboss.as.webservices] (ServerService Thread Pool --
> > 59) WFLYWS0002: Activating WebServices Extension
> 
> > 14:38:46,985 INFO [org.jboss.as.naming] (MSC service thread 1-2)
> > WFLYNAM0003:
> > Starting Naming Service
> 
> > 14:38:46,992 INFO [org.jboss.as.mail.extension] (MSC service thread 1-4)
> > WFLYMAIL0001: Bound mail session [java:jboss/mail/Default]
> 
> > 14:38:47,115 INFO [org.wildfly.extension.undertow] (MSC service thread 1-1)
> > WFLYUT0003: Undertow 1.2.9.Final starting
> 
> > 14:38:47,119 INFO [org.wildfly.extension.undertow] (ServerService Thread
> > Pool
> > -- 58) WFLYUT0003: Undertow 1.2.9.Final starting
> 
> > 14:38:47,206 INFO [org.wildfly.extension.undertow] (ServerService Thread
> > Pool
> > -- 58) WFLYUT0014: Creating file handler for path
> > /opt/keycloak-1.7.0.Final/welcome-content
> 
> > 14:38:47,229 INFO [org.wildfly.extension.undertow] (MSC service thread 1-4)
> > WFLYUT0012: Started server default-server.
> 
> > 14:38:47,263 INFO [org.wildfly.extension.undertow] (MSC service thread 1-4)
> > WFLYUT0018: Host default-host starting
> 
> > 14:38:47,320 INFO [org.wildfly.extension.undertow] (MSC service thread 1-2)
> > WFLYUT0006: Undertow AJP listener ajp listening on / 10.1.7.103:8009
> 
> > 14:38:47,324 INFO [org.wildfly.extension.undertow] (MSC service thread 1-3)
> > WFLYUT0006: Undertow HTTP listener default listening on / 10.1.7.103:8080
> 
> > 14:38:47,339 INFO [org.jboss.modcluster] (ServerService Thread Pool -- 62)
> > MODCLUSTER000001: Initializing mod_cluster version 1.3.1.Final
> 
> > 14:38:47,372 INFO [org.jboss.modcluster] (ServerService Thread Pool -- 62)
> > MODCLUSTER000032: Listening to proxy advertisements on / 224.0.1.105:23364
> 
> > 14:38:47,478 INFO
> > [org.jboss.as.connector.subsystems.datasources.AbstractDataSourceService$AS7DataSourceDeployer]
> > (MSC service thread 1-1) IJ020018: Enabling <validate-on-match> for
> > java:jboss/datasources/PgDskeycloak
> 
> > 14:38:47,513 INFO [org.jboss.as.connector.subsystems.datasources] (MSC
> > service thread 1-2) WFLYJCA0001: Bound data source
> > [java:jboss/datasources/KeycloakDS]
> 
> > 14:38:47,513 INFO [org.jboss.as.connector.subsystems.datasources] (MSC
> > service thread 1-2) WFLYJCA0001: Bound data source
> > [java:jboss/datasources/ExampleDS]
> 
> > 14:38:47,530 INFO [org.jboss.as.connector.subsystems.datasources] (MSC
> > service thread 1-2) WFLYJCA0001: Bound data source
> > [java:jboss/datasources/PgDskeycloak]
> 
> > 14:38:47,673 INFO [org.jboss.as.server.deployment] (MSC service thread 1-4)
> > WFLYSRV0027: Starting deployment of "keycloak-server.war" (runtime-name:
> > "keycloak-server.war")
> 
> > 14:38:47,820 INFO [org.jboss.ws.common.management] (MSC service thread 1-3)
> > JBWS022052: Starting JBoss Web Services - Stack CXF Server 5.0.0.Final
> 
> > 14:38:48,898 INFO [stdout] (MSC service thread 1-2)
> 
> > 14:38:48,898 INFO [stdout] (MSC service thread 1-2)
> > -------------------------------------------------------------------
> 
> > 14:38:48,898 INFO [stdout] (MSC service thread 1-2) GMS:
> > address=ip-10-1-7-103, cluster=ee, physical address= 10.1.7.103:7600
> 
> > 14:38:48,899 INFO [stdout] (MSC service thread 1-2)
> > -------------------------------------------------------------------
> 
> > 14:38:49,250 INFO
> > [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService
> > Thread Pool -- 62) ISPN000078: Starting JGroups channel keycloak
> 
> > 14:38:49,265 INFO
> > [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService
> > Thread Pool -- 62) ISPN000094: Received new cluster view for channel
> > keycloak: [ip-10-1-7-103|0] (1) [ip-10-1-7-103]
> 
> > 14:38:49,273 INFO
> > [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService
> > Thread Pool -- 62) ISPN000079: Channel keycloak local address is
> > ip-10-1-7-103, physical addresses are [ 10.1.7.103:7600 ]
> 
> > 14:38:49,277 INFO [org.infinispan.factories.GlobalComponentRegistry]
> > (ServerService Thread Pool -- 62) ISPN000128: Infinispan version:
> > Infinispan
> > 'Insanely Bad Elf' 7.2.3.Final
> 
> > 14:38:49,521 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 65) WFLYCLINF0002: Started users cache from keycloak container
> 
> > 14:38:49,529 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 62) WFLYCLINF0002: Started loginFailures cache from keycloak
> > container
> 
> > 14:38:49,530 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 66) WFLYCLINF0002: Started sessions cache from keycloak container
> 
> > 14:38:49,536 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 63) WFLYCLINF0002: Started realms cache from keycloak container
> 
> > 14:38:50,116 INFO [org.keycloak.services.resources.KeycloakApplication]
> > (ServerService Thread Pool -- 66) Load config from
> > /opt/keycloak-1.7.0.Final/standalone/configuration/keycloak-server.json
> 
> > 14:38:50,638 INFO [org.hibernate.jpa.internal.util.LogHelper]
> > (ServerService
> > Thread Pool -- 66) HHH000204: Processing PersistenceUnitInfo [
> 
> > name: keycloak-default
> 
> > ...]
> 
> > 14:38:50,690 INFO [org.hibernate.Version] (ServerService Thread Pool -- 66)
> > HHH000412: Hibernate Core {4.3.10.Final}
> 
> > 14:38:50,691 INFO [org.hibernate.cfg.Environment] (ServerService Thread
> > Pool
> > -- 66) HHH000206: hibernate.properties not found
> 
> > 14:38:50,693 INFO [org.hibernate.cfg.Environment] (ServerService Thread
> > Pool
> > -- 66) HHH000021: Bytecode provider name : javassist
> 
> > 14:38:50,842 INFO [org.hibernate.annotations.common.Version] (ServerService
> > Thread Pool -- 66) HCANN000001: Hibernate Commons Annotations {4.0.5.Final}
> 
> > 14:38:51,794 INFO [org.hibernate.dialect.Dialect] (ServerService Thread
> > Pool
> > -- 66) HHH000400: Using dialect: org.hibernate.dialect.PostgreSQL9Dialect
> 
> > 14:38:51,803 INFO [org.hibernate.engine.jdbc.internal.LobCreatorBuilder]
> > (ServerService Thread Pool -- 66) HHH000424: Disabling contextual LOB
> > creation as createClob() method threw error :
> > java.lang.reflect.InvocationTargetException
> 
> > 14:38:52,120 INFO
> > [org.hibernate.hql.internal.ast.ASTQueryTranslatorFactory]
> > (ServerService Thread Pool -- 66) HHH000397: Using
> > ASTQueryTranslatorFactory
> 
> > 14:38:52,156 INFO [org.hibernate.validator.internal.util.Version]
> > (ServerService Thread Pool -- 66) HV000001: Hibernate Validator 5.1.3.Final
> 
> > 14:38:53,706 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 66) WFLYCLINF0002: Started offlineSessions cache from keycloak
> > container
> 
> > 14:38:53,748 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Deploying javax.ws.rs.core.Application: class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,750 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding class resource
> > org.keycloak.services.resources.WelcomeResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,750 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding class resource
> > org.keycloak.services.resources.JsResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,750 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding class resource
> > org.keycloak.services.resources.QRCodeResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,750 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding class resource
> > org.keycloak.services.resources.ThemeResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,751 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding singleton resource
> > org.keycloak.services.resources.RealmsResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,751 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding singleton resource
> > org.keycloak.services.resources.ServerVersionResource from Application
> > class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,751 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding singleton resource
> > org.keycloak.services.resources.admin.AdminRoot from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,751 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding provider singleton
> > org.keycloak.services.util.ObjectMapperResolver from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,752 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 66) Adding provider singleton
> > org.keycloak.services.resources.ModelExceptionMapper from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:38:53,824 INFO [org.wildfly.extension.undertow] (ServerService Thread
> > Pool
> > -- 66) WFLYUT0021: Registered web context: /auth
> 
> > 14:38:53,920 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61)
> > WFLYSRV0010: Deployed "keycloak-server.war" (runtime-name :
> > "keycloak-server.war")
> 
> > 14:38:54,021 INFO [ org.jboss.as ] (Controller Boot Thread) WFLYSRV0060:
> > Http
> > management interface listening on http://10.1.7.103:9990/management
> 
> > 14:38:54,021 INFO [ org.jboss.as ] (Controller Boot Thread) WFLYSRV0051:
> > Admin console listening on http://10.1.7.103:9990
> 
> > 14:38:54,022 INFO [ org.jboss.as ] (Controller Boot Thread) WFLYSRV0025:
> > Keycloak 1.7.0.Final (WildFly Core 1.0.2.Final) started in 9388ms - Started
> > 349 of 613 services (353 services are lazy, passive or on-demand)
> 

> > The logs for server 2 are :
> 
> > =========================================================================
> 

> > JBoss Bootstrap Environment
> 

> > JBOSS_HOME: /opt/keycloak-1.7.0.Final
> 

> > JAVA: /usr/lib/jvm/jre/bin/java
> 

> > JAVA_OPTS: -server -XX:+UseCompressedOops -server -XX:+UseCompressedOops
> > -Xms64m -Xmx512m -XX:MaxPermSize=256m -Djava.net.preferIPv4Stack=true
> > -Djboss.modules.system.pkgs=org.jboss.byteman -Djava.awt.headless=true
> 

> > =========================================================================
> 

> > 14:38:48,239 INFO [org.jboss.modules] (main) JBoss Modules version
> > 1.4.3.Final
> 
> > 14:38:48,723 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final
> 
> > 14:38:48,896 INFO [ org.jboss.as ] (MSC service thread 1-2) WFLYSRV0049:
> > Keycloak 1.7.0.Final (WildFly Core 1.0.2.Final) starting
> 
> > 14:38:50,979 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 8) WFLYCTL0028: Attribute
> > 'job-repository-type' in the resource at address '/subsystem=batch' is
> > deprecated, and may be removed in future version. See the attribute
> > description in the output of the read-resource-description operation to
> > learn more about the deprecation.
> 
> > 14:38:50,983 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 11) WFLYCTL0028: Attribute 'enabled' in the
> > resource at address '/subsystem=datasources/data-source=PgDskeycloak' is
> > deprecated, and may be removed in future version. See the attribute
> > description in the output of the read-resource-description operation to
> > learn more about the deprecation.
> 
> > 14:38:50,986 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 11) WFLYCTL0028: Attribute 'enabled' in the
> > resource at address '/subsystem=datasources/data-source=ExampleDS' is
> > deprecated, and may be removed in future version. See the attribute
> > description in the output of the read-resource-description operation to
> > learn more about the deprecation.
> 
> > 14:38:51,010 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 14) WFLYCTL0028: Attribute 'default-stack' in
> > the resource at address '/subsystem=jgroups' is deprecated, and may be
> > removed in future version. See the attribute description in the output of
> > the read-resource-description operation to learn more about the
> > deprecation.
> 
> > 14:38:51,044 INFO [org.jboss.as.controller.management-deprecated]
> > (ServerService Thread Pool -- 11) WFLYCTL0028: Attribute 'enabled' in the
> > resource at address '/subsystem=datasources/data-source=KeycloakDS' is
> > deprecated, and may be removed in future version. See the attribute
> > description in the output of the read-resource-description operation to
> > learn more about the deprecation.
> 
> > 14:38:51,452 INFO [org.jboss.as.server] (Controller Boot Thread)
> > WFLYSRV0039:
> > Creating http management service using socket-binding (management-http)
> 
> > 14:38:51,499 INFO [org.xnio] (MSC service thread 1-1) XNIO version
> > 3.3.1.Final
> 
> > 14:38:51,520 INFO [org.xnio.nio] (MSC service thread 1-1) XNIO NIO
> > Implementation Version 3.3.1.Final
> 
> > 14:38:51,590 INFO [org.jboss.as.connector.subsystems.datasources]
> > (ServerService Thread Pool -- 35) WFLYJCA0005: Deploying non-JDBC-compliant
> > driver class org.postgresql.Driver (version 9.4)
> 
> > 14:38:51,603 INFO [ org.wildfly.extension.io ] (ServerService Thread Pool
> > --
> > 38) WFLYIO001: Worker 'default' has auto-configured to 2 core threads with
> > 16 task threads based on your 1 available processors
> 
> > 14:38:51,601 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 39) WFLYCLINF0001: Activating Infinispan subsystem.
> 
> > 14:38:51,634 INFO [org.jboss.as.clustering.jgroups] (ServerService Thread
> > Pool -- 43) WFLYCLJG0001: Activating JGroups subsystem.
> 
> > 14:38:51,694 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 49)
> > WFLYNAM0001: Activating Naming Subsystem
> 
> > 14:38:51,666 INFO [org.jboss.as.jsf] (ServerService Thread Pool -- 46)
> > WFLYJSF0007: Activated the following JSF Implementations: [main]
> 
> > 14:38:51,696 INFO [org.jboss.as.connector] (MSC service thread 1-2)
> > WFLYJCA0009: Starting JCA Subsystem (IronJacamar 1.2.5.Final)
> 
> > 14:38:51,932 INFO [org.jboss.as.webservices] (ServerService Thread Pool --
> > 59) WFLYWS0002: Activating WebServices Extension
> 
> > 14:38:51,970 INFO [org.jboss.remoting] (MSC service thread 1-1) JBoss
> > Remoting version 4.0.9.Final
> 
> > 14:38:51,975 INFO [org.jboss.as.security] (ServerService Thread Pool -- 56)
> > WFLYSEC0002: Activating Security Subsystem
> 
> > 14:38:51,972 INFO [org.jboss.as.connector.subsystems.datasources]
> > (ServerService Thread Pool -- 35) WFLYJCA0004: Deploying JDBC-compliant
> > driver class org.h2.Driver (version 1.3)
> 
> > 14:38:51,971 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 57)
> > WFLYTX0013: Node identifier property is set to the default value. Please
> > make sure it is unique.
> 
> > 14:38:52,140 INFO [org.wildfly.extension.undertow] (ServerService Thread
> > Pool
> > -- 58) WFLYUT0003: Undertow 1.2.9.Final starting
> 
> > 14:38:52,187 INFO [org.jboss.as.security] (MSC service thread 1-2)
> > WFLYSEC0001: Current PicketBox version=4.9.2.Final
> 
> > 14:38:52,224 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service
> > thread
> > 1-1) WFLYJCA0018: Started Driver service with driver-name = postgresql
> 
> > 14:38:52,225 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service
> > thread
> > 1-1) WFLYJCA0018: Started Driver service with driver-name = h2
> 
> > 14:38:52,368 INFO [org.wildfly.extension.undertow] (MSC service thread 1-1)
> > WFLYUT0003: Undertow 1.2.9.Final starting
> 
> > 14:38:52,369 INFO [org.jboss.as.naming] (MSC service thread 1-2)
> > WFLYNAM0003:
> > Starting Naming Service
> 
> > 14:38:52,471 INFO [org.jboss.as.mail.extension] (MSC service thread 1-2)
> > WFLYMAIL0001: Bound mail session [java:jboss/mail/Default]
> 
> > 14:38:52,710 INFO [org.wildfly.extension.undertow] (ServerService Thread
> > Pool
> > -- 58) WFLYUT0014: Creating file handler for path
> > /opt/keycloak-1.7.0.Final/welcome-content
> 
> > 14:38:52,864 INFO [org.wildfly.extension.undertow] (MSC service thread 1-2)
> > WFLYUT0012: Started server default-server.
> 
> > 14:38:53,133 INFO [org.wildfly.extension.undertow] (MSC service thread 1-2)
> > WFLYUT0006: Undertow HTTP listener default listening on / 10.1.1.245:8080
> 
> > 14:38:53,166 INFO [org.wildfly.extension.undertow] (MSC service thread 1-2)
> > WFLYUT0018: Host default-host starting
> 
> > 14:38:53,192 INFO [org.wildfly.extension.undertow] (MSC service thread 1-2)
> > WFLYUT0006: Undertow AJP listener ajp listening on / 10.1.1.245:8009
> 
> > 14:38:53,211 INFO [org.jboss.modcluster] (ServerService Thread Pool -- 62)
> > MODCLUSTER000001: Initializing mod_cluster version 1.3.1.Final
> 
> > 14:38:53,307 INFO [org.jboss.modcluster] (ServerService Thread Pool -- 62)
> > MODCLUSTER000032: Listening to proxy advertisements on / 224.0.1.105:23364
> 
> > 14:38:53,779 INFO
> > [org.jboss.as.connector.subsystems.datasources.AbstractDataSourceService$AS7DataSourceDeployer]
> > (MSC service thread 1-2) IJ020018: Enabling <validate-on-match> for
> > java:jboss/datasources/PgDskeycloak
> 
> > 14:38:53,896 INFO [org.jboss.as.connector.subsystems.datasources] (MSC
> > service thread 1-1) WFLYJCA0001: Bound data source
> > [java:jboss/datasources/KeycloakDS]
> 
> > 14:38:53,903 INFO [org.jboss.as.connector.subsystems.datasources] (MSC
> > service thread 1-2) WFLYJCA0001: Bound data source
> > [java:jboss/datasources/ExampleDS]
> 
> > 14:38:53,909 INFO [org.jboss.as.connector.subsystems.datasources] (MSC
> > service thread 1-2) WFLYJCA0001: Bound data source
> > [java:jboss/datasources/PgDskeycloak]
> 
> > 14:38:54,118 INFO [org.jboss.as.server.deployment] (MSC service thread 1-2)
> > WFLYSRV0027: Starting deployment of "keycloak-server.war" (runtime-name:
> > "keycloak-server.war")
> 
> > 14:38:54,306 INFO [org.jboss.ws.common.management] (MSC service thread 1-1)
> > JBWS022052: Starting JBoss Web Services - Stack CXF Server 5.0.0.Final
> 
> > 14:38:56,138 INFO [stdout] (MSC service thread 1-2)
> 
> > 14:38:56,138 INFO [stdout] (MSC service thread 1-2)
> > -------------------------------------------------------------------
> 
> > 14:38:56,139 INFO [stdout] (MSC service thread 1-2) GMS:
> > address=ip-10-1-1-245, cluster=ee, physical address= 10.1.1.245:7600
> 
> > 14:38:56,139 INFO [stdout] (MSC service thread 1-2)
> > -------------------------------------------------------------------
> 
> > 14:38:56,606 INFO
> > [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService
> > Thread Pool -- 62) ISPN000078: Starting JGroups channel keycloak
> 
> > 14:38:56,623 INFO
> > [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService
> > Thread Pool -- 62) ISPN000094: Received new cluster view for channel
> > keycloak: [ip-10-1-1-245|0] (1) [ip-10-1-1-245]
> 
> > 14:38:56,644 INFO
> > [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ServerService
> > Thread Pool -- 62) ISPN000079: Channel keycloak local address is
> > ip-10-1-1-245, physical addresses are [ 10.1.1.245:7600 ]
> 
> > 14:38:56,651 INFO [org.infinispan.factories.GlobalComponentRegistry]
> > (ServerService Thread Pool -- 62) ISPN000128: Infinispan version:
> > Infinispan
> > 'Insanely Bad Elf' 7.2.3.Final
> 
> > 14:38:57,044 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 65) WFLYCLINF0002: Started users cache from keycloak container
> 
> > 14:38:57,050 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 62) WFLYCLINF0002: Started sessions cache from keycloak container
> 
> > 14:38:57,055 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 63) WFLYCLINF0002: Started realms cache from keycloak container
> 
> > 14:38:57,059 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 64) WFLYCLINF0002: Started loginFailures cache from keycloak
> > container
> 
> > 14:38:58,007 INFO [org.keycloak.services.resources.KeycloakApplication]
> > (ServerService Thread Pool -- 64) Load config from
> > /opt/keycloak-1.7.0.Final/standalone/configuration/keycloak-server.json
> 
> > 14:38:58,755 INFO [org.hibernate.jpa.internal.util.LogHelper]
> > (ServerService
> > Thread Pool -- 64) HHH000204: Processing PersistenceUnitInfo [
> 
> > name: keycloak-default
> 
> > ...]
> 
> > 14:38:58,812 INFO [org.hibernate.Version] (ServerService Thread Pool -- 64)
> > HHH000412: Hibernate Core {4.3.10.Final}
> 
> > 14:38:58,819 INFO [org.hibernate.cfg.Environment] (ServerService Thread
> > Pool
> > -- 64) HHH000206: hibernate.properties not found
> 
> > 14:38:58,824 INFO [org.hibernate.cfg.Environment] (ServerService Thread
> > Pool
> > -- 64) HHH000021: Bytecode provider name : javassist
> 
> > 14:38:59,268 INFO [org.hibernate.annotations.common.Version] (ServerService
> > Thread Pool -- 64) HCANN000001: Hibernate Commons Annotations {4.0.5.Final}
> 
> > 14:39:00,264 INFO [org.hibernate.dialect.Dialect] (ServerService Thread
> > Pool
> > -- 64) HHH000400: Using dialect: org.hibernate.dialect.PostgreSQL9Dialect
> 
> > 14:39:00,272 INFO [org.hibernate.engine.jdbc.internal.LobCreatorBuilder]
> > (ServerService Thread Pool -- 64) HHH000424: Disabling contextual LOB
> > creation as createClob() method threw error :
> > java.lang.reflect.InvocationTargetException
> 
> > 14:39:00,602 INFO
> > [org.hibernate.hql.internal.ast.ASTQueryTranslatorFactory]
> > (ServerService Thread Pool -- 64) HHH000397: Using
> > ASTQueryTranslatorFactory
> 
> > 14:39:00,634 INFO [org.hibernate.validator.internal.util.Version]
> > (ServerService Thread Pool -- 64) HV000001: Hibernate Validator 5.1.3.Final
> 
> > 14:39:04,607 INFO [org.jboss.as.clustering.infinispan] (ServerService
> > Thread
> > Pool -- 64) WFLYCLINF0002: Started offlineSessions cache from keycloak
> > container
> 
> > 14:39:04,665 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Deploying javax.ws.rs.core.Application: class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,667 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding class resource
> > org.keycloak.services.resources.WelcomeResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,667 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding class resource
> > org.keycloak.services.resources.QRCodeResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,668 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding class resource
> > org.keycloak.services.resources.JsResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,668 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding class resource
> > org.keycloak.services.resources.ThemeResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,668 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding provider singleton
> > org.keycloak.services.resources.ModelExceptionMapper from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,669 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding singleton resource
> > org.keycloak.services.resources.RealmsResource from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,669 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding provider singleton
> > org.keycloak.services.util.ObjectMapperResolver from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,669 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding singleton resource
> > org.keycloak.services.resources.ServerVersionResource from Application
> > class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,669 INFO [org.jboss.resteasy.spi.ResteasyDeployment]
> > (ServerService
> > Thread Pool -- 64) Adding singleton resource
> > org.keycloak.services.resources.admin.AdminRoot from Application class
> > org.keycloak.services.resources.KeycloakApplication
> 
> > 14:39:04,757 INFO [org.wildfly.extension.undertow] (ServerService Thread
> > Pool
> > -- 64) WFLYUT0021: Registered web context: /auth
> 
> > 14:39:04,844 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61)
> > WFLYSRV0010: Deployed "keycloak-server.war" (runtime-name :
> > "keycloak-server.war")
> 
> > 14:39:05,526 INFO [ org.jboss.as ] (Controller Boot Thread) WFLYSRV0060:
> > Http
> > management interface listening on http://10.1.1.245:9990/management
> 
> > 14:39:05,527 INFO [ org.jboss.as ] (Controller Boot Thread) WFLYSRV0051:
> > Admin console listening on http://10.1.1.245:9990
> 
> > 14:39:05,531 INFO [ org.jboss.as ] (Controller Boot Thread) WFLYSRV0025:
> > Keycloak 1.7.0.Final (WildFly Core 1.0.2.Final) started in 17727ms -
> > Started
> > 349 of 613 services (353 services are lazy, passive or on-demand)
> 

> > CHARLES-EDOUARD GAGNAIRE
> 
> > SysAdmin
> 
> > c.gagnaire at kreactive.com
> 
> > p. 06.27.80.28.53
> 
> > LYON "Le Capitole"
> 
> > 97, cours Gambetta
> 
> > 69481 Lyon Cedex 03
> 

> > PARIS
> 
> > 16, rue de Turbigo
> 
> > 75002 Paris
> 

> > 
> 

> > 2015-12-18 15:53 GMT+01:00 Alan Field < afield at redhat.com > :
> 

> > > Hey Charles,
> > 
> 

> > > Can you send the full logs and tell me which version of JGroups you are
> > > using?
> > 
> 

> > > Thanks,
> > 
> 
> > > Alan
> > 
> 

> > > > From: "charles-edouard gagnaire" < c.gagnaire at kreactive.com >
> > > 
> > 
> 
> > > > To: keycloak-user at lists.jboss.org
> > > 
> > 
> 
> > > > Sent: Friday, December 18, 2015 9:01:12 AM
> > > 
> > 
> 
> > > > Subject: [keycloak-user] Problem running keycloak cluster on EC2 with
> > > > S3_ping
> > > 
> > 
> 

> > > > hi,
> > > 
> > 
> 

> > > > I'm having trouble configuring a Keycloak cluster running on AWS' EC2.
> > > 
> > 
> 
> > > > The database configuration is OK no problem, but i can't manage to get
> > > > the
> > > > invalidation cache working correctly.
> > > 
> > 
> 
> > > > I configured Infinispan to work with S3_ping plugin (the relevant part
> > > > of
> > > > my
> > > > configuration is below).
> > > 
> > 
> 

> > > > When i run both server, the connection with the database is Ok, but the
> > > > infinispan logs look like this :
> > > 
> > 
> 
> > > > On Server 1 :
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 
> > > > 11:00:17,592 INFO [stdout] (MSC service thread 1-1) GMS:
> > > > address=ip-10-1-7-103, cluster=ee, physical address= 10.1.7.103:7600
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 
> > > > 11:00:18,057 INFO
> > > > [org.infinispan.remoting.transport.jgroups.JGroupsTransport]
> > > > (ServerService
> > > > Thread Pool -- 62) ISPN000094: Received new cluster view for channel
> > > > keycloak: [ip-10-1-7-103|0] (1) [ip-10-1-7-103]
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 

> > > > On Server 2 :
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 
> > > > 11:03:41,159 INFO [stdout] (MSC service thread 1-1) GMS:
> > > > address=ip-10-1-1-245, cluster=ee, physical address= 10.1.1.245:7600
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 
> > > > 11:03:41,783 INFO
> > > > [org.infinispan.remoting.transport.jgroups.JGroupsTransport]
> > > > (ServerService
> > > > Thread Pool -- 62) ISPN000094: Received new cluster view for channel
> > > > keycloak: [ip-10-1-1-245|0] (1) [ip-10-1-1-245]
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 

> > > > In my S3 bucket, i have 2 files created :
> > > 
> > 
> 
> > > > 402ea329-c135-f1e9-2782-02768779e02f.ip-10-1-1-245.list
> > > 
> > 
> 
> > > > a584321f-408b-b2ae-e2dd-d19333db96c4.ip-10-1-7-103.list
> > > 
> > 
> 

> > > > And the content of the files is like this :
> > > 
> > 
> 
> > > > File 1 :
> > > 
> > 
> 
> > > > ip-10-1-1-245 402ea329-c135-f1e9-2782-02768779e02f 10.1.1.245:7600 T
> > > 
> > 
> 

> > > > File 2 :
> > > 
> > 
> 
> > > > ip-10-1-7-103 a584321f-408b-b2ae-e2dd-d19333db96c4 10.1.7.103:7600 T
> > > 
> > 
> 

> > > > When i read the logs, it looks like the infinispan's cache can't
> > > > contact
> > > > each
> > > > other.
> > > 
> > 
> 
> > > > I double check my network config, and i tried connecting from one
> > > > server
> > > > to
> > > > the other using nc (like this: nc -vvv 10.1.7.103 7600) and this works
> > > > fine.
> > > 
> > 
> 

> > > > Is there a way to check the infinispan status of the servers?
> > > 
> > 
> 
> > > > Do you guys got any clue on how to make this works?
> > > 
> > 
> 

> > > > Thank you,
> > > 
> > 
> 
> > > > Charles-Edouard
> > > 
> > 
> 

> > > > My config looks like this :
> > > 
> > 
> 

> > > > - Standalone-ha.xml
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 
> > > > <datasources>
> > > 
> > 
> 
> > > > <driver name="postgresql" module="org.postgresql">
> > > 
> > 
> 
> > > > <datasource-class>org.postgresql.Driver</datasource-class>
> > > 
> > 
> 
> > > > <xa-datasource-class>org.postgresql.xa.PGXADataSource</xa-datasource-class>
> > > 
> > 
> 
> > > > </driver>
> > > 
> > 
> 
> > > > <datasource jndi-name="java:jboss/datasources/PgDskeycloak"
> > > > pool-name="PgDskeycloak" enabled="true" use-java-context="true">
> > > 
> > 
> 
> > > > <connection-url>jdbc:postgresql://****:5432/keycloak?ApplicationName=keycloak</connection-url>
> > > 
> > 
> 
> > > > <driver>postgresql</driver>
> > > 
> > 
> 
> > > > <pool>
> > > 
> > 
> 
> > > > <min-pool-size>5</min-pool-size>
> > > 
> > 
> 
> > > > <initial-pool-size>5</initial-pool-size>
> > > 
> > 
> 
> > > > <max-pool-size>100</max-pool-size>
> > > 
> > 
> 
> > > > <prefill>true</prefill>
> > > 
> > 
> 
> > > > </pool>
> > > 
> > 
> 
> > > > <validation>
> > > 
> > 
> 
> > > > <valid-connection-checker
> > > 
> > 
> 
> > > > class-name="org.jboss.jca.adapters.jdbc.extensions.postgres.PostgreSQLValidConnectionChecker"></valid-connection-checker>
> > > 
> > 
> 
> > > > <exception-sorter
> > > 
> > 
> 
> > > > class-name="org.jboss.jca.adapters.jdbc.extensions.postgres.PostgreSQLExceptionSorter"></exception-sorter>
> > > 
> > 
> 
> > > > </validation>
> > > 
> > 
> 
> > > > <security>
> > > 
> > 
> 
> > > > <user-name>****</user-name>
> > > 
> > 
> 
> > > > <password>****</password>
> > > 
> > 
> 
> > > > </security>
> > > 
> > 
> 
> > > > </datasource>
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 
> > > > <stacks default="tcp">
> > > 
> > 
> 
> > > > <stack name="udp">
> > > 
> > 
> 
> > > > <transport type="UDP" socket-binding="jgroups-udp"/>
> > > 
> > 
> 
> > > > <protocol type="PING"/>
> > > 
> > 
> 
> > > > <protocol type="MERGE3"/>
> > > 
> > 
> 
> > > > <protocol type="FD_SOCK" socket-binding="jgroups-udp-fd"/>
> > > 
> > 
> 
> > > > <protocol type="FD_ALL"/>
> > > 
> > 
> 
> > > > <protocol type="VERIFY_SUSPECT"/>
> > > 
> > 
> 
> > > > <protocol type="pbcast.NAKACK2"/>
> > > 
> > 
> 
> > > > <protocol type="UNICAST3"/>
> > > 
> > 
> 
> > > > <protocol type="pbcast.STABLE"/>
> > > 
> > 
> 
> > > > <protocol type="pbcast.GMS"/>
> > > 
> > 
> 
> > > > <protocol type="UFC"/>
> > > 
> > 
> 
> > > > <protocol type="MFC"/>
> > > 
> > 
> 
> > > > <protocol type="FRAG2"/>
> > > 
> > 
> 
> > > > <protocol type="RSVP"/>
> > > 
> > 
> 
> > > > </stack>
> > > 
> > 
> 
> > > > <stack name="tcp">
> > > 
> > 
> 
> > > > <transport type="TCP" socket-binding="jgroups-tcp"/>
> > > 
> > 
> 
> > > > <protocol type="S3_PING" >
> > > 
> > 
> 
> > > > <property name="location">****</property>
> > > 
> > 
> 
> > > > <property name="access_key">****</property>
> > > 
> > 
> 
> > > > <property name="secret_access_key">****</property>
> > > 
> > 
> 
> > > > </protocol>
> > > 
> > 
> 
> > > > <!-- <protocol type="MPING" socket-binding="jgroups-mping"/> -->
> > > 
> > 
> 
> > > > <protocol type="MERGE3"/>
> > > 
> > 
> 
> > > > <protocol type="FD_SOCK" socket-binding="jgroups-tcp-fd"/>
> > > 
> > 
> 
> > > > <protocol type="FD"/>
> > > 
> > 
> 
> > > > <protocol type="VERIFY_SUSPECT"/>
> > > 
> > 
> 
> > > > <protocol type="pbcast.NAKACK2"/>
> > > 
> > 
> 
> > > > <protocol type="UNICAST3"/>
> > > 
> > 
> 
> > > > <protocol type="pbcast.STABLE"/>
> > > 
> > 
> 
> > > > <protocol type="pbcast.GMS"/>
> > > 
> > 
> 
> > > > <protocol type="MFC"/>
> > > 
> > 
> 
> > > > <protocol type="FRAG2"/>
> > > 
> > 
> 
> > > > <protocol type="RSVP"/>
> > > 
> > 
> 
> > > > </stack>
> > > 
> > 
> 
> > > > ...
> > > 
> > 
> 
> > > > <interfaces>
> > > 
> > 
> 
> > > > <interface name="management">
> > > 
> > 
> 
> > > > <nic name="eth0"/>
> > > 
> > 
> 
> > > > </interface>
> > > 
> > 
> 
> > > > <interface name="public">
> > > 
> > 
> 
> > > > <nic name="eth0"/>
> > > 
> > 
> 
> > > > </interface>
> > > 
> > 
> 
> > > > <!-- TODO - only show this if the jacorb subsystem is added -->
> > > 
> > 
> 
> > > > <interface name="unsecure">
> > > 
> > 
> 
> > > > <!--
> > > 
> > 
> 
> > > > ~ Used for IIOP sockets in the standard configuration.
> > > 
> > 
> 
> > > > ~ To secure JacORB you need to setup SSL
> > > 
> > 
> 
> > > > -->
> > > 
> > 
> 
> > > > <nic name="eth0"/>
> > > 
> > 
> 
> > > > </interface>
> > > 
> > 
> 
> > > > </interfaces>
> > > 
> > 
> 

> > > > - keycloak-server.json
> > > 
> > 
> 
> > > > {
> > > 
> > 
> 
> > > > "providers": [
> > > 
> > 
> 
> > > > "classpath:${jboss.server.config.dir}/providers/*"
> > > 
> > 
> 
> > > > ],
> > > 
> > 
> 

> > > > "admin": {
> > > 
> > 
> 
> > > > "realm": "master"
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "eventsStore": {
> > > 
> > 
> 
> > > > "provider": "jpa",
> > > 
> > 
> 
> > > > "jpa": {
> > > 
> > 
> 
> > > > "exclude-events": [ "REFRESH_TOKEN" ]
> > > 
> > 
> 
> > > > }
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "realm": {
> > > 
> > 
> 
> > > > "provider": "jpa"
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "user": {
> > > 
> > 
> 
> > > > "provider": "jpa"
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "userSessionPersister": {
> > > 
> > 
> 
> > > > "provider": "jpa"
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "timer": {
> > > 
> > 
> 
> > > > "provider": "basic"
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "theme": {
> > > 
> > 
> 
> > > > "default": "keycloak",
> > > 
> > 
> 
> > > > "staticMaxAge": 2592000,
> > > 
> > 
> 
> > > > "cacheTemplates": true,
> > > 
> > 
> 
> > > > "cacheThemes": true,
> > > 
> > 
> 
> > > > "folder": {
> > > 
> > 
> 
> > > > "dir": "${jboss.server.config.dir}/themes"
> > > 
> > 
> 
> > > > }
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "scheduled": {
> > > 
> > 
> 
> > > > "interval": 900
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "connectionsHttpClient": {
> > > 
> > 
> 
> > > > "default": {
> > > 
> > 
> 
> > > > "disable-trust-manager": true
> > > 
> > 
> 
> > > > }
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "connectionsJpa": {
> > > 
> > 
> 
> > > > "default": {
> > > 
> > 
> 
> > > > "dataSource": "java:jboss/datasources/PgDskeycloak",
> > > 
> > 
> 
> > > > "databaseSchema": "update"
> > > 
> > 
> 
> > > > }
> > > 
> > 
> 
> > > > },
> > > 
> > 
> 

> > > > "connectionsInfinispan": {
> > > 
> > 
> 
> > > > "default" : {
> > > 
> > 
> 
> > > > "cacheContainer" : "java:jboss/infinispan/Keycloak"
> > > 
> > 
> 
> > > > }
> > > 
> > 
> 
> > > > }
> > > 
> > 
> 
> > > > }
> > > 
> > 
> 

> > > > CHARLES-EDOUARD GAGNAIRE
> > > 
> > 
> 
> > > > SysAdmin
> > > 
> > 
> 
> > > > c.gagnaire at kreactive.com
> > > 
> > 
> 
> > > > p. 06.27.80.28.53
> > > 
> > 
> 
> > > > LYON "Le Capitole"
> > > 
> > 
> 
> > > > 97, cours Gambetta
> > > 
> > 
> 
> > > > 69481 Lyon Cedex 03
> > > 
> > 
> 

> > > > PARIS
> > > 
> > 
> 
> > > > 16, rue de Turbigo
> > > 
> > 
> 
> > > > 75002 Paris
> > > 
> > 
> 

> > > > 
> > > 
> > 
> 

> > > > _______________________________________________
> > > 
> > 
> 
> > > > keycloak-user mailing list
> > > 
> > 
> 
> > > > keycloak-user at lists.jboss.org
> > > 
> > 
> 
> > > > https://lists.jboss.org/mailman/listinfo/keycloak-user
> > > 
> > 
> 
> _______________________________________________
> keycloak-user mailing list
> keycloak-user at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/keycloak-user
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/keycloak-user/attachments/20151218/9b6954f1/attachment-0001.html 


More information about the keycloak-user mailing list