Error

From kalc04 at gmail.com Fri Jun 12 01:33:43 2015 Content-Type: multipart/mixed; boundary="===============9049017425909957862==" MIME-Version: 1.0 From: Lohitha Chiranjeewa To: keycloak-user at lists.jboss.org Subject: [keycloak-user] Exception thrown when deleting user through API (when Keycloak servers are highly available) Date: Fri, 12 Jun 2015 11:03:42 +0530 Message-ID: --===============9049017425909957862== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi, We're running into a bit of a problem when trying to delete users through the API. The error returned is of HTML format with 500 error code: ErrorInternal Server Error Please note: - We're using Infinispan for userSessions, realmCache and userCache. Rest of the data is in MySQL. - Issue only occurs when Keycloak servers are highly available (2 servers in our case). Works fine when only one server is up. Logs reveal that this is possibly a serialization issue related to Infinispan: [2015-06-12 04:56:54.0303], ERROR, org.infinispan.interceptors.InvocationContextInterceptor default task-11 - ISPN000136: Execution error: org.infinispan.commons.CacheException: java.lang.RuntimeException: Failure to marshal argument(s) at org.infinispan.commons.util.Util.rewrapAsCacheException(Util.java:581) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeR= emoteCommand(CommandAwareRpcDispatcher.java:176) at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(J= GroupsTransport.java:521) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.ja= va:281) Caused by: java.lang.RuntimeException: Failure to marshal argument(s) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.marshal= lCall(CommandAwareRpcDispatcher.java:333) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.process= SingleCall(CommandAwareRpcDispatcher.java:352) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeR= emoteCommand(CommandAwareRpcDispatcher.java:167) ... 94 more Caused by: org.infinispan.commons.marshall.NotSerializableException: org.keycloak.models.sessions.infinispan.entities.LoginFailureKey Caused by: an exception which occurred: in object org.keycloak.models.sessions.infinispan.entities.LoginFailureKey(a)f42bdd72 -> toString =3D org.keycloak.models.sessions.infinispan.entities.LoginFailureKey(a)f42bdd72 in object org.infinispan.commands.write.RemoveCommand(a)914fd0ce -> toString =3D RemoveCommand{key=3Dorg.keycloak.models.sessions.infinispan.entities.LoginF= ailureKey(a)f42bdd72, value=3Dnull, flags=3Dnull, valueMatcher=3DMATCH_ALWAYS} in object org.infinispan.commands.remote.SingleRpcCommand(a)bfee4c5c -> toString =3D SingleRpcCommand{cacheName=3D'loginFailures', command=3DRemoveCommand{key=3Dorg.keycloak.models.sessions.infinispan.entit= ies.LoginFailureKey(a)f42bdd72, value=3Dnull, flags=3Dnull, valueMatcher=3DMATCH_ALWAYS}} Also there's a DEBUG log as follows: [2015-06-12 04:56:54.0301], DEBUG, org.infinispan.marshall.core.VersionAwareMarshaller default task-11 - Object is not serializable: java.io.NotSerializableException: org.keycloak.models.sessions.infinispan.entities.LoginFailureKey at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.j= ava:860) at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput= .java:58) at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.jav= a:111) at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeCommandPara= meters(ReplicableCommandExternalizer.java:57) at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(Repl= icableCommandExternalizer.java:42) at org.infinispan.marshall.exts.ReplicableCommandExternalizer.writeObject(Repl= icableCommandExternalizer.java:30) at org.infinispan.marshall.core.ExternalizerTable$ExternalizerAdapter.writeObj= ect(ExternalizerTable.java:395) at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.j= ava:138) Our Keycloak HA system works fine except for this issue. Please advise on how tackle this. Regards, Lohitha. --===============9049017425909957862== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2PjxkaXY+PGRpdj48ZGl2PjxkaXY+SGksPGJyPjxicj48 L2Rpdj5XZSYjMzk7cmUgcnVubmluZyBpbnRvIGEgYml0IG9mIGEgcHJvYmxlbSB3aGVuIHRyeWlu ZyB0byBkZWxldGUgdXNlcnMgdGhyb3VnaCB0aGUgQVBJLiBUaGUgZXJyb3IgcmV0dXJuZWQgaXMg b2YgSFRNTCBmb3JtYXQgd2l0aCA1MDAgZXJyb3IgY29kZTo8YnI+Jmx0O2h0bWwmZ3Q7Jmx0O2hl YWQmZ3Q7Jmx0O3RpdGxlJmd0O0Vycm9yJmx0Oy90aXRsZSZndDsmbHQ7L2hlYWQmZ3Q7Jmx0O2Jv ZHkmZ3Q7SW50ZXJuYWwgU2VydmVyIEVycm9yJmx0Oy9ib2R5Jmd0OyZsdDsvaHRtbCZndDs8YnI+ PGJyPjwvZGl2PjxkaXY+UGxlYXNlIG5vdGU6IDxicj4tIFdlJiMzOTtyZSB1c2luZyBJbmZpbmlz cGFuIGZvciB1c2VyU2Vzc2lvbnMsIHJlYWxtQ2FjaGUgYW5kIHVzZXJDYWNoZS4gUmVzdCBvZiB0 aGUgZGF0YSBpcyBpbiBNeVNRTC48YnI+PC9kaXY+PGRpdj4tIElzc3VlIG9ubHkgb2NjdXJzIHdo ZW4gS2V5Y2xvYWsgc2VydmVycyBhcmUgaGlnaGx5IGF2YWlsYWJsZSAoMiBzZXJ2ZXJzIGluIG91 ciBjYXNlKS4gV29ya3MgZmluZSB3aGVuIG9ubHkgb25lIHNlcnZlciBpcyB1cC4gPGJyPjwvZGl2 PjxkaXY+PGJyPjwvZGl2PkxvZ3MgcmV2ZWFsIHRoYXQgdGhpcyBpcyBwb3NzaWJseSBhIHNlcmlh bGl6YXRpb24gaXNzdWUgcmVsYXRlZCB0byBJbmZpbmlzcGFuOjxicj48YnI+WzIwMTUtMDYtMTIg MDQ6NTY6NTQuMDMwM10sIEVSUk9SLCBvcmcuaW5maW5pc3Bhbi5pbnRlcmNlcHRvcnMuSW52b2Nh dGlvbkNvbnRleHRJbnRlcmNlcHRvciBkZWZhdWx0IHRhc2stMTEgLSBJU1BOMDAwMTM2OiBFeGVj dXRpb24gZXJyb3I6IG9yZy5pbmZpbmlzcGFuLmNvbW1vbnMuQ2FjaGVFeGNlcHRpb246IGphdmEu bGFuZy5SdW50aW1lRXhjZXB0aW9uOiBGYWlsdXJlIHRvIG1hcnNoYWwgYXJndW1lbnQocyk8YnI+ wqDCoMKgIGF0IG9yZy5pbmZpbmlzcGFuLmNvbW1vbnMudXRpbC5VdGlsLnJld3JhcEFzQ2FjaGVF eGNlcHRpb24oVXRpbC5qYXZhOjU4MSk8YnI+wqDCoMKgIGF0IG9yZy5pbmZpbmlzcGFuLnJlbW90 aW5nLnRyYW5zcG9ydC5qZ3JvdXBzLkNvbW1hbmRBd2FyZVJwY0Rpc3BhdGNoZXIuaW52b2tlUmVt b3RlQ29tbWFuZChDb21tYW5kQXdhcmVScGNEaXNwYXRjaGVyLmphdmE6MTc2KTxicj7CoMKgwqAg YXQgb3JnLmluZmluaXNwYW4ucmVtb3RpbmcudHJhbnNwb3J0Lmpncm91cHMuSkdyb3Vwc1RyYW5z cG9ydC5pbnZva2VSZW1vdGVseShKR3JvdXBzVHJhbnNwb3J0LmphdmE6NTIxKTxicj7CoMKgwqAg YXQgb3JnLmluZmluaXNwYW4ucmVtb3RpbmcucnBjLlJwY01hbmFnZXJJbXBsLmludm9rZVJlbW90 ZWx5KFJwY01hbmFnZXJJbXBsLmphdmE6MjgxKTxicj5DYXVzZWQgYnk6IGphdmEubGFuZy5SdW50 aW1lRXhjZXB0aW9uOiBGYWlsdXJlIHRvIG1hcnNoYWwgYXJndW1lbnQocyk8YnI+wqDCoMKgIGF0 IG9yZy5pbmZpbmlzcGFuLnJlbW90aW5nLnRyYW5zcG9ydC5qZ3JvdXBzLkNvbW1hbmRBd2FyZVJw Y0Rpc3BhdGNoZXIubWFyc2hhbGxDYWxsKENvbW1hbmRBd2FyZVJwY0Rpc3BhdGNoZXIuamF2YToz MzMpPGJyPsKgwqDCoCBhdCBvcmcuaW5maW5pc3Bhbi5yZW1vdGluZy50cmFuc3BvcnQuamdyb3Vw cy5Db21tYW5kQXdhcmVScGNEaXNwYXRjaGVyLnByb2Nlc3NTaW5nbGVDYWxsKENvbW1hbmRBd2Fy ZVJwY0Rpc3BhdGNoZXIuamF2YTozNTIpPGJyPsKgwqDCoCBhdCBvcmcuaW5maW5pc3Bhbi5yZW1v dGluZy50cmFuc3BvcnQuamdyb3Vwcy5Db21tYW5kQXdhcmVScGNEaXNwYXRjaGVyLmludm9rZVJl bW90ZUNvbW1hbmQoQ29tbWFuZEF3YXJlUnBjRGlzcGF0Y2hlci5qYXZhOjE2Nyk8YnI+wqDCoMKg IC4uLiA5NCBtb3JlPGJyPkNhdXNlZCBieTogb3JnLmluZmluaXNwYW4uY29tbW9ucy5tYXJzaGFs bC5Ob3RTZXJpYWxpemFibGVFeGNlcHRpb246IG9yZy5rZXljbG9hay5tb2RlbHMuc2Vzc2lvbnMu aW5maW5pc3Bhbi5lbnRpdGllcy5Mb2dpbkZhaWx1cmVLZXk8YnI+Q2F1c2VkIGJ5OiBhbiBleGNl cHRpb24gd2hpY2ggb2NjdXJyZWQ6PGJyPsKgwqDCoCBpbiBvYmplY3Qgb3JnLmtleWNsb2FrLm1v ZGVscy5zZXNzaW9ucy5pbmZpbmlzcGFuLmVudGl0aWVzLkxvZ2luRmFpbHVyZUtleUBmNDJiZGQ3 Mjxicj7CoMKgwqAgwqDCoMKgIC0mZ3Q7IHRvU3RyaW5nID0gb3JnLmtleWNsb2FrLm1vZGVscy5z ZXNzaW9ucy5pbmZpbmlzcGFuLmVudGl0aWVzLkxvZ2luRmFpbHVyZUtleUBmNDJiZGQ3Mjxicj7C oMKgwqAgaW4gb2JqZWN0IG9yZy5pbmZpbmlzcGFuLmNvbW1hbmRzLndyaXRlLlJlbW92ZUNvbW1h bmRAOTE0ZmQwY2U8YnI+wqDCoMKgIMKgwqDCoCAtJmd0OyB0b1N0cmluZyA9IFJlbW92ZUNvbW1h bmR7a2V5PW9yZy5rZXljbG9hay5tb2RlbHMuc2Vzc2lvbnMuaW5maW5pc3Bhbi5lbnRpdGllcy5M b2dpbkZhaWx1cmVLZXlAZjQyYmRkNzIsIHZhbHVlPW51bGwsIGZsYWdzPW51bGwsIHZhbHVlTWF0 Y2hlcj1NQVRDSF9BTFdBWVN9PGJyPsKgwqDCoCBpbiBvYmplY3Qgb3JnLmluZmluaXNwYW4uY29t bWFuZHMucmVtb3RlLlNpbmdsZVJwY0NvbW1hbmRAYmZlZTRjNWM8YnI+wqDCoMKgIMKgwqDCoCAt Jmd0OyB0b1N0cmluZyA9IFNpbmdsZVJwY0NvbW1hbmR7Y2FjaGVOYW1lPSYjMzk7bG9naW5GYWls dXJlcyYjMzk7LCBjb21tYW5kPVJlbW92ZUNvbW1hbmR7a2V5PW9yZy5rZXljbG9hay5tb2RlbHMu c2Vzc2lvbnMuaW5maW5pc3Bhbi5lbnRpdGllcy5Mb2dpbkZhaWx1cmVLZXlAZjQyYmRkNzIsIHZh bHVlPW51bGwsIGZsYWdzPW51bGwsIHZhbHVlTWF0Y2hlcj1NQVRDSF9BTFdBWVN9fTxicj48YnI+ PC9kaXY+PGJyPkFsc28gdGhlcmUmIzM5O3MgYSBERUJVRyBsb2cgYXMgZm9sbG93czo8YnI+PGJy PlsyMDE1LTA2LTEyIDA0OjU2OjU0LjAzMDFdLCBERUJVRywgb3JnLmluZmluaXNwYW4ubWFyc2hh bGwuY29yZS5WZXJzaW9uQXdhcmVNYXJzaGFsbGVyIGRlZmF1bHQgdGFzay0xMSAtIE9iamVjdCBp cyBub3Qgc2VyaWFsaXphYmxlOiBqYXZhLmlvLk5vdFNlcmlhbGl6YWJsZUV4Y2VwdGlvbjogb3Jn LmtleWNsb2FrLm1vZGVscy5zZXNzaW9ucy5pbmZpbmlzcGFuLmVudGl0aWVzLkxvZ2luRmFpbHVy ZUtleTxicj7CoMKgwqAgYXQgb3JnLmpib3NzLm1hcnNoYWxsaW5nLnJpdmVyLlJpdmVyTWFyc2hh bGxlci5kb1dyaXRlT2JqZWN0KFJpdmVyTWFyc2hhbGxlci5qYXZhOjg2MCk8YnI+wqDCoMKgIGF0 IG9yZy5qYm9zcy5tYXJzaGFsbGluZy5BYnN0cmFjdE9iamVjdE91dHB1dC53cml0ZU9iamVjdChB YnN0cmFjdE9iamVjdE91dHB1dC5qYXZhOjU4KTxicj7CoMKgwqAgYXQgb3JnLmpib3NzLm1hcnNo YWxsaW5nLkFic3RyYWN0TWFyc2hhbGxlci53cml0ZU9iamVjdChBYnN0cmFjdE1hcnNoYWxsZXIu amF2YToxMTEpPGJyPsKgwqDCoCBhdCBvcmcuaW5maW5pc3Bhbi5tYXJzaGFsbC5leHRzLlJlcGxp Y2FibGVDb21tYW5kRXh0ZXJuYWxpemVyLndyaXRlQ29tbWFuZFBhcmFtZXRlcnMoUmVwbGljYWJs ZUNvbW1hbmRFeHRlcm5hbGl6ZXIuamF2YTo1Nyk8YnI+wqDCoMKgIGF0IG9yZy5pbmZpbmlzcGFu Lm1hcnNoYWxsLmV4dHMuUmVwbGljYWJsZUNvbW1hbmRFeHRlcm5hbGl6ZXIud3JpdGVPYmplY3Qo UmVwbGljYWJsZUNvbW1hbmRFeHRlcm5hbGl6ZXIuamF2YTo0Mik8YnI+wqDCoMKgIGF0IG9yZy5p bmZpbmlzcGFuLm1hcnNoYWxsLmV4dHMuUmVwbGljYWJsZUNvbW1hbmRFeHRlcm5hbGl6ZXIud3Jp dGVPYmplY3QoUmVwbGljYWJsZUNvbW1hbmRFeHRlcm5hbGl6ZXIuamF2YTozMCk8YnI+wqDCoMKg IGF0IG9yZy5pbmZpbmlzcGFuLm1hcnNoYWxsLmNvcmUuRXh0ZXJuYWxpemVyVGFibGUkRXh0ZXJu YWxpemVyQWRhcHRlci53cml0ZU9iamVjdChFeHRlcm5hbGl6ZXJUYWJsZS5qYXZhOjM5NSk8YnI+ wqDCoMKgIGF0IG9yZy5qYm9zcy5tYXJzaGFsbGluZy5yaXZlci5SaXZlck1hcnNoYWxsZXIuZG9X cml0ZU9iamVjdChSaXZlck1hcnNoYWxsZXIuamF2YToxMzgpPGJyPjxicj48YnI+PC9kaXY+T3Vy IEtleWNsb2FrIEhBIHN5c3RlbSB3b3JrcyBmaW5lIGV4Y2VwdCBmb3IgdGhpcyBpc3N1ZS4gUGxl YXNlIGFkdmlzZSBvbiBob3cgdGFja2xlIHRoaXMuPGJyPjxicj48YnI+PC9kaXY+UmVnYXJkcyw8 YnI+PC9kaXY+TG9oaXRoYS4gPGJyPjwvZGl2Pgo= --===============9049017425909957862==--