August 2011 - gatein-issues - Jboss List Archives

[JBoss JIRA] Created: (GTNPORTAL-1870) Login time of user "root" depends on number of users in DB

by Marek Posolda (JIRA)

Login time of user "root" depends on number of users in DB ---------------------------------------------------------- Key: GTNPORTAL-1870 URL: https://issues.jboss.org/browse/GTNPORTAL-1870 Project: GateIn Portal Issue Type: Bug Security Level: Public (Everyone can see) Components: Identity integration, Performance Affects Versions: 3.1.0-GA Environment: EPP 5.1.0.GA Reporter: Marek Posolda Assignee: Boleslaw Dawidowicz Fix For: 3.2.0-GA When we have 100000 users in DB, then login of user root took me 3 minutes on my laptop. With million users in DB is login of user root impossible . The cause is that method GroupDAOImpl.getAllGroups() is called for user "root" and CPU time of this method depends on number of users in database. This method has 2 possible bottlenecks: 1) Method GroupDAOImpl.getAllGroups() is internally running RelationshipManagerImpl.findAssociatedGroups for root group, which in next turn means recursive call of method RelationshipManagerImpl.findAssociatedGroups for each group in DB. This method is sending SQL, which is looking for all children under specified group. Problem is that these children can be both users or other groups and users are then filtered and removed from final result by algorithm at the end of method RelationshipManagerImpl.findAssociatedGroups(). When having 1000000 users and method RelationshipManagerImpl.findAssociatedGroups() is called for IDM group equivalent to "/platform/users", then we have 1000000 objects in result from Hibernate call. And this is the cause of bottleneck. This SQL is called (4 is ID of group "users" in table "jbid_io") : select distinct hibernatei1_.ID as ID4_, hibernatei1_.IDENTITY_TYPE as IDENTITY2_4_, hibernatei1_.NAME as NAME4_, hibernatei1_.REALM as REALM4_ from jbid_io_rel hibernatei0_ inner join jbid_io hibernatei1_ on hibernatei0_.TO_IDENTITY=hibernatei1_.ID, jbid_io_rel_type hibernatei3_ where hibernatei0_.REL_TYPE=hibernatei3_.ID and (hibernatei1_.NAME like '%') and hibernatei3_.NAME='JBOSS_IDENTITY_MEMBERSHIP' and hibernatei0_.FROM_IDENTITY=4; Running of this SQL is expensive and another thing, which I am seeing from profiling, is that big amount of CPU time is also spend by caching of this result in Hibernate Query Cache (which is very bad for memory as well because it needs to cache 1000000 HibernateIdentityObject instances with all users). 2) Second thing in GroupDAOImpl.getAllGroups() is calling of method convertGroup(), which needs to call DB requests to obtain attributes for concrete group. Hibernate is using these selects (for group with ID 1) for obtain attributes: select attributes0_.IDENTITY_OBJECT_ID as IDENTITY2_4_1_, attributes0_.ATTRIBUTE_ID as ATTRIBUTE1_1_, attributes0_.ATTRIBUTE_ID as ATTRIBUTE1_9_0_, attributes0_.IDENTITY_OBJECT_ID as IDENTITY2_9_0_, attributes0_.NAME as NAME9_0_, attributes0_.ATTRIBUTE_TYPE as ATTRIBUTE4_9_0_, attributes0_.BIN_VALUE_ID as BIN5_9_0_ from jbid_io_attr attributes0_ where attributes0_.IDENTITY_OBJECT_ID in (select hibernatei1_.ID from jbid_io_rel hibernatei0_ inner join jbid_io hibernatei1_ on hibernatei0_.TO_IDENTITY=hibernatei1_.ID, jbid_io_rel_type hibernatei3_ where hibernatei0_.REL_TYPE=hibernatei3_.ID and (hibernatei1_.NAME like '%') and hibernatei3_.NAME='JBOSS_IDENTITY_MEMBERSHIP' and hibernatei0_.FROM_IDENTITY=1); select textvalues0_.TEXT_ATTR_VALUE_ID as TEXT1_9_0_, textvalues0_.ATTR_VALUE as ATTR2_0_ from jbid_io_attr_text_values textvalues0_ where textvalues0_.TEXT_ATTR_VALUE_ID in (select attributes0_.ATTRIBUTE_ID from jbid_io_attr attributes0_ where attributes0_.IDENTITY_OBJECT_ID in (select hibernatei1_.ID from jbid_io_rel hibernatei0_ inner join jbid_io hibernatei1_ on hibernatei0_.TO_IDENTITY=hibernatei1_.ID, jbid_io_rel_type hibernatei3_ where hibernatei0_.REL_TYPE=hibernatei3_.ID and (hibernatei1_.NAME like '%') and hibernatei3_.NAME='JBOSS_IDENTITY_MEMBERSHIP' and hibernatei0_.FROM_IDENTITY=1)); When profiling, I am seeing that these selects are slow because attributes of groups are in same DB table as attributes of user ( When we have million users and each user has 7 attributes, then we have around 7000000 items in tables "jbid_io_attr" and in table "jbid_io_attr_text_values" ) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

3
3
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-2026) CustomMembershipLoginModule should end lifecycle in case of an error

by Boleslaw Dawidowicz (JIRA)

CustomMembershipLoginModule should end lifecycle in case of an error -------------------------------------------------------------------- Key: GTNPORTAL-2026 URL: https://issues.jboss.org/browse/GTNPORTAL-2026 Project: GateIn Portal Issue Type: Bug Security Level: Public (Everyone can see) Affects Versions: 3.2.0-M01 Reporter: Boleslaw Dawidowicz Assignee: Boleslaw Dawidowicz Fix For: 3.2.0-M02 A misconfiguration of the CustomMembershipLoginModule (eg. an incorrect/missing membershipType value), the addUserToPlatformUsers method fails with the following error: javax.naming.InvalidNameException: Can not create membership record for jduke1 because membership type is null at org.exoplatform.services.organization.idm.MembershipDAOImpl.linkMembership(MembershipDAOImpl.java:131) at org.exoplatform.services.organization.idm.CustomMembershipLoginModule.addUserToPlatformUsers(CustomMembershipLoginModule.java:156) at org.exoplatform.services.organization.idm.CustomMembershipLoginModule.login(CustomMembershipLoginModule.java:102) As a consequence, the RequestLifeCycle.end() method won't be called, which results in an unclosed db connection: INFO [CachedConnectionManager] Closing a connection for you. Please close them yourself: org.jboss.resource.adapter.jdbc.jdk6.WrappedConnectionJDK6@7e138f1b java.lang.Throwable: STACKTRACE ... at org.exoplatform.services.organization.idm.CustomMembershipLoginModule.begin(CustomMembershipLoginModule.java:170) at org.exoplatform.services.organization.idm.CustomMembershipLoginModule.addUserToPlatformUsers(CustomMembershipLoginModule.java:152) at org.exoplatform.services.organization.idm.CustomMembershipLoginModule.login(CustomMembershipLoginModule.java:102) The end(orgService) call should be made in a finally() block. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

1
1
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-1692) Decouple gadget import process and gadget import metadata extraction

by Julien Viet (JIRA)

Decouple gadget import process and gadget import metadata extraction -------------------------------------------------------------------- Key: GTNPORTAL-1692 URL: https://jira.jboss.org/browse/GTNPORTAL-1692 Project: GateIn Portal Issue Type: Task Security Level: Public (Everyone can see) Reporter: Julien Viet Assignee: Julien Viet Gadget import details should be managed in the GadgetRegistryService. Gadget metadata extraction should be managed by the GadgetDeployer and the gadget importer. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

2
2
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-2001) Cannot edit a local gadget

by Khoi Nguyen (JIRA)

Cannot edit a local gadget -------------------------- Key: GTNPORTAL-2001 URL: https://issues.jboss.org/browse/GTNPORTAL-2001 Project: GateIn Portal Issue Type: Bug Security Level: Public (Everyone can see) Reporter: Khoi Nguyen Now, the local gadget content is encoded in gadget editor form, so when we edit and save the gadget, there is warning message -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

3
2
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-2024) can't retrieve a navigation based on ID

by Matt Wringe (JIRA)

can't retrieve a navigation based on ID --------------------------------------- Key: GTNPORTAL-2024 URL: https://issues.jboss.org/browse/GTNPORTAL-2024 Project: GateIn Portal Issue Type: Bug Security Level: Public (Everyone can see) Components: Java API Reporter: Matt Wringe can't retrieve a navigation using either Navigation.getId(childNavigation.getId()) Navigation.getId(childNavigation.getId().toString()) or Navigation.getId(Navigation.getIdForChild(ChildNavigation.getId())) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

1
0
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-2023) Stale storage id's result in error during rollback for pages and site layout.

by Nick Scavelli (JIRA)

Stale storage id's result in error during rollback for pages and site layout. ----------------------------------------------------------------------------- Key: GTNPORTAL-2023 URL: https://issues.jboss.org/browse/GTNPORTAL-2023 Project: GateIn Portal Issue Type: Bug Security Level: Public (Everyone can see) Components: Management Affects Versions: 3.2.0-M02 Reporter: Nick Scavelli Assignee: Nick Scavelli During rollback, storage id's are used when trying to save stale object data. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

1
2
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-2022) Merge gatein management mop extension into trunk.

by Nick Scavelli (JIRA)

Merge gatein management mop extension into trunk. ------------------------------------------------- Key: GTNPORTAL-2022 URL: https://issues.jboss.org/browse/GTNPORTAL-2022 Project: GateIn Portal Issue Type: Task Security Level: Public (Everyone can see) Components: Management Reporter: Nick Scavelli Assignee: Nick Scavelli Fix For: 3.2.0-M02 Merge branch gatein-management r6919 to trunk. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

1
1
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-2020) NPE when calling navigation.getURI()

by Matt Wringe (JIRA)

NPE when calling navigation.getURI() ------------------------------------ Key: GTNPORTAL-2020 URL: https://issues.jboss.org/browse/GTNPORTAL-2020 Project: GateIn Portal Issue Type: Bug Security Level: Public (Everyone can see) Components: Java API Reporter: Matt Wringe 10:42:32,587 ERROR [STDERR] Caused by: java.lang.NullPointerException 10:42:32,587 ERROR [STDERR] at org.gatein.portal.api.impl.portal.NavigationImpl.getURI(NavigationImpl.java:118) 10:42:32,587 ERROR [STDERR] at org.gatein.api.rest.resource.handler.SitesHandler.toNodeResource(SitesHandler.java:164) 10:42:32,587 ERROR [STDERR] at org.gatein.api.rest.resource.handler.SitesHandler.getNodesResourceForPortal(SitesHandler.java:147) 10:42:32,587 ERROR [STDERR] at org.gatein.api.rest.service.SitesService.getNodes(SitesService.java:152) 10:42:32,587 ERROR [STDERR] ... 47 more -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

1
0
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-2019) Can't retrieve a page from a navigation

by Matt Wringe (JIRA)

Can't retrieve a page from a navigation --------------------------------------- Key: GTNPORTAL-2019 URL: https://issues.jboss.org/browse/GTNPORTAL-2019 Project: GateIn Portal Issue Type: Bug Security Level: Public (Everyone can see) Components: Java API Reporter: Matt Wringe When trying to call getTargetPage() on a navigation from a portal object, it fails with the following error: 10:37:23,161 ERROR [STDERR] Caused by: java.lang.IllegalArgumentException: Invalid value 'portal::classic::homepage' for component 'page'. Valid values should match: '\w+' 10:37:23,161 ERROR [STDERR] at org.gatein.api.id.Component.validate(Component.java:67) 10:37:23,161 ERROR [STDERR] at org.gatein.api.id.GenericContext.validate(GenericContext.java:245) 10:37:23,161 ERROR [STDERR] at org.gatein.api.id.GenericId.getIdForChild(GenericId.java:67) 10:37:23,161 ERROR [STDERR] at org.gatein.portal.api.impl.GateInImpl.pageId(GateInImpl.java:661) 10:37:23,161 ERROR [STDERR] at org.gatein.portal.api.impl.portal.NavigationImpl.getTargetPage(NavigationImpl.java:155) 10:37:23,161 ERROR [STDERR] at org.gatein.api.rest.resource.handler.SitesHandler.toNodeResource(SitesHandler.java:163) 10:37:23,161 ERROR [STDERR] at org.gatein.api.rest.resource.handler.SitesHandler.getNodesResourceForPortal(SitesHandler.java:147) 10:37:23,161 ERROR [STDERR] at org.gatein.api.rest.service.SitesService.getNodes(SitesService.java:152) 10:37:23,161 ERROR [STDERR] ... 47 more -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

1
0
0 / 0

[JBoss JIRA] Created: (GTNPORTAL-2018) NPE when trying to get a navigation's display name

by Matt Wringe (JIRA)

NPE when trying to get a navigation's display name -------------------------------------------------- Key: GTNPORTAL-2018 URL: https://issues.jboss.org/browse/GTNPORTAL-2018 Project: GateIn Portal Issue Type: Bug Security Level: Public (Everyone can see) Components: Java API Reporter: Matt Wringe 10:32:39,935 ERROR [STDERR] Caused by: java.lang.NullPointerException 10:32:39,935 ERROR [STDERR] at org.gatein.portal.api.impl.portal.NavigationImpl.getUserLocale(NavigationImpl.java:323) 10:32:39,935 ERROR [STDERR] at org.gatein.portal.api.impl.portal.NavigationImpl.getDisplayName(NavigationImpl.java:300) 10:32:39,936 ERROR [STDERR] at org.gatein.api.rest.resource.handler.SitesHandler.toNodeResource(SitesHandler.java:158) 10:32:39,936 ERROR [STDERR] at org.gatein.api.rest.resource.handler.SitesHandler.getNodesResourceForPortal(SitesHandler.java:147) 10:32:39,936 ERROR [STDERR] at org.gatein.api.rest.service.SitesService.getNodes(SitesService.java:152) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

14 years, 8 months

1
0
0 / 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

gatein-issues August 2011