[hibernate-issues] [Hibernate-JIRA] Commented: (HSEARCH-513) Experiencing long delays when indexing entities saved in different transactions
Florin Haizea (JIRA)
noreply at atlassian.com
Fri May 7 23:01:49 EDT 2010
[ http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=36980#action_36980 ]
Florin Haizea commented on HSEARCH-513:
---------------------------------------
I reproduced the whole scenario again. Here's what I did:
1) created a test project from the sources found in HibernateSearchJira.zip (using IntellijIdea under Windows)
2) imported all the libs from AllLibsExceptSpringAndHibernate.zip, SpringAndHibernateLibs.zip and hibernate3.jar (which I forgot to add initially)
2) created the DB using schema.sql
3) ran GedcomManagerTests.testSavePeople() from Intellij (with these memory settings: -Xms256m -Xmx1024m -XX:MaxPermSize=120m -ea)
and obtained the attached output.
Here is a sample of the output of a second run:
Saving batch number 250
Finished saving batch number 250in 203millis
Saving batch number 251
Finished saving batch number 251in 203millis
Saving batch number 252
Finished saving batch number 252in 219millis
Saving batch number 253
Finished saving batch number 253in 156millis
Saving batch number 254
Finished saving batch number 254in 453millis
Saving batch number 255
Finished saving batch number 255in 1265millis
Saving batch number 256
Finished saving batch number 256in 10297millis
Saving batch number 257
Finished saving batch number 257in 281millis
Saving batch number 258
Finished saving batch number 258in 1125millis
Saving batch number 259
Finished saving batch number 259in 172millis
Saving batch number 260
Finished saving batch number 260in 375millis
Saving batch number 261
Finished saving batch number 261in 672millis
Saving batch number 262
Finished saving batch number 262in 125millis
Saving batch number 263
Finished saving batch number 263in 219millis
Saving batch number 264
Finished saving batch number 264in 312millis
Saving batch number 265
Finished saving batch number 265in 188millis
Saving batch number 266
Finished saving batch number 266in 250millis
Saving batch number 267
Finished saving batch number 267in 219millis
Saving batch number 268
Finished saving batch number 268in 672millis
Saving batch number 269
Finished saving batch number 269in 250millis
Saving batch number 270
Finished saving batch number 270in 421millis
Saving batch number 271
Finished saving batch number 271in 297millis
Saving batch number 272
Finished saving batch number 272in 328millis
Saving batch number 273
Finished saving batch number 273in 73141millis
Saving batch number 274
Finished saving batch number 274in 141millis
Saving batch number 275
Finished saving batch number 275in 312millis
Saving batch number 276
Finished saving batch number 276in 719millis
Saving batch number 277
Finished saving batch number 277in 328millis
Saving batch number 278
Finished saving batch number 278in 219millis
Saving batch number 279
Finished saving batch number 279in 33969millis
Saving batch number 280
Finished saving batch number 280in 234millis
Saving batch number 281
Finished saving batch number 281in 297millis
Saving batch number 282
Finished saving batch number 282in 140millis
Saving batch number 283
Finished saving batch number 283in 141millis
Saving batch number 284
Finished saving batch number 284in 188millis
Saving batch number 285
Finished saving batch number 285in 312millis
Saving batch number 286
Finished saving batch number 286in 297millis
Saving batch number 287
Finished saving batch number 287in 12687millis
Saving batch number 288
Finished saving batch number 288in 49625millis
Saving batch number 289
Finished saving batch number 289in 2282millis
Saving batch number 290
Finished saving batch number 290in 984millis
Saving batch number 291
Finished saving batch number 291in 2344millis
Saving batch number 292
Finished saving batch number 292in 30203millis
Saving batch number 293
Finished saving batch number 293in 391millis
Saving batch number 294
Finished saving batch number 294in 203millis
Saving batch number 295
Finished saving batch number 295in 234millis
Saving batch number 296
Finished saving batch number 296in 10344millis
Saving batch number 297
Finished saving batch number 297in 140millis
Saving batch number 298
Finished saving batch number 298in 266millis
Saving batch number 299
Finished saving batch number 299in 30719millis
Saving batch number 300
Finished saving batch number 300in 140millis
Saving batch number 301
Finished saving batch number 301in 188millis
Saving batch number 302
Finished saving batch number 302in 141millis
Saving batch number 303
Finished saving batch number 303in 343millis
Saving batch number 304
Finished saving batch number 304in 1750millis
Saving batch number 305
Finished saving batch number 305in 1219millis
Saving batch number 306
Finished saving batch number 306in 234millis
Saving batch number 307
Finished saving batch number 307in 1797millis
Saving batch number 308
Finished saving batch number 308in 297millis
Saving batch number 309
Finished saving batch number 309in 141millis
Saving batch number 310
Finished saving batch number 310in 4281millis
Saving batch number 311
Finished saving batch number 311in 625millis
Saving batch number 312
Finished saving batch number 312in 219millis
Saving batch number 313
Finished saving batch number 313in 1094millis
Saving batch number 314
Finished saving batch number 314in 203millis
Saving batch number 315
Finished saving batch number 315in 312millis
Saving batch number 316
Finished saving batch number 316in 453millis
Saving batch number 317
Finished saving batch number 317in 891millis
Saving batch number 318
> Experiencing long delays when indexing entities saved in different transactions
> -------------------------------------------------------------------------------
>
> Key: HSEARCH-513
> URL: http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-513
> Project: Hibernate Search
> Issue Type: Bug
> Components: engine
> Affects Versions: 3.2.0.CR1
> Environment: Hibernate 3.5.1-Final
> Spring 3.0.2
> MySQL Connector 5.1.6
> Reporter: Florin Haizea
> Fix For: 3.3.0
>
> Attachments: AllLibsExceptSpringAndHibernate.zip, hibernate3.jar, HibernateSearchJira.zip, output.txt, SpringAndHibernateLibs.zip
>
>
> https://forum.hibernate.org/viewtopic.php?f=9&t=1003224
> I have 3 entities Person, Event and ParentOfBirthEvent. I save about 8000 Person objects in batches of 20, each batch is being saved in a different transaction. After a sufficient number of entities have been persisted (the saving and indexing of initial batches takes between150ms and 500ms) the indexing of the entities that are saved in some of the following batches takes a very large amount of time (sometime even minutes for a whole batch).
> The problem is that in order for these delays to appear there has to be a certain relationship between the objects saved in the current batch and objects saved in previous batches. The only way in which I can reproduce this 100% is by importing a file (which was submitted by one of the users of our app), creating entities based on the data in that file and saving the entities in batches of 20. When I reach batch number 273 or so the indexing starts taking a lot of time.
> If I removed the @IndexedEmbedded annotation from the "parent" field in the ParentOfBirthEvent class the problem is solved. Also, if I removed all the hibernate search listeners from the sessionFactory the problem is solved.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://opensource.atlassian.com/projects/hibernate/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
More information about the hibernate-issues
mailing list