[hibernate-issues] [Hibernate-JIRA] Commented: (HSEARCH-228) Write a reliability test under stress

[Sanne Grinovero (JIRA)]

    [ http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=31774#action_31774 ] 

Sanne Grinovero commented on HSEARCH-228:
-----------------------------------------

I am also wondering how to do it;
To detect concurrency problems you either need to write highly complex testcases to actively control different interleaving scenarios, or rely on random thread interleaving scenarios by applying a very high load and an "unreasonable high" number of threads (to add more randomness), of course running for long times. In an infinite resources project apply both strategies :-)

So even if the most common use case of H.Search would be "behind tomcat" this would prevent you to achieve the high concurrency needed to eventually detect bugs in a reasonable test time:
two days of testing results in no problem being detected, this doesn't mean you wouldn't have hit one on the third day; So IMHO you should need to remove all layers which are not part of the test,
especially HTTP and Tomcat's session handling.

When using this strategy you need long test times: you could use JUnit if you like it but would be better to avoid the inclusion in the standard test suite.
It would be very nice if this could have at least "repeatable data" and performed operations (can't control exact order of course) so to use it as a reference to detect performance regressions
or improvements.

> Write a reliability test under stress
> -------------------------------------
>
>                 Key: HSEARCH-228
>                 URL: http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-228
>             Project: Hibernate Search
>          Issue Type: Task
>            Reporter: Emmanuel Bernard
>            Assignee: Hardy Ferentschik
>             Fix For: 3.1.0
>
>
> Write an app inserting, updating deleting concurrently
> Also searching concurrently and make sure data is reliable during search
> all that during stress conditions.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://opensource.atlassian.com/projects/hibernate/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira