[jbosstools-dev] Ways to increase tycho timeouts

[Rob Stryker]

Denis:

The reason the tests take so long is because we are testing several 
hundred configurations per test. I've ensured that only one test does a 
"full matrix" test, but even that test takes about 1-2 seconds each. 
Multiplying over 1000 possible configurations, and this one test alone 
takes 1500-2000 seconds. THis one test takes about 30 minutes, but it's 
actually 1000 tests. It uses junit-4 and parametized testing.

The other tests sometimes take up to 5-10 seconds each because they 
create Dynamic web projects. These tests have only about 100-150 
permutations, but that alone is about 10 minutes per test class.

The real fact is just that there's LOTS more testing going on. I've 
tried limiting the number of configurations, as I mentioned above, but 
the fact is there are dozens of things that need testing.

As an example, let's take a simple ear project with an external jar 
added in via module assembly. We have 3 unique types of server 
deployment (deploy-only,  as3-6, as7), we have two zip options (zipped 
vs exploded), we have tons of customizations regarding where that module 
/ ear project's root deployment folder is to be located, and we also 
have several options for what the .component file has as it's deployment 
settings (specifically, what hte inner jar should be named, what folder 
it should live in inside the ear, etc). All of these configurations need 
to be tested.

In short, all of these tests are basically necessary, and the test suite 
will continue to grow. IT's not even done yet.

On 08/04/2012 02:07 AM, Denis Golovin wrote:
> Rob,
>
> I wondering why it takes so long to test.
> What test are you talking about?
> Does it include SWT Bot tests?
> Most likely it uses delay() function to much and that's why it takes 
> so long.
>
> Best
> Denis
>
> On 08/03/2012 01:03 AM, Rob Stryker wrote:
>> Hi all:
>>
>> I've recently added a new test suite to astools, and when run locally
>> via tycho, it times out after 40 minutes. My test suite requires longer
>> than that to run, so I was wondering if there's any way to increase this
>> timeout.
>> _______________________________________________
>> jbosstools-dev mailing list
>> jbosstools-dev at lists.jboss.org
>> https://lists.jboss.org/mailman/listinfo/jbosstools-dev
>