On Tue, Sep 24, 2013 at 04:19:10PM +0200, Karel Piwko wrote: > Hi All, > > QE needs to setup jobs that would allow us to test more than what's > available in Travis - Ubuntu hosts are pretty limiting plus they contains > OpenJDK related bugs [1][2]. > > The problem is that only instance we have access to is behind VPN, so it > might be complicated/impossible to read the results/get better feedback. > > Following questions needs to be answered, some suggestions included in []: > > * Where to put result logs? [http://hudson.jboss.org/hudson/] This might be a good place, since it's already set up. > * How to notify and who to notify? [email|push messages ;-)|some specific > ML|commiter only] We can always create a build status mailing list and funnel everything there. > ** IRC is unfortunately a no-go here boo :( > * When to notify? [failure only|unstable|always] Failure only

> * How often to run tests? [nightly|per commit] This really boils down to what kind of tests are being run, and how busy is the build-slave queue.

> * How to enable developers to easily rerun something? [email|irc] irc would be easier, email safer?

> * Something else? how crowded is this env? do we have OSX slaves on it?

On Tue, Sep 24, 2013 at 06:30:34PM +0200, Karel Piwko wrote: > > > * When to notify? [failure only|unstable|always] > > > > Failure only > Sorry, I was not explicit here: > * Failure: job didn't finish (aborted to to some error) > * Unstable: some tests failed > > What about specific states, like still-failing or still-unstable? The less noise, the better - I think jenkins has a "state changed only" notification setting

> > > > > * How often to run tests? [nightly|per commit] > > > > This really boils down to what kind of tests are being run, and how busy > > is the build-slave queue. > > Well, per commit strategy is unrealistic setup when trying to rerun > everyting. So nightly is the obvious choice, right?

> > > > > > * How to enable developers to easily rerun something? [email|irc] > > > > irc would be easier, email safer? > > I prefer IRC, however QE does not cover all timezones. In such cases email > makes more sense. Aaah, will it be manual intervention? email then.