4:33 p.m.
On 1 June 2012 20:20, Hardy Ferentschik <hardy(a)hibernate.org> wrote:
For the records buildhive kind of worked for Hibernate Validator. At
least we it built and as
Sanne said, the setup was almost too easy to be true.
However, there are indeed too many false positives. I have not been able to figure out
what
the problem is (not a timeout issue). Test would randomly fail and then pass without
further
code changes on the next build. Probably worth watching build hive to see where there
are
going. I am happy to try cloudbee provided we get a free account.
On "where they are going", it seems to me it's an easy catch for
customers towards the full platform: you'll likely always get
more/better configuration options on the full one.
I'm sure we can get a free account, I just wanted to know we agree on
getting one as I'd need to impersonate "Hibernate", or maybe Steve can
do it.
Plus we have some experience with it (mostly Galder), have a look at:
https://infinispan.ci.cloudbees.com/
I guess the interface will look familiar, so really not much new to
learn.. it's a quick and free way to add more nodes to our build
farms.
It seems the pull-request-monitoring plugin isn't available yet so
there's no rush, but it would be nice to start offloading some work
from our QA lab which would be nice for those tasks not strictly
requiring a specific OS or database vendor/version.
For example I have no clue on why Hibernate Search builds seem dead -
I think our lab is overloaded - so I'd like to setup a job there.
Sanne
--Hardy
On Jun 1, 2012, at 3:43 PM, Sanne Grinovero wrote:
> Hi All,
> I've had Buildhive configured on some of our projects for the last
> week as an experiment (Hibernate Validator, Search, OGM).
>
> Apologies for all the notifications it made, especially since I didn't
> warn about enabling it.
> Apparently it creates lots of false positives so it has been quite
> noisy on all pull requests and commits.
>
> It was super easy to setup, they definitely made an example to follow
> in terms of service usability and UI: just login with your github
> account, you can setup all projects you are admin of with a single
> mouse click.
>
> Now the bad news:
> it's very limited, for example it wasn't able to build Hibernate ORM
> as you can't choose the gradle version, and it's unable to run the
> Infinispan testsuite as there is a 15 minutes build time limit.
> Hibernate Search builds fails all Byteman related tests, I guess it's
> missing the JDK's tools.jar from the classpath (not available in JRE).
> OGM wasn't that bad, still occasionally it failed with apparently no
> reason.
>
> I've contacted Cloudbees to ask about the gradle version and I was
> suggested to use their standard build platform, for which the same
> pull-request-review plugin will be available soon, and which is much
> more flexible in terms of configuration.
> I think that's a reasonable suggestion and that would give us
> most of the options we need, and we could get it for free as an open
> source project.
>
> It has never been my intention to replace JBoss's internal QA Jenkins
> instances, nor I think that will be possible as only there we have all
> different platforms to test on and all different databases, so I'm
> exploring these options exclusively to get a filter between broken
> pull requests and our reviews: if we can save some time and
> efficiency, I think any additional help is welcome. Also some of the
> tasks run by QA labs would be redundant - like most H2 run tests - and
> we might save resources there for the other tasks by running a
> selection of tests less frequently.
>
> In conclusion: yesterday night I disabled it as I think it had way too
> many false positives.
>
> Shall we proceed in making an Hibernate account to setup some tasks on
> the full-powered Cloudbees version? Again, not with the intention to
> replace the role of "reference CI", but only to get some extra
> processing power - especially the preventive tests on pull requests
> are IMHO very nice.
> I don't think it's a big cost as it's quite easy to configure and
> maintain an additional set of Jenkins instances.
>
> On a side note:
> # I was looking into cloudbees anyway as they have free MongoDB
> instances, so this would help in testing Hibernate OGM.
> # I've tested openshift too for this purpose. Apparently the
> expectation is that you have to commit "to" openshift directly to have
> it trigger a test run: it's currently not able to monitor a different
> git repository so that didn't seem very suited; it might be a good
> place to run tests of demos to run on AS7 though.
> Of course we might "push" the jenkins source code to it an use it as
> was a self-made webapp, but then I think cloudbees would be more
> effective as someone else will manage the platform.
>
> Cheers,
> Sanne
> _______________________________________________
> hibernate-dev mailing list
> hibernate-dev(a)lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/hibernate-dev
_______________________________________________
hibernate-dev mailing list
hibernate-dev(a)lists.jboss.org
https://lists.jboss.org/mailman/listinfo/hibernate-dev