[jbosstools-issues] [JBoss JIRA] (JBIDE-21145) Composite install job does not reliably install all JBT IUs and so does not see changes between CI builds

[Nick Boldt (JIRA)]

    [ https://issues.jboss.org/browse/JBIDE-21145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13137815#comment-13137815 ] 

Nick Boldt commented on JBIDE-21145:
------------------------------------

To explain our current process / job interconnections again...

* composite site job performs an install to see if anything has changed. If so, it kicks off the aggregate jobs.
* when aggregates are done, they check to see if anything has changed (currently this is just a buildinfo.json diff, not a p2diff -- but we can add that in JBDS-16970). If nothing new, no new publish.
* then JBDS is built. When done, check to see if anything has changed (currently this is just a buildinfo.json diff, not a p2diff -- but we can add that in JBDS-16970). If nothing new, no new publish.
* then discovery sites are built & versionwatch verification is kicked (in parallel, downstream from JBDS build)
* Once discovery is refreshed, THEN we do p2 director and install-grinder install tests of JBT and JBDS. Because these tests require a fully-functional JBT, JBDS, Central, and EA site.

SO... if you're suggesting that the outcome of a p2diff in the JBT aggregate jobs should control whether or not to fire the install tests, we can certainly do that.

But we already prevent running those install tests by preventing upstream from firing downstream. If no new JBT, then no new JBDS, and therefore no new discovery, so no new install tests.

Right now the mechanism to determine if/when to fire install tests is "new JBT? new JBDS? new discovery? OK, then new install tests." And that's currently controlled by 2 levels of buildinfo.json SHA diffing - first in JBT, then again in JBDS.

So... TL;DR, I think we actually agree here. Scary.



> Composite install job does not reliably install all JBT IUs and so does not see changes between CI builds
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: JBIDE-21145
>                 URL: https://issues.jboss.org/browse/JBIDE-21145
>             Project: Tools (JBoss Tools)
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 4.3.1.Beta1, 4.4.0.Alpha1
>            Reporter: Pavol Srna
>            Assignee: Nick Boldt
>            Priority: Blocker
>             Fix For: 4.3.1.Beta1, 4.4.0.Alpha1
>
>
> We have often seen old artifacts on nightly sites (mars and neon too). 
> It seems that the composite-install job [0], [1] is not reliable. So, the downstream JBT aggregate builds [2], [3] are not triggered automatically to pick up all new changes in the upstream JBT component site builds.
> [0] http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/jbosstools-composite-install_master/lastBuild/console
> [1] http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/jbosstools-composite-install_4.3.mars/lastBuild/console
> [2] http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/jbosstools-build-sites.aggregate.site_master/ (latest build shows: "Nov 27, 2015 6:15 AM NOT ​PUBLISHED: ​​UNCHANGED")
> [3] http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/jbosstools-build-sites.aggregate.site_4.3.mars/ (latest build shows: "Nov 27, 2015 3:43 AM NOT ​PUBLISHED: ​​UNCHANGED")
> Please investigate.
> Thanks!



--
This message was sent by Atlassian JIRA
(v6.4.11#64026)