<div dir="ltr">randomly failing tests is an horror but they reveal real issues, often in products, sometimes in tests or CI.<div>Changing CI is often a great way to discover all our &quot;concurrency issues&quot; as everything is not running at the same pace.<br><br>For Fuse Tooling (and in my previous company), What i try to do when it occurs instead of just relaunching the job is to report a JIRA issue.<br>it will help to gather more information, imagine how to add logs or whatever to have more information when it will happen next. Each time it occurs again, we can add a comment it helps to know what is the frequency and what is the urgency to fix it. it is easier to include time for investigation in sprint if we know how much we are loosing every sprint (and how often a user might hit this issue).<div><br></div><div>At a comparison level, I saw a great keynote from OpenStack organization. They also had this issue and they even created an automatic reporting with automatic relaunch of jobs when it failed for known &quot;random failures&quot;.<br><br><br><br><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 10, 2017 at 10:44 AM, Andre Dietisheim <span dir="ltr">&lt;<a href="mailto:adietish@redhat.com" target="_blank">adietish@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    <p>Radim, these are exactly the EGit failures that I was referring
      to. The one you pasted is among the ones that occurr. But afaik
      the failures are not consistent and they dont happen in the old
      jenkins. <br>
    </p>
    <div class="m_2438988690329666814moz-cite-prefix">Am 10.05.17 um 10:41 schrieb Radim
      Hopp:<br>
    </div><div><div class="h5">
    <blockquote type="cite">
      <div dir="ltr">Last time I sent PR to openshift repo I had to be
        really patient, because the build was failing on
        &quot;java.io.IOException: Could not delete file
/mnt/hudson_workspace/<wbr>workspace/jbosstools-<wbr>openshift-Pull-Request/tests/<wbr>org.jboss.tools.openshift.<wbr>egit.test/target/work/data/<wbr>Project-1494366069560&quot;.
        I had to run the PR check job ~5 times for it to finally pass.<br>
      </div>
      <br>
      <div class="gmail_quote">
        <div dir="ltr">On Wed, May 10, 2017 at 10:38 AM Andre Dietisheim
          &lt;<a href="mailto:adietish@redhat.com" target="_blank">adietish@redhat.com</a>&gt;
          wrote:<br>
        </div>
        <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
          <div bgcolor="#FFFFFF" text="#000000">
            <p>I agree in the principle. But for the approach to be
              successfull we need our new new jenkins to be rocksolid
              which it isnt for now. Our EGit tests fail randomly on it
              while they pass on the old jenkins.<br>
            </p>
            <div class="m_2438988690329666814m_8160306295588628023moz-cite-prefix">Am
              10.05.17 um 10:17 schrieb Dmitrii Bocharov:<br>
            </div>
          </div>
          <div bgcolor="#FFFFFF" text="#000000">
            <blockquote type="cite">
              <div dir="ltr">Jeff, for this purpose we can think of some
                special comment for such PRs, that would allow to merge
                them (like <i>testPR</i> for a new build). As far as i
                know it&#39;s possible.</div>
              <div class="gmail_extra"><br>
                <div class="gmail_quote">On Wed, May 10, 2017 at 9:01
                  AM, Jean-Francois Maury <span dir="ltr">&lt;<a href="mailto:jmaury@redhat.com" target="_blank">jmaury@redhat.com</a>&gt;</span>
                  wrote:<br>
                  <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                    <div dir="auto">I&#39;m ok with that rule except for one
                      case when the pr is done before the version bump
                      has been merged then the Jenkins build will fail
                      because of the baseline check so maybe we need to
                      update the pr Jenkins build 
                      <div dir="auto"><br>
                      </div>
                      <div dir="auto">Jeff</div>
                    </div>
                    <div class="gmail_extra"><br>
                      <div class="gmail_quote">
                        <div>
                          <div class="m_2438988690329666814m_8160306295588628023h5">Le 9 mai
                            2017 23:10, &quot;Mickael Istria&quot; &lt;<a href="mailto:mistria@redhat.com" target="_blank">mistria@redhat.com</a>&gt;
                            a écrit :<br type="attribution">
                          </div>
                        </div>
                        <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                          <div>
                            <div class="m_2438988690329666814m_8160306295588628023h5">
                              <div dir="ltr">
                                <div>
                                  <div>
                                    <div>FYI, not merging the broken
                                      patches is the policy followed by
                                      most Eclipse.org projects and
                                      overall, none of this project has
                                      complained from a reduced
                                      productivity; on the contrary,
                                      catching and fixing issues
                                      immediately on the right context
                                      has improved quality and reduced
                                      the necessary amount of quick fix
                                      patches (which are actually quite
                                      time consuming and stressful for
                                      their low added-value).<br>
                                    </div>
                                    So I think if it works for
                                    Eclipse.org projects, it can work
                                    for JBoss Tools.<br>
                                    <br>
                                  </div>
                                  Cheers,<br>
                                </div>
                                Mickael<br>
                              </div>
                              <br>
                            </div>
                          </div>
                          <span>______________________________<wbr>_________________<br>
                            jbosstools-dev mailing list<br>
                            <a href="mailto:jbosstools-dev@lists.jboss.org" target="_blank">jbosstools-dev@lists.jboss.org</a><br>
                            <a href="https://lists.jboss.org/mailman/listinfo/jbosstools-dev" rel="noreferrer" target="_blank">https://lists.jboss.org/<wbr>mailman/listinfo/jbosstools-<wbr>dev</a><br>
                          </span></blockquote>
                      </div>
                    </div>
                  </blockquote>
                </div>
                <br>
              </div>
              <br>
              <fieldset class="m_2438988690329666814m_8160306295588628023mimeAttachmentHeader"></fieldset>
              <br>
              <pre>______________________________<wbr>_________________
jbosstools-dev mailing list
<a class="m_2438988690329666814m_8160306295588628023moz-txt-link-abbreviated" href="mailto:jbosstools-dev@lists.jboss.org" target="_blank">jbosstools-dev@lists.jboss.org</a>
<a class="m_2438988690329666814m_8160306295588628023moz-txt-link-freetext" href="https://lists.jboss.org/mailman/listinfo/jbosstools-dev" target="_blank">https://lists.jboss.org/<wbr>mailman/listinfo/jbosstools-<wbr>dev</a></pre>
            </blockquote>
            <br>
          </div>
          ______________________________<wbr>_________________<br>
          jbosstools-dev mailing list<br>
          <a href="mailto:jbosstools-dev@lists.jboss.org" target="_blank">jbosstools-dev@lists.jboss.org</a><br>
          <a href="https://lists.jboss.org/mailman/listinfo/jbosstools-dev" rel="noreferrer" target="_blank">https://lists.jboss.org/<wbr>mailman/listinfo/jbosstools-<wbr>dev</a></blockquote>
      </div>
      <div dir="ltr">-- <br>
      </div>
      <div data-smartmail="gmail_signature">
        <div dir="ltr">
          <p class="m_2438988690329666814inbox-inbox-fullname-container" style="box-sizing:border-box;color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span class="m_2438988690329666814inbox-inbox-firstname-container" style="box-sizing:border-box">RADIM</span><span class="m_2438988690329666814inbox-inbox-Apple-converted-space"> </span><span class="m_2438988690329666814inbox-inbox-lastname-container" style="box-sizing:border-box">HOPP</span></p>
          <p class="m_2438988690329666814inbox-inbox-position-container" style="box-sizing:border-box;color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span class="m_2438988690329666814inbox-inbox-position" style="box-sizing:border-box">RED
              HAT JBOSS DEVELOPER STUDIO QUALITY ASSURANCE</span></p>
          <p class="m_2438988690329666814inbox-inbox-legal-container" style="box-sizing:border-box;font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a class="m_2438988690329666814inbox-inbox-redhat-anchor" href="https://www.redhat.com/" style="box-sizing:border-box;color:rgb(0,136,206);margin:0px;text-decoration-line:none" target="_blank">Red
              Hat<span class="m_2438988690329666814inbox-inbox-Apple-converted-space"> </span><span style="box-sizing:border-box">Czech s.r.o.</span></a></p>
          <p class="m_2438988690329666814inbox-inbox-contact-container" style="box-sizing:border-box;font-family:overpass,sans-serif;margin:0px 0px 6px;font-size:10px;color:rgb(153,153,153)"><span class="m_2438988690329666814inbox-inbox-email-container" style="box-sizing:border-box;margin:0px;padding:0px"><a class="m_2438988690329666814inbox-inbox-email-anchor" href="mailto:rhopp@redhat.com" style="box-sizing:border-box;color:rgb(0,136,206);margin:0px;text-decoration-line:none" target="_blank">rhopp@redhat.com</a> 
               </span><span class="m_2438988690329666814inbox-inbox-Apple-converted-space"> </span><span class="m_2438988690329666814inbox-inbox-im-container" style="box-sizing:border-box">IM:<span class="m_2438988690329666814inbox-inbox-Apple-converted-space"> </span><span style="box-sizing:border-box">rhopp</span></span></p>
          <table style="box-sizing:border-box;color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0">
            <tbody style="box-sizing:border-box">
              <tr style="box-sizing:border-box">
                <td style="box-sizing:border-box" width="100px"><a href="https://red.ht/sig" style="box-sizing:border-box" target="_blank"><img style="box-sizing:border-box" src="https://www.redhat.com/files/brand/email/sig-redhat.png" height="auto" width="90"></a></td>
                <td class="m_2438988690329666814inbox-inbox-promo" style="box-sizing:border-box;font-size:10px">
                  <div class="m_2438988690329666814inbox-inbox-promo m_2438988690329666814inbox-inbox-promo-1" style="box-sizing:border-box"><a href="https://redhat.com/trusted" style="box-sizing:border-box;text-decoration-line:none;color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED.
                      TESTED. TRUSTED.</a></div>
                </td>
              </tr>
            </tbody>
          </table>
          <div class="m_2438988690329666814inbox-inbox-social" style="box-sizing:border-box;color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px">
            <div class="m_2438988690329666814inbox-inbox-social m_2438988690329666814inbox-inbox-social-2" style="box-sizing:border-box;color:rgb(153,153,153)"><a href="https://twitter.com/redhatway" title="twitter" style="box-sizing:border-box;background-image:url(&quot;https://www.redhat.com/files/brand/email/sm-twitter.png&quot;);height:20px;text-decoration-line:none;color:rgb(119,119,119);display:inline-block;line-height:20px;padding-left:16px;background-repeat:no-repeat;background-size:16px;background-position:0px 50%" target="_blank">@redhatway</a><span class="m_2438988690329666814inbox-inbox-Apple-converted-space"> </span> <span class="m_2438988690329666814inbox-inbox-Apple-converted-space"> </span><a href="https://instagram.com/redhatinc" title="instagram" style="box-sizing:border-box;background-image:url(&quot;https://www.redhat.com/files/brand/email/sm-instagram.png&quot;);height:20px;text-decoration-line:none;color:rgb(119,119,119);display:inline-block;line-height:20px;padding-left:16px;background-repeat:no-repeat;background-size:16px;background-position:0px 50%" target="_blank">@redhatinc</a><span class="m_2438988690329666814inbox-inbox-Apple-converted-space"> </span> <span class="m_2438988690329666814inbox-inbox-Apple-converted-space"> </span><a href="https://snapchat.com/add/redhatsnaps" title="snapchat" style="box-sizing:border-box;background-image:url(&quot;https://www.redhat.com/files/brand/email/sm-snapchat.png&quot;);height:20px;text-decoration-line:none;color:rgb(119,119,119);display:inline-block;line-height:20px;padding-left:16px;background-repeat:no-repeat;background-size:15px;background-position:0px 50%" target="_blank">@<wbr>redhatsnaps</a></div>
          </div>
        </div>
      </div>
    </blockquote>
    <br>
  </div></div></div>

<br>______________________________<wbr>_________________<br>
jbosstools-dev mailing list<br>
<a href="mailto:jbosstools-dev@lists.jboss.org">jbosstools-dev@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/jbosstools-dev" rel="noreferrer" target="_blank">https://lists.jboss.org/<wbr>mailman/listinfo/jbosstools-<wbr>dev</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>AURÉLIEN</span> <span>PUPIER</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>SENIOR SOFTWARE ENGINEER, FUSE TOOLING</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px;text-decoration:none" target="_blank">Red Hat <span>France</span></a></p><p style="font-family:overpass,sans-serif;margin:0px 0px 6px;font-size:10px;color:rgb(153,153,153)"><span style="margin:0px;padding:0px"><a href="mailto:apupier@redhat.com" style="color:rgb(0,136,206);margin:0px;text-decoration:none" target="_blank">apupier@redhat.com</a>   </span> <span>IM: <span>apupier</span></span></p><table border="0" style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/files/brand/email/sig-redhat.png" width="90" height="auto"></a></td></tr></tbody></table></div></div></div></div>
</div>