[JBoss JIRA] (ISPN-9488) Jenkins cleanup script can delete the current build's directory
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-9488?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-9488:
-------------------------------
Status: Open (was: New)
> Jenkins cleanup script can delete the current build's directory
> ---------------------------------------------------------------
>
> Key: ISPN-9488
> URL: https://issues.jboss.org/browse/ISPN-9488
> Project: Infinispan
> Issue Type: Bug
> Components: CI
> Affects Versions: 9.4.0.CR1
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Critical
> Labels: testsuite_failure
> Fix For: 9.4.0.Final
>
>
> Our {{Jenkinsfile}} runs {{cleanup.sh}} (provisioned on each agent via Ansible) to make room for the new build. The idea is to keep the checked-out sources after a build, so that the next build for the same branch is faster, and {{cleanup.sh}} only deletes the workspace directories of old builds if there's less than 10gb of free space.
> There is a problem, however: the agent may have less than 10GB of free space after deleting all the old workspace directories, and {{cleanup.sh}} will happily delete the current build's workspace to make more room. Obviously, the build fails afterwards:
> {noformat}
> ERROR: missing workspace /home/infinispan/workspace/Infinispan_PR-6236-6TTBGFU5OA5XZXKEPJRZI245GOIWTNAUH3HC5M6B36G25UNJPTCA on rhos-infinispan-slave-4.localdomain
> {noformat}
> Unfortunately we also use `returnOutput: true` when running the cleanup script, so it's not obvious who is deleting the build directory.
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
7 years, 7 months
[JBoss JIRA] (ISPN-9488) Jenkins cleanup script can delete the current build's directory
by Dan Berindei (JIRA)
Dan Berindei created ISPN-9488:
----------------------------------
Summary: Jenkins cleanup script can delete the current build's directory
Key: ISPN-9488
URL: https://issues.jboss.org/browse/ISPN-9488
Project: Infinispan
Issue Type: Bug
Components: CI
Affects Versions: 9.4.0.CR1
Reporter: Dan Berindei
Assignee: Dan Berindei
Priority: Critical
Fix For: 9.4.0.Final
Our {{Jenkinsfile}} runs {{cleanup.sh}} (provisioned on each agent via Ansible) to make room for the new build. The idea is to keep the checked-out sources after a build, so that the next build for the same branch is faster, and {{cleanup.sh}} only deletes the workspace directories of old builds if there's less than 10gb of free space.
There is a problem, however: the agent may have less than 10GB of free space after deleting all the old workspace directories, and {{cleanup.sh}} will happily delete the current build's workspace to make more room. Obviously, the build fails afterwards:
{noformat}
ERROR: missing workspace /home/infinispan/workspace/Infinispan_PR-6236-6TTBGFU5OA5XZXKEPJRZI245GOIWTNAUH3HC5M6B36G25UNJPTCA on rhos-infinispan-slave-4.localdomain
{noformat}
Unfortunately we also use `returnOutput: true` when running the cleanup script, so it's not obvious who is deleting the build directory.
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
7 years, 7 months