[JBoss JIRA] (JBIDE-24964) HUDSON_STATIC_ENV not defined for windows and osx slaves
by Nick Boldt (JIRA)
[ https://issues.jboss.org/browse/JBIDE-24964?page=com.atlassian.jira.plugi... ]
Nick Boldt updated JBIDE-24964:
-------------------------------
Description:
On windows and osx slaves, HUDSON_STATIC_ENV is not defined. On rhel7 slaves, it's defined as /home/hudson/static_build_env
Could an equivalent path be set for other OSes, so we can benefit from this NFS-mounted shared space?
Currently when we run itests on multiple OSes, we see stuff like this:
{code:title=rhel7 - HUDSON_STATIC_ENV = /home/hudson/static_build_env}
16:05:48 [rhel7] $ /mnt/hudson_workspace/tools/hudson.tasks.Maven_MavenInstallation/maven-3.3.9/bin/mvn -s /tmp/settings2086504014812240990.xml -Djdk=openjdk-1.8 -Dlabel_exp=rhel7 -Ddownload.cache.directory=/home/hudson/static_build_env/devstudio/download-cache -Dsurefire.timeout=10000 -DJOB_NAME=server.it.weekly/jdk=openjdk-1.8,label_exp=rhel7 -DBUILD_NUMBER=24 -DskipPrivateRequirements=false -Djbosstools.test.jre.8=/qa/tools/opt/x86_64/jdk1.8.0_last -Dsurefire.itests.timeout=10000 -Djbosstools.test.jre.7=/qa/tools/opt/x86_64/jdk1.7.0_last -Djbosstools.test.jre.6=/qa/tools/opt/x86_64/jdk1.6.0_last -Djbosstools.test.jre.5=/qa/tools/opt/x86_64/jdk1.5.0_last -DskipBaselineComparison=true -Dmaven.test.error.ignore=true -Dmaven.test.failure.ignore=true clean install -B -U -fae -e -P hudson,pack200,unified.target,maximum -DjgitDirtyWorkingTree=warning
{code}
{code:title=win81 - HUDSON_STATIC_ENV not defined}
16:05:51 [win81] $ cmd.exe /C "\mnt\hudson_workspace\tools\hudson.tasks.Maven_MavenInstallation\maven-3.3.9\bin\mvn.cmd -s C:\Users\jbossqa\AppData\Local\Temp\settings7229513778735293013.xml -Djdk=openjdk-1.8 -Dlabel_exp=win81 -Ddownload.cache.directory=${HUDSON_STATIC_ENV}/devstudio/download-cache -Dsurefire.timeout=10000 "-DJOB_NAME=server.it.weekly/jdk=openjdk-1.8,label_exp=win81" -DBUILD_NUMBER=24 -DskipPrivateRequirements=false -Djbosstools.test.jre.8=T:\opt\windows\amd64\jdk1.8.0_last -Dsurefire.itests.timeout=10000 -Djbosstools.test.jre.7=T:\opt\windows\amd64\jdk1.7.0_last -Djbosstools.test.jre.6=T:\opt\windows\amd64\jdk1.7.0_last -Djbosstools.test.jre.5=T:\opt\windows\amd64\jdk1.7.0_last -DskipBaselineComparison=true -Dmaven.test.error.ignore=true -Dmaven.test.failure.ignore=true clean install -B -U -fae -e -P "hudson,pack200,unified.target,maximum" -DjgitDirtyWorkingTree=warning && exit %%ERRORLEVEL%%"
{code}
{code:title=win10 - HUDSON_STATIC_ENV not defined}
16:05:48 [win10] $ cmd.exe /C "\mnt\hudson_workspace\tools\hudson.tasks.Maven_MavenInstallation\maven-3.3.9\bin\mvn.cmd -s C:\Users\jbossqa\AppData\Local\Temp\settings8339429706904285132.xml -Djdk=openjdk-1.8 -Dlabel_exp=win10 -Ddownload.cache.directory=${HUDSON_STATIC_ENV}/devstudio/download-cache -Dsurefire.timeout=10000 "-DJOB_NAME=server.it.weekly/jdk=openjdk-1.8,label_exp=win10" -DBUILD_NUMBER=24 -DskipPrivateRequirements=false -Djbosstools.test.jre.8=T:\opt\windows\amd64\jdk1.8.0_last -Dsurefire.itests.timeout=10000 -Djbosstools.test.jre.7=T:\opt\windows\amd64\jdk1.7.0_last -Djbosstools.test.jre.6=T:\opt\windows\amd64\jdk1.7.0_last -Djbosstools.test.jre.5=T:\opt\windows\amd64\jdk1.7.0_last -DskipBaselineComparison=true -Dmaven.test.error.ignore=true -Dmaven.test.failure.ignore=true clean install -B -U -fae -e -P "hudson,pack200,unified.target,maximum" -DjgitDirtyWorkingTree=warning && exit %%ERRORLEVEL%%"
{code}
{code:title=macosx - HUDSON_STATIC_ENV not defined}
16:05:46 [macosx] $ /jenkins/tools/hudson.tasks.Maven_MavenInstallation/maven-3.3.9/bin/mvn -s /var/folders/tp/hcfshtz152n2t8y4jfl08w140000gp/T/settings6780477723089804684.xml -Djdk=jdk1.8 -Dlabel_exp=macosx -Ddownload.cache.directory=${HUDSON_STATIC_ENV}/devstudio/download-cache -Dsurefire.timeout=10000 -DJOB_NAME=server.it.weekly/jdk=jdk1.8,label_exp=macosx -DBUILD_NUMBER=24 -DskipPrivateRequirements=false -Djbosstools.test.jre.8=/qa/tools/opt/osx/jdk1.8.0_last -Dsurefire.itests.timeout=10000 -Djbosstools.test.jre.7=/qa/tools/opt/osx/jdk1.7.0_last -Djbosstools.test.jre.6=/qa/tools/opt/osx/jdk1.8.0_last -Djbosstools.test.jre.5=/qa/tools/opt/osx/jdk1.8.0_last -DskipBaselineComparison=true -Dmaven.test.error.ignore=true -Dmaven.test.failure.ignore=true clean install -B -U -fae -e -P hudson,pack200,unified.target,maximum -DjgitDirtyWorkingTree=warning
{code}
was:
On windows and osx slaves, HUDSON_STATIC_ENV is not defined. On rhel7 slaves, it's defined as /home/hudson/static_build_env
Could an equivalent path be set for other OSes, so we can benefit from this NFS-mounted shared space?
> HUDSON_STATIC_ENV not defined for windows and osx slaves
> --------------------------------------------------------
>
> Key: JBIDE-24964
> URL: https://issues.jboss.org/browse/JBIDE-24964
> Project: Tools (JBoss Tools)
> Issue Type: Bug
> Components: build, qa
> Affects Versions: 4.5.1.AM1
> Reporter: Nick Boldt
> Assignee: Pavol Srna
> Fix For: 4.5.x
>
>
> On windows and osx slaves, HUDSON_STATIC_ENV is not defined. On rhel7 slaves, it's defined as /home/hudson/static_build_env
> Could an equivalent path be set for other OSes, so we can benefit from this NFS-mounted shared space?
> Currently when we run itests on multiple OSes, we see stuff like this:
> {code:title=rhel7 - HUDSON_STATIC_ENV = /home/hudson/static_build_env}
> 16:05:48 [rhel7] $ /mnt/hudson_workspace/tools/hudson.tasks.Maven_MavenInstallation/maven-3.3.9/bin/mvn -s /tmp/settings2086504014812240990.xml -Djdk=openjdk-1.8 -Dlabel_exp=rhel7 -Ddownload.cache.directory=/home/hudson/static_build_env/devstudio/download-cache -Dsurefire.timeout=10000 -DJOB_NAME=server.it.weekly/jdk=openjdk-1.8,label_exp=rhel7 -DBUILD_NUMBER=24 -DskipPrivateRequirements=false -Djbosstools.test.jre.8=/qa/tools/opt/x86_64/jdk1.8.0_last -Dsurefire.itests.timeout=10000 -Djbosstools.test.jre.7=/qa/tools/opt/x86_64/jdk1.7.0_last -Djbosstools.test.jre.6=/qa/tools/opt/x86_64/jdk1.6.0_last -Djbosstools.test.jre.5=/qa/tools/opt/x86_64/jdk1.5.0_last -DskipBaselineComparison=true -Dmaven.test.error.ignore=true -Dmaven.test.failure.ignore=true clean install -B -U -fae -e -P hudson,pack200,unified.target,maximum -DjgitDirtyWorkingTree=warning
> {code}
> {code:title=win81 - HUDSON_STATIC_ENV not defined}
> 16:05:51 [win81] $ cmd.exe /C "\mnt\hudson_workspace\tools\hudson.tasks.Maven_MavenInstallation\maven-3.3.9\bin\mvn.cmd -s C:\Users\jbossqa\AppData\Local\Temp\settings7229513778735293013.xml -Djdk=openjdk-1.8 -Dlabel_exp=win81 -Ddownload.cache.directory=${HUDSON_STATIC_ENV}/devstudio/download-cache -Dsurefire.timeout=10000 "-DJOB_NAME=server.it.weekly/jdk=openjdk-1.8,label_exp=win81" -DBUILD_NUMBER=24 -DskipPrivateRequirements=false -Djbosstools.test.jre.8=T:\opt\windows\amd64\jdk1.8.0_last -Dsurefire.itests.timeout=10000 -Djbosstools.test.jre.7=T:\opt\windows\amd64\jdk1.7.0_last -Djbosstools.test.jre.6=T:\opt\windows\amd64\jdk1.7.0_last -Djbosstools.test.jre.5=T:\opt\windows\amd64\jdk1.7.0_last -DskipBaselineComparison=true -Dmaven.test.error.ignore=true -Dmaven.test.failure.ignore=true clean install -B -U -fae -e -P "hudson,pack200,unified.target,maximum" -DjgitDirtyWorkingTree=warning && exit %%ERRORLEVEL%%"
> {code}
> {code:title=win10 - HUDSON_STATIC_ENV not defined}
> 16:05:48 [win10] $ cmd.exe /C "\mnt\hudson_workspace\tools\hudson.tasks.Maven_MavenInstallation\maven-3.3.9\bin\mvn.cmd -s C:\Users\jbossqa\AppData\Local\Temp\settings8339429706904285132.xml -Djdk=openjdk-1.8 -Dlabel_exp=win10 -Ddownload.cache.directory=${HUDSON_STATIC_ENV}/devstudio/download-cache -Dsurefire.timeout=10000 "-DJOB_NAME=server.it.weekly/jdk=openjdk-1.8,label_exp=win10" -DBUILD_NUMBER=24 -DskipPrivateRequirements=false -Djbosstools.test.jre.8=T:\opt\windows\amd64\jdk1.8.0_last -Dsurefire.itests.timeout=10000 -Djbosstools.test.jre.7=T:\opt\windows\amd64\jdk1.7.0_last -Djbosstools.test.jre.6=T:\opt\windows\amd64\jdk1.7.0_last -Djbosstools.test.jre.5=T:\opt\windows\amd64\jdk1.7.0_last -DskipBaselineComparison=true -Dmaven.test.error.ignore=true -Dmaven.test.failure.ignore=true clean install -B -U -fae -e -P "hudson,pack200,unified.target,maximum" -DjgitDirtyWorkingTree=warning && exit %%ERRORLEVEL%%"
> {code}
> {code:title=macosx - HUDSON_STATIC_ENV not defined}
> 16:05:46 [macosx] $ /jenkins/tools/hudson.tasks.Maven_MavenInstallation/maven-3.3.9/bin/mvn -s /var/folders/tp/hcfshtz152n2t8y4jfl08w140000gp/T/settings6780477723089804684.xml -Djdk=jdk1.8 -Dlabel_exp=macosx -Ddownload.cache.directory=${HUDSON_STATIC_ENV}/devstudio/download-cache -Dsurefire.timeout=10000 -DJOB_NAME=server.it.weekly/jdk=jdk1.8,label_exp=macosx -DBUILD_NUMBER=24 -DskipPrivateRequirements=false -Djbosstools.test.jre.8=/qa/tools/opt/osx/jdk1.8.0_last -Dsurefire.itests.timeout=10000 -Djbosstools.test.jre.7=/qa/tools/opt/osx/jdk1.7.0_last -Djbosstools.test.jre.6=/qa/tools/opt/osx/jdk1.8.0_last -Djbosstools.test.jre.5=/qa/tools/opt/osx/jdk1.8.0_last -DskipBaselineComparison=true -Dmaven.test.error.ignore=true -Dmaven.test.failure.ignore=true clean install -B -U -fae -e -P hudson,pack200,unified.target,maximum -DjgitDirtyWorkingTree=warning
> {code}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months
[JBoss JIRA] (JBIDE-24964) HUDSON_STATIC_ENV not defined for windows and osx slaves
by Nick Boldt (JIRA)
Nick Boldt created JBIDE-24964:
----------------------------------
Summary: HUDSON_STATIC_ENV not defined for windows and osx slaves
Key: JBIDE-24964
URL: https://issues.jboss.org/browse/JBIDE-24964
Project: Tools (JBoss Tools)
Issue Type: Bug
Components: build, qa
Affects Versions: 4.5.1.AM1
Reporter: Nick Boldt
On windows and osx slaves, HUDSON_STATIC_ENV is not defined. On rhel7 slaves, it's defined as /home/hudson/static_build_env
Could an equivalent path be set for other OSes, so we can benefit from this NFS-mounted shared space?
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months
[JBoss JIRA] (JBIDE-24844) fix *.it.weekly jobs to properly build on macos w/ jdk1.8 (not openjdk 1.8)
by Nick Boldt (JIRA)
[ https://issues.jboss.org/browse/JBIDE-24844?page=com.atlassian.jira.plugi... ]
Nick Boldt edited comment on JBIDE-24844 at 9/1/17 5:46 PM:
------------------------------------------------------------
Current state (16 red balls): !redballs-16.png|thumbnail!
Trying a couple things:
a) use SHORT_COMBINATION for workspace paths, as we seem to have intermittent failures on Windows slaves [1].
b) enable Naginator to rebuild failing matrix combos (eg., because a slave dies in mid-run) after 30 mins [2]
Testing these fixes on this build [3].
[1] https://dev-platform-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/Devstud...
[2] https://dev-platform-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/Devstud...
[3] https://dev-platform-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/Devstud... >=97
Some job config snippets I'm working with:
{code}
<hudson.plugins.toolenv.ToolEnvBuildWrapper plugin="toolenv(a)1.1">
<vars>JDK1_5_HOME,JDK1_6_HOME,JDK1_7_HOME,JDK1_8_HOME,OPENJDK_1_7_HOME,OPENJDK_1_8_HOME</vars>
</hudson.plugins.toolenv.ToolEnvBuildWrapper>
--------
<childCustomWorkspace>${SHORT_COMBINATION}</childCustomWorkspace>
--------
<com.chikli.hudson.plugin.naginator.NaginatorPublisher plugin="naginator(a)1.17.2">
<regexpForRerun/>
<rerunIfUnstable>true</rerunIfUnstable>
<rerunMatrixPart>true</rerunMatrixPart>
<checkRegexp>false</checkRegexp>
<regexpForMatrixStrategy>TestChildrenRetriggerAll</regexpForMatrixStrategy>
<noChildStrategy>RerunWhole</noChildStrategy>
<delay class="com.chikli.hudson.plugin.naginator.FixedDelay">
<delay>30</delay>
</delay>
<maxSchedule>1</maxSchedule>
</com.chikli.hudson.plugin.naginator.NaginatorPublisher>
--------
<concurrentBuild>true</concurrentBuild>
<hudson.matrix.LabelExpAxis>
<name>label_exp</name>
<values>
<string>rhel7</string>
<string>fedora26</string>
<string>ubuntu1704</string>
<string>ubuntu1604</string>
<string>win10</string>
<string>win81</string>
<string>win7</string>
<string>macosx</string>
</values>
</hudson.matrix.LabelExpAxis>
</axes>
<combinationFilter>(label_exp == "macosx" || label_exp == "ubuntu1704" || label_exp == "ubuntu1604").implies(jdk == "jdk1.8")</combinationFilter>
{code}
was (Author: nickboldt):
Current state (16 red balls): !redballs-16.png|thumbnail!
Trying a couple things:
a) use SHORT_COMBINATION for workspace paths, as we seem to have intermittent failures on Windows slaves [1].
b) enable Naginator to rebuild failing matrix combos (eg., because a slave dies in mid-run) after 30 mins [2]
Testing these fixes on this build [3].
[1] https://dev-platform-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/Devstud...
[2] https://dev-platform-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/Devstud...
[3] https://dev-platform-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/Devstud... >=97
Snippets:
{code}
<hudson.plugins.toolenv.ToolEnvBuildWrapper plugin="toolenv(a)1.1">
<vars>JDK1_5_HOME,JDK1_6_HOME,JDK1_7_HOME,JDK1_8_HOME,OPENJDK_1_7_HOME,OPENJDK_1_8_HOME</vars>
</hudson.plugins.toolenv.ToolEnvBuildWrapper>
--------
<childCustomWorkspace>${SHORT_COMBINATION}</childCustomWorkspace>
--------
<com.chikli.hudson.plugin.naginator.NaginatorPublisher plugin="naginator(a)1.17.2">
<regexpForRerun/>
<rerunIfUnstable>true</rerunIfUnstable>
<rerunMatrixPart>true</rerunMatrixPart>
<checkRegexp>false</checkRegexp>
<regexpForMatrixStrategy>TestChildrenRetriggerAll</regexpForMatrixStrategy>
<noChildStrategy>RerunWhole</noChildStrategy>
<delay class="com.chikli.hudson.plugin.naginator.FixedDelay">
<delay>30</delay>
</delay>
<maxSchedule>1</maxSchedule>
</com.chikli.hudson.plugin.naginator.NaginatorPublisher>
--------
<hudson.matrix.LabelExpAxis>
<name>label_exp</name>
<values>
<string>rhel7</string>
<string>fedora26</string>
<string>ubuntu1704</string>
<string>ubuntu1604</string>
<string>win10</string>
<string>win81</string>
<string>win7</string>
<string>macosx</string>
</values>
</hudson.matrix.LabelExpAxis>
</axes>
<combinationFilter>(label_exp == "macosx" || label_exp == "ubuntu1704" || label_exp == "ubuntu1604").implies(jdk == "jdk1.8")</combinationFilter>
{code}
> fix *.it.weekly jobs to properly build on macos w/ jdk1.8 (not openjdk 1.8)
> ---------------------------------------------------------------------------
>
> Key: JBIDE-24844
> URL: https://issues.jboss.org/browse/JBIDE-24844
> Project: Tools (JBoss Tools)
> Issue Type: Feature Request
> Components: build
> Affects Versions: 4.5.0.Final
> Reporter: Nick Boldt
> Assignee: Nick Boldt
> Fix For: 4.5.1.AM2
>
> Attachments: red-weekly-smoke-tests.png, redballs-16.png
>
>
> As noted in JBIDE-24835, the it.weekly jobs try to run on macos w/ openjdk 1.8, but no such JDK exists there. Therefore need a combinationFilter to let us build with openjdk on windows and linux, and oracle jdk on macos.
> {code}
> combinationFilter = (label_exp == "macosx").implies(jdk == "jdk1.8") && (label_exp != "macosx").implies(jdk == "openjdk-1.8")
> {code}
> TODO: verify all the jobs linked from here [1] are working for all OSes
> [1] https://dev-platform-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/devstudi...
> * hibernatetools-itests.download-devstudio - test failures on rhel7 (not a matrix job)
> * livereload.it.weekly - failing for windows 8.1 & 10 due to unresolved parent pom
> * browsersim.it.weekly - failing for windows 8.1 due to unresolved parent pom
> * archives.it.weekly - failed to resolve tycho-plugins:repo-utils1.0.0 (bad Nexus settings?) on win81
> * vpe.it.weekly - test failures on win81
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months