[jbosstools-issues] [JBoss JIRA] (JBIDE-23026) Integration tests: improve test stability

[Marián Labuda (JIRA)]

    [ https://issues.jboss.org/browse/JBIDE-23026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13319539#comment-13319539 ] 

Marián Labuda edited comment on JBIDE-23026 at 11/9/16 8:30 AM:
----------------------------------------------------------------

IT tests are not stable enough to have them passed in a single run, sometimes because of timeouts, other times bcs. of UI bugs. But there are also some issues I found recently and once I finish with current tasks, I am about to fix it and make it more stable and runnable on Central CI, probably on OpenShift from minishift.

What are the most common issues?

At the moment the most significant issue is https://issues.jboss.org/browse/JBIDE-23463 which break many tests bcs. we were waiting for a finished build pod and thus it is failing.


was (Author: mlabuda):
IT tests are not stable enough to have them passed in a single run, sometimes because of timeouts, other times bcs. of UI bugs. But there are also some issues I found recently and once I finish with current tasks, I am about to fix it and make it more stable and runnable on Central CI, probably on OpenShift from minishift.

What are the most common issues?

> Integration tests: improve test stability
> -----------------------------------------
>
>                 Key: JBIDE-23026
>                 URL: https://issues.jboss.org/browse/JBIDE-23026
>             Project: Tools (JBoss Tools)
>          Issue Type: Sub-task
>          Components: openshift
>    Affects Versions: 4.4.1.AM3
>            Reporter: Andre Dietisheim
>            Assignee: Andre Dietisheim
>            Priority: Critical
>              Labels: integration_tests
>             Fix For: 4.4.2.Final
>
>
> There are several impediments to the test stability:
> * tests dont set up their env individually
> * some tests assert the oc binary, but this binary is not the same across platforms (oc, oc.exe, etc): org.jboss.tools.openshift.reddeer.requirement.OCBinary et org.jboss.tools.openshift.reddeer.utils.OpenShiftLabel



--
This message was sent by Atlassian JIRA
(v7.2.3#72005)