4:29 a.m.
I would like to start a discussion on how to test graphical user interfaces
related to WildFly.
There's a demand to test the client side of OpenID Connect. Other use cases
are integration tests in the Quickstarts [1] and smoke tests in the WildFly
test suite [2]. There has already been some discussion about this topic in
the chat [3].
We should find a common approach used for these use cases. There are several
different approaches:
1. Use Arquillian Drone and Graphene, Selenium and a WebDriver backed by
HtmlUnit. This approach is currently used in [2].
2. Use Arquillian Drone and Graphene, Selenium and a remote WebDriver provided
by Testcontainers [4].
3. Use HtmlUnit only
The list is not meant to be complete. Please let me know if you have any
suggestions for other methods or tools that could help us with our testing
needs.
One thing to keep in mind is that the final approach has to work also in a
closed CI environment without downloading resources from external
sources/repositories.
[1] https://issues.redhat.com/browse/WFLY-20129
[2] https://issues.redhat.com/browse/WFLY-20322
[3]
https://wildfly.zulipchat.com/#narrow/channel/174184-wildfly-developers/t...
[4] https://java.testcontainers.org/modules/webdriver_containers/
--
Harald Pehl
7:24 a.m.
Hi Harald
My use case are quickstarts and try to implement option 1 and 3. Here are my updates to
QS
option 1:
https://github.com/kstekovi/quickstart/commit/3d784824b5c19f42472575e4d1f...
option 3:
https://github.com/kstekovi/quickstart/commit/66da0ddf7a27e29f50b086ad0f1...
I was able to use both variants locally on my laptop when it start the QS test manually.
In the CI automation work only option 3.
For the option 1 in the CI I get the following errors:
13:28:16 [ERROR] Errors:
13:28:16 [ERROR] MailTestCaseIT.a_testSMTP:71 » NoSuchElement Unable to locate a node
using //ul[@id='smtp_messages']/li
13:28:16 For documentation on this error, please visit:
https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#n...
13:28:16 Build info: version: '4.19.1', revision: 'abe0ee07dc'
13:28:16 System info: os.name: 'Linux', os.arch: 'amd64', os.version:
'4.18.0-553.27.1.el8_10.x86_64', java.version: '17.0.12'
13:28:16 Driver info: driver.version: HtmlUnitDriver
13:28:16 [ERROR] MailTestCaseIT.b_retrievePOP3:93 » Timeout Expected condition failed:
waiting for
org.jboss.as.quickstarts.mail.MailTestCaseIT$$Lambda$447/0x00007fd58c5cadf0@6345e7b9
(tried for 15 second(s) with 500 milliseconds interval)
13:28:16 Build info: version: '4.19.1', revision: 'abe0ee07dc'
13:28:16 System info: os.name: 'Linux', os.arch: 'amd64', os.version:
'4.18.0-553.27.1.el8_10.x86_64', java.version: '17.0.12'
13:28:16 Driver info:
org.jboss.arquillian.drone.webdriver.htmlunit.DroneHtmlUnitDriver_ByGraphene
13:28:16 [INFO]
13:28:16 [ERROR] Tests run: 4, Failures: 0, Errors: 2, Skipped: 0
It looks the browser is ready and few test passed. Unfortunately not all. It didn't
found some required HTML elements and i don't know way. This didn't happens when i
use only HtmlUnit.
So i am voting for Option 3 - because the the setup of the browser is much easier and i
didn't had any issue with it locale or in CI
6:14 a.m.
Hi Krystof and everyone
First I would like to point out that in 'option 3', you're looking for
different element as in `option 1` (missing /li suffix).
Both option seems problematic for me even when running locally. They often
fail after cold start. But not in subsequent runs.
By coldstart I mean both WF server and james server (docker compose up
--remove-orphans --force-recreate and docker-compose down --volumes).
option 1:
```
[ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
18.18 s <<< FAILURE! -- in org.jboss.as.quickstarts.mail.MailTestCaseIT
[ERROR] org.jboss.as.quickstarts.mail.MailTestCaseIT.b_retrievePOP3 -- Time
elapsed: 15.20 s <<< ERROR!
org.openqa.selenium.TimeoutException:
Expected condition failed: waiting for
org.jboss.as.quickstarts.mail.MailTestCaseIT$$Lambda$265/0x00007faf10555f58@4d6f623d
(tried for 15 second(s) with 500 milliseconds interval)
Build info: version: '4.19.1', revision: 'abe0ee07dc'
System info: os.name: 'Linux', os.arch: 'amd64', os.version:
'6.12.8-200.fc41.x86_64', java.version: '17.0.13'
Driver info:
org.jboss.arquillian.drone.webdriver.htmlunit.DroneHtmlUnitDriver_ByGraphene
...
at
org.jboss.as.quickstarts.mail.MailTestCaseIT.b_retrievePOP3(MailTestCaseIT.java:93)
```
option 3:
```
[ERROR] org.jboss.as.quickstarts.mail.MailTestCaseIT.b_retrievePOP3 -- Time
elapsed: 0.452 s <<< FAILURE!
java.lang.AssertionError: Expected From not found:
at org.junit.Assert.fail(Assert.java:89)
```
This could be related to missing /li
On Tue, Jan 28, 2025 at 2:25 PM Krystof Stekovic <kstekovi(a)redhat.com>
wrote:
Hi Harald
My use case are quickstarts and try to implement option 1 and 3. Here are
my updates to QS
option 1:
https://github.com/kstekovi/quickstart/commit/3d784824b5c19f42472575e4d1f...
option 3:
https://github.com/kstekovi/quickstart/commit/66da0ddf7a27e29f50b086ad0f1...
I was able to use both variants locally on my laptop when it start the QS
test manually. In the CI automation work only option 3.
For the option 1 in the CI I get the following errors:
13:28:16 [ERROR] Errors:
13:28:16 [ERROR] MailTestCaseIT.a_testSMTP:71 » NoSuchElement Unable to
locate a node using //ul[@id='smtp_messages']/li
13:28:16 For documentation on this error, please visit:
https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#n...
13:28:16 Build info: version: '4.19.1', revision: 'abe0ee07dc'
13:28:16 System info: os.name: 'Linux', os.arch: 'amd64', os.version:
'4.18.0-553.27.1.el8_10.x86_64', java.version: '17.0.12'
13:28:16 Driver info: driver.version: HtmlUnitDriver
13:28:16 [ERROR] MailTestCaseIT.b_retrievePOP3:93 » Timeout Expected
condition failed: waiting for
org.jboss.as.quickstarts.mail.MailTestCaseIT$$Lambda$447/0x00007fd58c5cadf0@6345e7b9
(tried for 15 second(s) with 500 milliseconds interval)
13:28:16 Build info: version: '4.19.1', revision: 'abe0ee07dc'
13:28:16 System info: os.name: 'Linux', os.arch: 'amd64', os.version:
'4.18.0-553.27.1.el8_10.x86_64', java.version: '17.0.12'
13:28:16 Driver info:
org.jboss.arquillian.drone.webdriver.htmlunit.DroneHtmlUnitDriver_ByGraphene
13:28:16 [INFO]
13:28:16 [ERROR] Tests run: 4, Failures: 0, Errors: 2, Skipped: 0
It looks the browser is ready and few test passed. Unfortunately not all.
It didn't found some required HTML elements and i don't know way. This
didn't happens when i use only HtmlUnit.
So i am voting for Option 3 - because the the setup of the browser is much
easier and i didn't had any issue with it locale or in CI
_______________________________________________
wildfly-dev mailing list -- wildfly-dev(a)lists.jboss.org
To unsubscribe send an email to wildfly-dev-leave(a)lists.jboss.org
Privacy Statement: https://www.redhat.com/en/about/privacy-policy
List Archives:
https://lists.jboss.org/archives/list/wildfly-dev@lists.jboss.org/message...
9:24 a.m.
Thanks all for your input!
I've chosen HtmlUnit for the implementation (option 3). I've adjusted the related
PR [1] to reflect this.
[1] https://github.com/wildfly/wildfly/pull/18696
213
days inactive
245
days old
3 comments
3 participants
participants (3)
-
Harald Pehl -
Krystof Stekovic -
Ladislav Dokoupil