[aerogear-dev] Aerogear SDK E2E testing discussion

[Jose Miguel Gallas Olmedo]

Hi Vojta, I recently created some tickets and some of them are about E2E
testing. I should have asked you first and perhaps you created already
tickets for that. In any case, here's the link o the thread and tickets:
https://groups.google.com/forum/?utm_medium=email&utm_source=footer#!msg/aerogear/FlZUqKwvt8Q/8BNa4O_9CQAJ

Please feel free to elaborate on those tickets or even close them if they
are duplicated (the E2E testing tickets).

JOSE MIGUEL GALLAS OLMEDO

ASSOCIATE QE, mobile

Red Hat

<https://www.redhat.com/>

M: +34618488633 <http://redhatemailsignature-marketing.itos.redhat.com/>
<https://red.ht/sig>

On 9 March 2018 at 12:49, Vojtech Sazel <vsazel at redhat.com> wrote:

> Hi all,
>
> Wei recommended me to start further discussion about viability of making
> E2E tests for regression testing of our SDKs. There was some debate around
> it, so I'm putting it also to the mailing list.
>
> I have done Appium UI test
> <https://github.com/aerogear/aerogear-sdk-e2e-tests/pull/1> of the
> example app included in AG Android SDK [1]
> <https://github.com/aerogear/aerogear-sdk-e2e-tests/pull/1>. It has been
> done for Auth functionality. This test checks happy path of login and
> logout.
>
> Is it worth doing it this way? Is it worth doing it at least for some
> functionality?
>
> My take TLDR:
>
> Pros:
> + it tests real end-user/developer usage of the SDK in the real device
> environment
>
> In the middle:
> = it requires running emulator or connected device to the test server
>
> Cons:
> - test stability (it can go wrong because of load on the test server)
> - test speed
> - UI change volatility can break the test - this is partially avoided by
> using page objects [2] <https://martinfowler.com/bliki/PageObject.html>
> pattern
>
> I think the real environment is clear benefit, for OpenID authentication,
> it's difficult to do it other way than from UI and using real browser. I
> don't know if this is true for other functionality. But writing tests at
> least for happy paths can be beneficial.
>
> refs:
> [1] https://github.com/aerogear/aerogear-sdk-e2e-tests/pull/1
> [2] https://martinfowler.com/bliki/PageObject.html
> --
>
> VOJTĚCH SÁZEL
>
> SENIOR SOFTWARE ENGINEER, RED HAT MOBILE
>
> Red Hat
>
> <https://www.redhat.com/>
>
> Remote Czech Republic
>
> vsazel at redhat.com    IM: vsazel
> <https://red.ht/sig>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/aerogear-dev/attachments/20180312/e96183f9/attachment-0001.html