[weld-dev] Running TCK Tests

[Gurkan Erdogdu]

Hello Jozef;

Thanks for responding. We test OpenWebBeans for TCK. We are using the last released version of TCK. There is no problem for running tests uniquely, problem occurs while running tests successively in Eclipse via TestNG plugin with given test suite file. 

No difference with standalone or incontainer testing. Problem is the same. For example, running 582 test via TestNG plugin, lets say that 10 are failed. I am running failed tests with TestNG again, then 8 are passed and re-run failed tests and remaining 2 are passed.

Is there any ordering issue in tests? or timing problems?

Thanks;

--Gurkan




________________________________
From: Jozef Hartinger <jharting at redhat.com>
To: Gurkan Erdogdu <gurkanerdogdu at yahoo.com>
Cc: weld-dev at lists.jboss.org
Sent: Mon, March 22, 2010 10:06:56 AM
Subject: Re: [weld-dev] Running TCK Tests

I am not able to reproduce. I just run ResolutionByTypeTest several 
times with 0 failures. Which version of TCK and Weld are you running? 
Are you running the TCK in standalone/incontainer mode? If incontainer 
which container?

On 03/21/2010 02:01 AM, Gurkan Erdogdu wrote:
> For example,
>
> Belows tests are failed on first run but passed on second or third try:
>
> DuplicateNamePrefixResolutionTest # testDuplicateBeanNamePrefix
> CircularDependencyTest # testCircularInjectionOnOneDependentAndOneNormalBean
> UnproxyableTest #
> testInjectionPointWithUnproxyableTypeWhichResolvesToNormalScopedBean
> ResolutionByTypeTest # testGenericBeanTypesOnProducerMethod
> ResolutionByTypeTest # testGenericBeanTypesOnProducerField
> ResolutionByTypeTest # testGenericBeanTypesOnManagedBean
>
> Gurkan
>
> ------------------------------------------------------------------------
> *From:* Mark Struberg <struberg at yahoo.de>
> *To:* weld-dev at lists.jboss.org; Gurkan Erdogdu <gurkanerdogdu at yahoo.com>
> *Sent:* Sun, March 21, 2010 1:22:59 AM
> *Subject:* AW: [weld-dev] Running TCK Tests
>
> Whenever I had such weird problems with TestNG tests, then because the
> tests are not guaranteed to get executed in order by TestNG. It's not
> even guaranteed that all tests of a certain class gets executed before
> the next class ...
>
> So this might be a problem inside the TCK.
>
> LieGrue,
> strub
>
> --- Gurkan Erdogdu /<gurkanerdogdu at yahoo.com>/ schrieb am *Sa, 20.3.2010:
> *
>
>     *
>     Von: Gurkan Erdogdu <gurkanerdogdu at yahoo.com>
>     Betreff: [weld-dev] Running TCK Tests
>     An: weld-dev at lists.jboss.org
>     Datum: Samstag, 20. März, 2010 23:42 Uhr
>
>     *
>     *Hello folks;
>
>     I have been trying to run TCK tests but trouble into some weird
>     situation. Some of the tests are sometimes passed and sometimes
>     failed, and I did not find any reason for it. For example, I run
>     ResolutionByTypeTest, sometimes it has passed all tests, sometimes 2
>     of them failed, sometimes one of them failed, sometimes 3 of them
>     failed. But always failed tests are
>     "testGenericBeanTypesOnManagedBean","testGenericBeanTypesOnProducerMethod",testGenericBeanTypesOnProducerField.
>
>
>     I have trouble with some other tests also, for example
>     "ResolutionByNameTest#testAmbiguousELNamesResolved", it has passed
>     %95 and failed %5 of time
>
>     What is the reason for all of these weird sitatuions ? I use Eclipse
>     with TestNG plugin for testing.
>
>     Thanks;
>
>     --Gurkan
>
>
>     *
>     *
>     *
>     *
>     *
>     ------------------------------------------------------------------------
>     *Yahoo! Türkiye açıldı!
>     Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de!
>    www.yahoo.com.tr <http://tr.yahoo.com/>*
>     *
>     -----Integrierter Anhang folgt-----
>
>     *
>     *_______________________________________________
>     weld-dev mailing list
>    weld-dev at lists.jboss.org
>    https://lists.jboss.org/mailman/listinfo/weld-dev*
>
>
> __________________________________________________
> Do You Yahoo!?
> Sie sind Spam leid? Yahoo! Mail verfügt über einen herausragenden Schutz
> gegen Massenmails.
> http://mail.yahoo.com
>
> ------------------------------------------------------------------------
> Yahoo! Türkiye açıldı!
> Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de!
> www.yahoo.com.tr <http://tr.yahoo.com/>
>
>
>
> _______________________________________________
> weld-dev mailing list
> weld-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/weld-dev



      ___________________________________________________________________
Yahoo! Türkiye açıldı!  http://yahoo.com.tr
İnternet üzerindeki en iyi içeriği Yahoo! Türkiye sizlere sunuyor!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/weld-dev/attachments/20100322/e0f924bf/attachment-0001.html