Hello Jozef;

Thanks for responding. We test OpenWebBeans for TCK. We are using the last released version of TCK. There is no problem for running tests uniquely, problem occurs while running tests successively in Eclipse via TestNG plugin with given test suite file.

No difference with standalone or incontainer testing. Problem is the same. For example, running 582 test via TestNG plugin, lets say that 10 are failed. I am running failed tests with TestNG again, then 8 are passed and re-run failed tests and remaining 2 are passed.

Is there any ordering issue in tests? or timing problems?

Thanks;

--Gurkan


From: Jozef Hartinger <jharting@redhat.com>
To: Gurkan Erdogdu <gurkanerdogdu@yahoo.com>
Cc: weld-dev@lists.jboss.org
Sent: Mon, March 22, 2010 10:06:56 AM
Subject: Re: [weld-dev] Running TCK Tests

I am not able to reproduce. I just run ResolutionByTypeTest several
times with 0 failures. Which version of TCK and Weld are you running?
Are you running the TCK in standalone/incontainer mode? If incontainer
which container?

On 03/21/2010 02:01 AM, Gurkan Erdogdu wrote:
> For example,
>
> Belows tests are failed on first run but passed on second or third try:
>
> DuplicateNamePrefixResolutionTest # testDuplicateBeanNamePrefix
> CircularDependencyTest # testCircularInjectionOnOneDependentAndOneNormalBean
> UnproxyableTest #
> testInjectionPointWithUnproxyableTypeWhichResolvesToNormalScopedBean
> ResolutionByTypeTest # testGenericBeanTypesOnProducerMethod
> ResolutionByTypeTest # testGenericBeanTypesOnProducerField
> ResolutionByTypeTest # testGenericBeanTypesOnManagedBean
>
> Gurkan
>
> ------------------------------------------------------------------------
> *From:* Mark Struberg <struberg@yahoo.de>
> *To:* weld-dev@lists.jboss.org; Gurkan Erdogdu <gurkanerdogdu@yahoo.com>
> *Sent:* Sun, March 21, 2010 1:22:59 AM
> *Subject:* AW: [weld-dev] Running TCK Tests
>
> Whenever I had such weird problems with TestNG tests, then because the
> tests are not guaranteed to get executed in order by TestNG. It's not
> even guaranteed that all tests of a certain class gets executed before
> the next class ...
>
> So this might be a problem inside the TCK.
>
> LieGrue,
> strub
>
> --- Gurkan Erdogdu /<gurkanerdogdu@yahoo.com>/ schrieb am *Sa, 20.3.2010:
> *
>
>    *
>    Von: Gurkan Erdogdu <gurkanerdogdu@yahoo.com>
>    Betreff: [weld-dev] Running TCK Tests
>    An: weld-dev@lists.jboss.org
>    Datum: Samstag, 20. März, 2010 23:42 Uhr
>
>    *
>    *Hello folks;
>
>    I have been trying to run TCK tests but trouble into some weird
>    situation. Some of the tests are sometimes passed and sometimes
>    failed, and I did not find any reason for it. For example, I run
>    ResolutionByTypeTest, sometimes it has passed all tests, sometimes 2
>    of them failed, sometimes one of them failed, sometimes 3 of them
>    failed. But always failed tests are
>    "testGenericBeanTypesOnManagedBean","testGenericBeanTypesOnProducerMethod",testGenericBeanTypesOnProducerField.
>
>
>    I have trouble with some other tests also, for example
>    "ResolutionByNameTest#testAmbiguousELNamesResolved", it has passed
>    %95 and failed %5 of time
>
>    What is the reason for all of these weird sitatuions ? I use Eclipse
>    with TestNG plugin for testing.
>
>    Thanks;
>
>    --Gurkan
>
>
>    *
>    *
>    *
>    *
>    *
>    ------------------------------------------------------------------------
>    *Yahoo! Türkiye açıldı!
>    Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de!
>    www.yahoo.com.tr <http://tr.yahoo.com/>*
>    *
>    -----Integrierter Anhang folgt-----
>
>    *
>    *_______________________________________________
>    weld-dev mailing list
>    weld-dev@lists.jboss.org
>    https://lists.jboss.org/mailman/listinfo/weld-dev*
>
>
> __________________________________________________
> Do You Yahoo!?
> Sie sind Spam leid? Yahoo! Mail verfügt über einen herausragenden Schutz
> gegen Massenmails.
> http://mail.yahoo.com
>
> ------------------------------------------------------------------------
> Yahoo! Türkiye açıldı!
> Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de!
> www.yahoo.com.tr <http://tr.yahoo.com/>
>
>
>
> _______________________________________________
> weld-dev mailing list
> weld-dev@lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/weld-dev


Yahoo! Türkiye açıldı!
Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de!
www.yahoo.com.tr