For example, Belows tests are failed on first run but passed on second or third try: DuplicateNamePrefixResolutionTest # testDuplicateBeanNamePrefix CircularDependencyTest # testCircularInjectionOnOneDependentAndOneNormalBean UnproxyableTest # testInjectionPointWithUnproxyableTypeWhichResolvesToNormalScopedBean ResolutionByTypeTest # testGenericBeanTypesOnProducerMethod ResolutionByTypeTest # testGenericBeanTypesOnProducerField ResolutionByTypeTest # testGenericBeanTypesOnManagedBean Gurkan ------------------------------------------------------------------------ *From:* Mark Struberg <struberg(a)yahoo.de&gt; *To:* weld-dev(a)lists.jboss.org; Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; *Sent:* Sun, March 21, 2010 1:22:59 AM *Subject:* AW: [weld-dev] Running TCK Tests Whenever I had such weird problems with TestNG tests, then because the tests are not guaranteed to get executed in order by TestNG. It's not even guaranteed that all tests of a certain class gets executed before the next class ... So this might be a problem inside the TCK. LieGrue, strub --- Gurkan Erdogdu /&lt;gurkanerdogdu(a)yahoo.com&gt;/ schrieb am *Sa, 20.3.2010: * * Von: Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; Betreff: [weld-dev] Running TCK Tests An: weld-dev(a)lists.jboss.org Datum: Samstag, 20. März, 2010 23:42 Uhr * *Hello folks; I have been trying to run TCK tests but trouble into some weird situation. Some of the tests are sometimes passed and sometimes failed, and I did not find any reason for it. For example, I run ResolutionByTypeTest, sometimes it has passed all tests, sometimes 2 of them failed, sometimes one of them failed, sometimes 3 of them failed. But always failed tests are "testGenericBeanTypesOnManagedBean","testGenericBeanTypesOnProducerMethod",testGenericBeanTypesOnProducerField. I have trouble with some other tests also, for example "ResolutionByNameTest#testAmbiguousELNamesResolved", it has passed %95 and failed %5 of time What is the reason for all of these weird sitatuions ? I use Eclipse with TestNG plugin for testing. Thanks; --Gurkan * * * * * ------------------------------------------------------------------------ *Yahoo! Türkiye açıldı! Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! www.yahoo.com.tr <http://tr.yahoo.com/>* * -----Integrierter Anhang folgt----- * *_______________________________________________ weld-dev mailing list weld-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/weld-dev* __________________________________________________ Do You Yahoo!? Sie sind Spam leid? Yahoo! Mail verfügt über einen herausragenden Schutz gegen Massenmails. http://mail.yahoo.com ------------------------------------------------------------------------ Yahoo! Türkiye açıldı! Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! www.yahoo.com.tr <http://tr.yahoo.com/> _______________________________________________ weld-dev mailing list weld-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/weld-dev

Hello Jozef; Thanks for responding. We test OpenWebBeans for TCK. We are using the last released version of TCK. There is no problem for running tests uniquely, problem occurs while running tests successively in Eclipse via TestNG plugin with given test suite file. No difference with standalone or incontainer testing. Problem is the same. For example, running 582 test via TestNG plugin, lets say that 10 are failed. I am running failed tests with TestNG again, then 8 are passed and re-run failed tests and remaining 2 are passed. Is there any ordering issue in tests? or timing problems? Thanks; --Gurkan From: Jozef Hartinger <jharting(a)redhat.com&gt; To: Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; Cc: weld-dev(a)lists.jboss.org Sent: Mon, March 22, 2010 10:06:56 AM Subject: Re: [weld-dev] Running TCK Tests I am not able to reproduce. I just run ResolutionByTypeTest several times with 0 failures. Which version of TCK and Weld are you running? Are you running the TCK in standalone/incontainer mode? If incontainer which container? On 03/21/2010 02:01 AM, Gurkan Erdogdu wrote: > For example, > > Belows tests are failed on first run but passed on second or third try: > > DuplicateNamePrefixResolutionTest # testDuplicateBeanNamePrefix > CircularDependencyTest # testCircularInjectionOnOneDependentAndOneNormalBean > UnproxyableTest # > testInjectionPointWithUnproxyableTypeWhichResolvesToNormalScopedBean > ResolutionByTypeTest # testGenericBeanTypesOnProducerMethod > ResolutionByTypeTest # testGenericBeanTypesOnProducerField > ResolutionByTypeTest # testGenericBeanTypesOnManagedBean > > Gurkan > > ------------------------------------------------------------------------ > *From:* Mark Struberg <struberg(a)yahoo.de&gt; > *To:* weld-dev(a)lists.jboss.org; Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; > *Sent:* Sun, March 21, 2010 1:22:59 AM > *Subject:* AW: [weld-dev] Running TCK Tests > > Whenever I had such weird problems with TestNG tests, then because the > tests are not guaranteed to get executed in order by TestNG. It's not > even guaranteed that all tests of a certain class gets executed before > the next class ... > > So this might be a problem inside the TCK. > > LieGrue, > strub > > --- Gurkan Erdogdu /&lt;gurkanerdogdu(a)yahoo.com&gt;/ schrieb am *Sa, 20.3.2010: > * > > * > Von: Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; > Betreff: [weld-dev] Running TCK Tests > An: weld-dev(a)lists.jboss.org > Datum: Samstag, 20. März, 2010 23:42 Uhr > > * > *Hello folks; > > I have been trying to run TCK tests but trouble into some weird > situation. Some of the tests are sometimes passed and sometimes > failed, and I did not find any reason for it. For example, I run > ResolutionByTypeTest, sometimes it has passed all tests, sometimes 2 > of them failed, sometimes one of them failed, sometimes 3 of them > failed. But always failed tests are > "testGenericBeanTypesOnManagedBean","testGenericBeanTypesOnProducerMethod",testGenericBeanTypesOnProducerField. > > > I have trouble with some other tests also, for example > "ResolutionByNameTest#testAmbiguousELNamesResolved", it has passed > %95 and failed %5 of time > > What is the reason for all of these weird sitatuions ? I use Eclipse > with TestNG plugin for testing. > > Thanks; > > --Gurkan > > > * > * > * > * > * > ------------------------------------------------------------------------ > *Yahoo! Türkiye açıldı! > Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! > www.yahoo.com.tr <http://tr.yahoo.com/>* > * > -----Integrierter Anhang folgt----- > > * > *_______________________________________________ > weld-dev mailing list > weld-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/weld-dev* > > > __________________________________________________ > Do You Yahoo!? > Sie sind Spam leid? Yahoo! Mail verfügt über einen herausragenden Schutz > gegen Massenmails. > http://mail.yahoo.com > > ------------------------------------------------------------------------ > Yahoo! Türkiye açıldı! > Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! > www.yahoo.com.tr <http://tr.yahoo.com/> > > > > _______________________________________________ > weld-dev mailing list > weld-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/weld-dev Yahoo! Türkiye açıldı! Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! www.yahoo.com.tr_______________________________________________ weld-dev mailing list weld-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/weld-dev

hi Pete, I test failed tests with re-running and they have all passed. I really do not know the reason behind it! --Gurkan From: Pete Muir <pmuir(a)redhat.com&gt; To: Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; Cc: Jozef Hartinger <jharting(a)redhat.com>; weld-dev(a)lists.jboss.org Sent: Thu, April 8, 2010 12:52:23 PM Subject: Re: [weld-dev] Running TCK Tests Yes, this looks like an ordering issue. You will need to investigate if the issue is in OpenWebBeans or in the TCK - let us know via JIRA if you find any problems in the TCK! Pete On 22 Mar 2010, at 13:37, Gurkan Erdogdu wrote: > Hello Jozef; > > Thanks for responding. We test OpenWebBeans for TCK. We are using the last released version of TCK. There is no problem for running tests uniquely, problem occurs while running tests successively in Eclipse via TestNG plugin with given test suite file. > > No difference with standalone or incontainer testing. Problem is the same. For example, running 582 test via TestNG plugin, lets say that 10 are failed. I am running failed tests with TestNG again, then 8 are passed and re-run failed tests and remaining 2 are passed. > > Is there any ordering issue in tests? or timing problems? > > Thanks; > > --Gurkan > > From: Jozef Hartinger <jharting(a)redhat.com&gt; > To: Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; > Cc: weld-dev(a)lists.jboss.org > Sent: Mon, March 22, 2010 10:06:56 AM > Subject: Re: [weld-dev] Running TCK Tests > > I am not able to reproduce. I just run ResolutionByTypeTest several > times with 0 failures. Which version of TCK and Weld are you running? > Are you running the TCK in standalone/incontainer mode? If incontainer > which container? > > On 03/21/2010 02:01 AM, Gurkan Erdogdu wrote: > > For example, > > > > Belows tests are failed on first run but passed on second or third try: > > > > DuplicateNamePrefixResolutionTest # testDuplicateBeanNamePrefix > > CircularDependencyTest # testCircularInjectionOnOneDependentAndOneNormalBean > > UnproxyableTest # > > testInjectionPointWithUnproxyableTypeWhichResolvesToNormalScopedBean > > ResolutionByTypeTest # testGenericBeanTypesOnProducerMethod > > ResolutionByTypeTest # testGenericBeanTypesOnProducerField > > ResolutionByTypeTest # testGenericBeanTypesOnManagedBean > > > > Gurkan > > > > ------------------------------------------------------------------------ > > *From:* Mark Struberg <struberg(a)yahoo.de&gt; > > *To:* weld-dev(a)lists.jboss.org; Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; > > *Sent:* Sun, March 21, 2010 1:22:59 AM > > *Subject:* AW: [weld-dev] Running TCK Tests > > > > Whenever I had such weird problems with TestNG tests, then because the > > tests are not guaranteed to get executed in order by TestNG. It's not > > even guaranteed that all tests of a certain class gets executed before > > the next class ... > > > > So this might be a problem inside the TCK. > > > > LieGrue, > > strub > > > > --- Gurkan Erdogdu /&lt;gurkanerdogdu(a)yahoo.com&gt;/ schrieb am *Sa, 20.3.2010: > > * > > > > * > > Von: Gurkan Erdogdu <gurkanerdogdu(a)yahoo.com&gt; > > Betreff: [weld-dev] Running TCK Tests > > An: weld-dev(a)lists.jboss.org > > Datum: Samstag, 20. März, 2010 23:42 Uhr > > > > * > > *Hello folks; > > > > I have been trying to run TCK tests but trouble into some weird > > situation. Some of the tests are sometimes passed and sometimes > > failed, and I did not find any reason for it. For example, I run > > ResolutionByTypeTest, sometimes it has passed all tests, sometimes 2 > > of them failed, sometimes one of them failed, sometimes 3 of them > > failed. But always failed tests are > > "testGenericBeanTypesOnManagedBean","testGenericBeanTypesOnProducerMethod",testGenericBeanTypesOnProducerField. > > > > > > I have trouble with some other tests also, for example > > "ResolutionByNameTest#testAmbiguousELNamesResolved", it has passed > > %95 and failed %5 of time > > > > What is the reason for all of these weird sitatuions ? I use Eclipse > > with TestNG plugin for testing. > > > > Thanks; > > > > --Gurkan > > > > > > * > > * > > * > > * > > * > > ------------------------------------------------------------------------ > > *Yahoo! Türkiye açıldı! > > Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! > > www.yahoo.com.tr <http://tr.yahoo.com/>* > > * > > -----Integrierter Anhang folgt----- > > > > * > > *_______________________________________________ > > weld-dev mailing list > > weld-dev(a)lists.jboss.org > > https://lists.jboss.org/mailman/listinfo/weld-dev* > > > > > > __________________________________________________ > > Do You Yahoo!? > > Sie sind Spam leid? Yahoo! Mail verfügt über einen herausragenden Schutz > > gegen Massenmails. > > http://mail.yahoo.com > > > > ------------------------------------------------------------------------ > > Yahoo! Türkiye açıldı! > > Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! > > www.yahoo.com.tr <http://tr.yahoo.com/> > > > > > > > > _______________________________________________ > > weld-dev mailing list > > weld-dev(a)lists.jboss.org > > https://lists.jboss.org/mailman/listinfo/weld-dev > > Yahoo! Türkiye açıldı! > Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! > www.yahoo.com.tr_______________________________________________ > weld-dev mailing list > weld-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/weld-dev Yahoo! Türkiye açıldı! Haber, Ekonomi, Videolar, Oyunlar hepsi Yahoo! Türkiye'de! www.yahoo.com.tr