From the Security project perspective:
Test Batch 1:
====================================
*org.jboss.test.security.test.EJBSpecUnitTestCase(tests-security-basic-unit).testMDBRunAs
*org.jboss.test.security.test.EJBSpecUnitTestCase(tests-security-basic-unit).testMDBDeepRunAs
*org.jboss.test.jacc.test.EJBSpecUnitTestCase(JACC).testRunAsWithRoles
*org.jboss.test.jacc.test.EJBSpecUnitTestCase(JACC).testMDBDeepRunAs
====================================
Reason: There is some issue with the lookup of ejb local refs here. I
need to dig further in metadata project for these??
org.jboss.test.security.ejb.CallerBean.java#invokeEcho(...)
Context enc = (Context) ic.lookup("java:comp/env");
Object ref = enc.lookup("ejb/local/CalleeHome"); <==== NPE
enc is null so there is a NPE. Why would the lookup of env become null?
Test Batch 2:
==================================
*org.jboss.test.web.test.FormAuthUnitTestCase(tomcat-federation).testPostDataFormAuth
*org.jboss.test.web.test.JASPIFormAuthUnitTestCase.unknown
*org.jboss.test.web.test.FormAuthUnitTestCase(tomcat-federation).testPostDataFormAuth
*org.jboss.test.jacc.test.FormAuthUnitTestCase(JACC).testPostDataFormAuth
===================================
Reason:
http://jira.jboss.com/jira/browse/JBAS-5645 (Fix available when
Remy releases next CR of JBossWeb)
Test Batch 3:
====================================
*org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testRoleSecuredSLSB
*org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testBasicSecuredSLSB
*org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testBasicSecuredServiceAccess
*org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testBasicSecuredDIIAccess
*org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testRoleSecuredServiceAccess
=======================================
Reason:
http://www.jboss.com/index.html?module=bb&op=viewtopic&p=4157811
Something to do with WS deployments not getting deployed properly or such.
Other Security related Tests: I have fixes for a few.
The above will be dealt immediately after 5.0.0.CR1
Sacha Labourey wrote:
In case you usually don't look at the result of the AS testsuite,
here
is the list of the 39 remaining failing tests:
* org.jboss.test.naming.test.SimpleUnitTestCase.unknown
*
org.jboss.test.classloader.leak.test.AopPreparedClassesClassloaderLeakUnitTestCase.testNoCacheReplicableWar
*
org.jboss.test.cluster.classloader.leak.test.ClassloaderLeakUnitTestCase(ClusteredClassLoaderLeak).testSimpleWar
*
org.jboss.test.jbossmessaging.clustertest.ClusteredTestCase(tests-jbossmessaging-cluster).testSimpleCluster
*
org.jboss.test.profileservice.test.DeployUnitTestCase(profileservice).testEjb3xDeployment
* org.jboss.test.util.test.SchedulerUnitTestCase.testDefaultScheduler
* org.jboss.test.jacc.test.EJBSpecUnitTestCase(JACC).testRunAsWithRoles
* org.jboss.test.jacc.test.EJBSpecUnitTestCase(JACC).testMDBDeepRunAs
*
org.jboss.test.cluster.classloader.leak.test.ClassloaderLeakUnitTestCase(ClusteredClassLoaderLeak).testNoPassivationWar
*
org.jboss.test.cluster.classloader.leak.test.FieldGranularityClassloaderLeakUnitTestCase(ClusteredClassLoaderLeak).testSimpleReplicableWar
*
org.jboss.test.cluster.classloader.leak.test.FieldGranularityClassloaderLeakUnitTestCase(ClusteredClassLoaderLeak).testFieldWar
*
org.jboss.test.cluster.classloader.leak.test.FieldGranularityClassloaderLeakUnitTestCase(ClusteredClassLoaderLeak).testFieldNoReplicableWar
* org.jboss.test.timer.test.BasicTimerUnitTestCase.testMDBTimer
*
org.jboss.test.cluster.defaultcfg.test.PartitionRestartUnitTestCase(Default-udp).testStatefulBeanFailover
*
org.jboss.test.compatibility.test.SerialVersionUIDUnitTestCase(tests-compatibility).test401Compatibility
*
org.jboss.test.compatibility.test.SerialVersionUIDUnitTestCase(tests-compatibility).testJ2EERI141Compatibility
*
org.jboss.test.jacc.test.FormAuthUnitTestCase(JACC).testPostDataFormAuth
*
org.jboss.test.web.security.AuthenticatorsExternalizationTestCase(tomcat-federation).testHeaderBasedAuthentication
*
org.jboss.test.web.test.FormAuthUnitTestCase(tomcat-federation).testPostDataFormAuth
*
org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testRoleSecuredSLSB
*
org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testBasicSecuredSLSB
*
org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testBasicSecuredServiceAccess
*
org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testBasicSecuredDIIAccess
*
org.jboss.test.webservice.jbws309.JBWS309TestCase(JACC).testRoleSecuredServiceAccess
*
org.jboss.test.security.test.EJBSpecUnitTestCase(tests-security-basic-unit).testMDBRunAs
*
org.jboss.test.security.test.EJBSpecUnitTestCase(tests-security-basic-unit).testMDBDeepRunAs
* org.jboss.test.web.test.FormAuthUnitTestCase.testPostDataFormAuth
*
org.jboss.test.refs.test.CircularRefResolutionUnitTestCase.testClientSessionRefByInterface
* org.jboss.test.asynch.AsynchTestCase.
*
org.jboss.test.refs.test.RefResolutionUnitTestCase.testClientSessionRefByInterface
* org.jboss.test.jmx.test.DeployXMBeanUnitTestCase.testSecuredJndiXMBean
*
org.jboss.test.jmx.test.DeployXMBeanUnitTestCase.testPersistentJndiXMBean
* org.jboss.test.naming.test.NamingRestartUnitTestCase.testLookupLink
* org.jboss.test.web.test.JASPIFormAuthUnitTestCase.unknown
* org.jboss.test.naming.test.EjbLinkUnitTestCase.testEjbNoLink
*
org.jboss.test.naming.test.InternalNamingClassReplacementUnitTestCase.testEjbNoLink
*
org.jboss.test.jcaprops.test.JBossRaXmlOverrideUnitTestCase.testJBossRaXmlOverride
* org.jboss.test.jmx.test.JMXConnectorUnitTestCase.testNotification
*
org.jboss.test.jmx.test.JMXConnectorUnitTestCase.testNotificationWithBadListener