TestResult isn't updated correctly when TestNG is used ------------------------------------------------------ Key: ARQ-1356 URL: https://issues.jboss.org/browse/ARQ-1356 Project: Arquillian Issue Type: Bug Security Level: Public(Everyone can see) Components: Base Implementation Affects Versions: 1.0.3.Final Environment: TestNG 6.1.1 Reporter: Jan Papousek Assignee: Jan Papousek When a test fails, the state of TestResult is still PASSED and therefore it can't be used in observer: {code} public class LifecycleObserver { @Inject private Instance<TestResult> result; public void afterTest(@Observes After event) { if (result.get().getStatus().equals(PASSED)) { // something } else { // something else } } } {code} The problem is [LocalTestExecutor|https://github.com/arquillian/arquillian-core/blob/mast...] updates the status to FAILED only if an [exception is thrown|https://github.com/arquillian/arquillian-core/blob/master/containe...], but [TestMethodExecutor|https://github.com/arquillian/arquillian-core/blob/mas...] from TestNG implemenation doesn't throw any exception when the test fails. It [memorizes it in ITestResult object|https://github.com/arquillian/arquillian-core/blob/master/testng/c...]. I propose to throw an exception in [the end of test invocation|https://github.com/arquillian/arquillian-core/blob/master/test...], if the test fails.