[jboss-jira] [JBoss JIRA] (AS7-2022) TS: Coverage reports

[Rostislav Svoboda (Commented) (JIRA)]

    [ https://issues.jboss.org/browse/AS7-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640935#comment-12640935 ] 

Rostislav Svoboda commented on AS7-2022:
----------------------------------------

Current Cobertura based coverage jobs mentioned in description are for AS7 unit tests. Cobertura needs source codes to produce instrumented classes and jars. And it has problems when tests are in separate module and not in the same module as source codes.

I was using Cobertura and Emma for code coverage on WS which has its testsuite in separate module and 2 submodules. I started with Cobertura and spent quite a lot of time to patch pom files. Than I had to merge Cobertura report files and it's not supported in maven plugin. I had to call ant from maven to merge these files and I had to know their exact location. 
Conclusion: Cobertura is good choice for code coverage for unit tests in modules but not good for testsuite module.

I'm using Emmma for WS code coverage. It can instrument directly jars, source code are not necessary. My workflow is simple: instrument jars in AS, patch pom.xml for emma.rt.control.port, run tests and generate report. There are some problems (for example with emma.rt.control.port) but it's minor comparing problem with Cobertura.
Conclusion: Works for my use use-case. Should work for your too.

Examples: 
- https://hudson.qa.jboss.com/hudson/view/EAP6-jbossws/job/eap6-jbossws-emma-jboss
- https://hudson.qa.jboss.com/hudson/view/EAP6-jbossws/job/eap6-jbossws-emma-cxf

                
> TS: Coverage reports
> --------------------
>
>                 Key: AS7-2022
>                 URL: https://issues.jboss.org/browse/AS7-2022
>             Project: Application Server 7
>          Issue Type: Sub-task
>          Components: Test Suite
>    Affects Versions: 7.1.0.Alpha1
>            Reporter: Ondrej Zizka
>            Assignee: Ondrej Zizka
>
> There are some coverage jobs in Hudson:
> * Aggregated: https://hudson.qa.jboss.com/hudson//view/JBoss%20AS/job/jboss-as7-code-coverage-cobertura/
> * Per module: https://hudson.qa.jboss.com/hudson/view/JBoss AS/job/JBoss-AS-7.0.x-unit-coverage/
> We can also use Emma: http://emma.sourceforge.net/ ,  http://mojo.codehaus.org/emma-maven-plugin/
> Or this? http://www.eclemma.org/jacoco/index.html
> TCK coverage reports: http://www.qa.jboss.com/~smcgowan/CDI-TCK-Assertions/jsr299-tck-impl-coverage-cdi.html

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira