Recommendations for code coverage tools?
I have a wishlist for code coverage tools and am wondering if people could recommend some tools that fulfill all or many of my wishes. I am starting my search for tools that work specifically with .net code, but will also need a tool for Java code as well, so recommendations for either would be appreciated.
- Integration with my continuous integration tool - TeamCity to run during unit test execution.
- Run against a deployed service or web service to track coverage during execution of automated and/or manual tests.
- Ability to merge results from multiple runs - I want to see combined coverage from all tests and then split it up to see results from unit tests vs functional automation vs manual regression.
- Ability to show coverage for specific executed tests.
I am currently evaluating NCover 4.0 for .net which is very promising, but can be expensive to license. I wanted to do a fair comparison to other tools before investing in the cost of NCover.
Feb 10 2016 Update
For the .net world mstest continues to provide code coverage. We also worked on integrating the Microsoft build technologies (msbuild, TeamBuild and the new TFS Build) with SonarQube.
Btw, TFS build also supports Java builds (via Maven, Ant and Gradle) and you can enable code coverage there. For Maven you even enable SonarQube analysis.
Visual Studio 2012 has a pretty good code coverage tool. I have used it to measure code coverage of a web service.
It is easy to integrate into build systems, you have out of the box support for TeamBuild (the TFS build) - see a more detailed article here.
According to msdn it has result merging.
Code coverage is also integrated in Microsoft Test Manager, so you can have manual testers do a round of testing on your service and at the end see how much of the code they actually hit.