Question

My project has a number of packages (“models”, “controllers”, etc.). I’ve set up Jenkins with the Cobertura plugin to generate coverage reports, which is great. I’d like to mark a build as unstable if coverage drops below a certain threshold, but only on certain packages (e.g., “controllers”, but not “models”). I don’t see an obvious way to do this in the configuration UI, however — it looks like the thresholds are global.

Is there a way to do this?

Answer 1

(Answering my own question here)

As far as I can tell, this isn’t possible — I haven’t seen anything after a couple days of looking. I wrote a simple script that would do what I want — take the coverage output, parse it, and fail the build if coverage of specific packages didn’t meet certain thresholds. It’s dirty and can be cleaned up/expanded, but the basic idea is here. Comments are welcome.

#!/usr/bin/env python

'''
Jenkins' Cobertura plugin doesn't allow marking a build as successful or
failed based on coverage of individual packages -- only the project as a
whole. This script will parse the coverage.xml file and fail if the coverage of
specified packages doesn't meet the thresholds given

'''

import sys

from lxml import etree

PACKAGES_XPATH = etree.XPath('/coverage/packages/package')


def main(argv):
    filename = argv[0]
    package_args = argv[1:] if len(argv) > 1 else []
    # format is package_name:coverage_threshold
    package_coverage = {package: int(coverage) for
        package, coverage in [x.split(':') for x in package_args]}

    xml = open(filename, 'r').read()
    root = etree.fromstring(xml)

    packages = PACKAGES_XPATH(root)

    failed = False
    for package in packages:
        name = package.get('name')
        if name in package_coverage:
            # We care about this one
            print 'Checking package {} -- need {}% coverage'.format(
                name, package_coverage[name])
            coverage = float(package.get('line-rate', '0.0')) * 100
            if coverage < package_coverage[name]:
                print ('FAILED - Coverage for package {} is {}% -- '
                       'minimum is {}%'.format(
                        name, coverage, package_coverage[name]))
                failed = True
            else:
                print "PASS"

    if failed:
        sys.exit(1)

if __name__ == '__main__':
    main(sys.argv[1:])