Metrics in Research Evaluation

Abstract

A recent rise in the accountability of research programmes, driven by economic circumstances, makes research evaluation increasingly needed. At the same time, computational advances and the advent of the Internet have given rise to a variety of metrics. If used appropriately, and in conjunction with peer evaluation and careful interpretation, these can inform and enhance research assessment through the benefits of impartiality, comparability, and scalability. Three initiatives (the DORA declaration, the HEFCE review of metrics, and the Snowball metrics project) have recently made the call for metrics to be appropriately used in research evaluation at various levels. Research assessment scenarios are multiple and complex; circumstances may shift for the same entities in different roles. A few easy tricks can help make the best use of metrics in research evaluation exercises: the use of trends, benchmarks and comparators, normalisation to size or resources, geographic or subject breakdowns, triangulation of indicators, and last but not least vigilant consideration of context.