Abstract
Research institutes represent a large part of the Medical Research Council (MRC) annual investment in research, which amounts to 21% of its portfolio, representing £145 Millions. Thus, on the one hand, understanding the contribution of research institutes to the MRC objectives in terms of research excellence and impact is of prime importance. On the other hand, research evaluation exercises, such as the Quinquennial Reviews that the research institutes are subjected to take significant time and resources. Thus, institute assessments should provide the best way to both ensure accountability of the institutes while limiting as much as possible the administrative burden on them.
This project aims to review the evaluation process that MRC research institutes undergo to identify the evidence crucial to the decision making and accountability purposes defined by the sponsor, including the tracking of benefits, as well as to inform future science policy. To do so the project entails two strands of research.
A first strand consists of reviewing what evidence has been submitted in the research institutes past evaluation exercises through document analysis. This will characterise the evidence submitted across a number of themes (i.e. excellence, building capacity, collaboration, translation, diversity etc.), but also what type of evidence is submitted, whether these are general narratives about what has been achieved, case studies or quantitative evidence. In order to assess the usefulness of this evidence, we will also consult with stakeholders (expert panellists, executive team of the research council, etc.).
A second strand consists of exploring how bibliometric data can be leveraged to provide systematic and easily compiled evidence to evaluation exercises, to best help evidence a range of strategic benefits of research performed at institutes, such as collaborations, translational work, disciplinary focus etc.
Overall the project aims to i) provide a framework for tracking research institute benefits that takes into account that the performance of these research organisations will reflect a variety of objectives and missions, and ii) explore how evaluation can produce the best evidence while limiting the administrative burden of compiling this evidence.
Aim
- Understand necessary and sufficient evidence that should be submitted by research institutes to ensure accountability and reduce administrative burden
- Exploring how bibliometric data can be used to provide a range of useful indicators for research institutes’ assessment exercises.
Intended Impact of the Study
The study aims to co-develop with the MRC and its research institutes, an improved approach to compiling evidence of progress. The findings will be formally considered by the MRC and may be of more general interest to other funders and research organisations.
Project Lead
Project Collaborators
Ian Viney
Contact Project Author
Keywords
Research Area(s)
Study Design(s)
Data Collection Method(s)
Participant(s)
Status
Expected completion date: March 31, 2022