Determinants of quality of research environment: An assessment of the environment submissions in the UK’s Research Excellence Framework in 2014

MEHMET PINAR, EMRE UNLU

Research output: Contribution to journalArticle (journal)peer-review

9 Citations (Scopus)
84 Downloads (Pure)

Abstract

One of the assessed research elements in the UK’s Research Excellence Framework (REF) exercise in 2014 was the research environment. The quality of the research environment was assessed by expert peer reviewers who were given a set of quantitative factors to support their decision making. However, there is no systematic procedure to integrate this quantitative information into the evaluation process. This article evaluates the relevance of quantitative factors in explaining the assessed quality of the research environment. Findings suggest submitting units with high external research income generation tend to have a better research environment evaluation in almost all the assessed subject areas. The importance given by reviewers to similar quantitative factors was distinctively different in two units of assessment (UoA) in which the evaluation criteria were the same, which highlights the internal inconsistency of the peer review evaluation. Our findings also confirm the existence of the ‘halo effect’ in some UoA where submitting units that belong to the Russell group and have sub-panel members in the REF exercise obtained higher scores even after controlling for the assessed quantitative factors.
Original languageEnglish
Pages (from-to)231-244
Number of pages14
JournalResearch Evaluation
Volume29
Issue number3
Early online date17 Mar 2020
DOIs
Publication statusPublished - 1 Jul 2020

Keywords

  • Quality Research
  • Evaluation
  • Quantitative factors
  • Halo effects
  • Research environment
  • Research Excellence Framework
  • Regression analysis

Fingerprint

Dive into the research topics of 'Determinants of quality of research environment: An assessment of the environment submissions in the UK’s Research Excellence Framework in 2014'. Together they form a unique fingerprint.

Cite this