An Investigation into the use of multi-source feedback (MSF) as a work-based assessment tool

Jeremy Brown, Kathryn Drury, Jill Fillingham, Philip Murphy, Margaret Bamforth, Ben Shaw

Research output: Contribution to journalArticle (journal)peer-review

9 Citations (Scopus)
189 Downloads (Pure)

Abstract

Introduction: This study compared Specialist Trainees’ (STs) hand-selected multi-source feedback (MSF) scores with those made by their clinical supervisors and explored perceptions of both those being assessed and those assessing. Methods: Participating STs were asked to hand a mini-PAT questionnaire to a clinical colleague of their choice and also to their Clinical Supervisor. Statistical analysis was carried out on submitted paired assessments to determine any differences in responses between clinical supervisors and hand-chosen assessors. Semi-structured interviews were held with seven nurses, seven Consultants and six postgraduate doctors. Results: Forty pairs of mini-PAT questionnaires were analysed. Hand-chosen assessors’ ratings were significantly higher than those for clinical supervisors with respect to: ‘‘good clinical care’’ (p50.01), ‘‘good medical practice’’ (p50.05), ‘‘teaching and training’’ (p50.01), ‘‘relationship with patients’’ (p50.05) as well as for overall impression of the trainee (p50.05). Five themes were identified from interviews: validity of selecting assessors; anonymity of assessors; usefulness of feedback; the value of multi-professional assessors; and grading. Discussions: There is a systematic difference in the assessment scores for trainees in MSF between clinical supervisors and hand-chosen assessors, the former scoring trainees more harshly. Grading was open to interpretation. This raised questions,especially from nurse interviewees regarding appropriate benchmarking.
Original languageEnglish
Pages (from-to)997-1004
Number of pages8
JournalMedical Teacher
Volume36
Issue number11
Early online date7 May 2014
DOIs
Publication statusPublished - 1 Nov 2014

Fingerprint

Dive into the research topics of 'An Investigation into the use of multi-source feedback (MSF) as a work-based assessment tool'. Together they form a unique fingerprint.

Cite this