An investigation of medical student reactions to feedback

A randomised controlled trial

Margaret L. Boehler, David A. Rogers, Cathy J. Schwind, Ruth Mayforth, Jacquelyn Quin, Reed G. Williams, Gary Dunnington

Research output: Contribution to journalArticle

96 Citations (Scopus)

Abstract

BACKGROUND: Medical educators have indicated that feedback is one of the main catalysts required for performance improvement. However, medical students appear to be persistently dissatisfied with the feedback that they receive. The purpose of this study was to evaluate learning outcomes and perceptions in students who received feedback compared to those who received general compliments. METHODS: All subjects received identical instruction on two-handed surgical knot-tying. Group 1 received specific, constructive feedback on how to improve their knot-tying skill. Group 2 received only general compliments. Performance was videotaped before and after instruction and after feedback. Subjects completed the study by indicating their global level of satisfaction. Three faculty evaluators observed and scored blinded videotapes of each performance. Intra-observer agreement among expert ratings of performance was calculated using 2-way random effects intraclass correlation (ICC) methods. Satisfaction scores and performance scores were compared using paired samples t-tests and independent samples t-tests. RESULTS: Performance data from 33 subjects were analysed. Inter-rater reliability exceeded 0.8 for ratings of pre-test, pre-intervention and post-intervention performances. The average performance of students who received specific feedback improved (21.98 versus 15.87, P <0.001), whereas there was no significant change in the performance score in the group who received only compliments (17.00 versus 15.39, P = 0.181) The average satisfaction rating in the group that received compliments was significantly higher than the group that received feedback (6.00 versus 5.00, P = 0.005). DISCUSSION: Student satisfaction is not an accurate measure of the quality of feedback. It appears that satisfaction ratings respond to praise more than feedback, while learning is more a function of feedback.

Original languageEnglish (US)
Pages (from-to)746-749
Number of pages4
JournalMedical Education
Volume40
Issue number8
DOIs
StatePublished - Aug 2006
Externally publishedYes

Fingerprint

Medical Students
medical student
Randomized Controlled Trials
performance
rating
Students
Group
Videotape Recording
instruction
student
learning
Learning
expert
educator

Keywords

  • *education, medical, undergraduate
  • *Feedback, psychological
  • Humans
  • Personal satisfaction
  • Randomised controlled trial
  • Students, medical/*psychology

ASJC Scopus subject areas

  • Nursing(all)
  • Education
  • Public Health, Environmental and Occupational Health

Cite this

Boehler, M. L., Rogers, D. A., Schwind, C. J., Mayforth, R., Quin, J., Williams, R. G., & Dunnington, G. (2006). An investigation of medical student reactions to feedback: A randomised controlled trial. Medical Education, 40(8), 746-749. https://doi.org/10.1111/j.1365-2929.2006.02503.x

An investigation of medical student reactions to feedback : A randomised controlled trial. / Boehler, Margaret L.; Rogers, David A.; Schwind, Cathy J.; Mayforth, Ruth; Quin, Jacquelyn; Williams, Reed G.; Dunnington, Gary.

In: Medical Education, Vol. 40, No. 8, 08.2006, p. 746-749.

Research output: Contribution to journalArticle

Boehler, ML, Rogers, DA, Schwind, CJ, Mayforth, R, Quin, J, Williams, RG & Dunnington, G 2006, 'An investigation of medical student reactions to feedback: A randomised controlled trial', Medical Education, vol. 40, no. 8, pp. 746-749. https://doi.org/10.1111/j.1365-2929.2006.02503.x
Boehler ML, Rogers DA, Schwind CJ, Mayforth R, Quin J, Williams RG et al. An investigation of medical student reactions to feedback: A randomised controlled trial. Medical Education. 2006 Aug;40(8):746-749. https://doi.org/10.1111/j.1365-2929.2006.02503.x
Boehler, Margaret L. ; Rogers, David A. ; Schwind, Cathy J. ; Mayforth, Ruth ; Quin, Jacquelyn ; Williams, Reed G. ; Dunnington, Gary. / An investigation of medical student reactions to feedback : A randomised controlled trial. In: Medical Education. 2006 ; Vol. 40, No. 8. pp. 746-749.
@article{d19c4b9a19dc491d9da1001232fc44b6,
title = "An investigation of medical student reactions to feedback: A randomised controlled trial",
abstract = "BACKGROUND: Medical educators have indicated that feedback is one of the main catalysts required for performance improvement. However, medical students appear to be persistently dissatisfied with the feedback that they receive. The purpose of this study was to evaluate learning outcomes and perceptions in students who received feedback compared to those who received general compliments. METHODS: All subjects received identical instruction on two-handed surgical knot-tying. Group 1 received specific, constructive feedback on how to improve their knot-tying skill. Group 2 received only general compliments. Performance was videotaped before and after instruction and after feedback. Subjects completed the study by indicating their global level of satisfaction. Three faculty evaluators observed and scored blinded videotapes of each performance. Intra-observer agreement among expert ratings of performance was calculated using 2-way random effects intraclass correlation (ICC) methods. Satisfaction scores and performance scores were compared using paired samples t-tests and independent samples t-tests. RESULTS: Performance data from 33 subjects were analysed. Inter-rater reliability exceeded 0.8 for ratings of pre-test, pre-intervention and post-intervention performances. The average performance of students who received specific feedback improved (21.98 versus 15.87, P <0.001), whereas there was no significant change in the performance score in the group who received only compliments (17.00 versus 15.39, P = 0.181) The average satisfaction rating in the group that received compliments was significantly higher than the group that received feedback (6.00 versus 5.00, P = 0.005). DISCUSSION: Student satisfaction is not an accurate measure of the quality of feedback. It appears that satisfaction ratings respond to praise more than feedback, while learning is more a function of feedback.",
keywords = "*education, medical, undergraduate, *Feedback, psychological, Humans, Personal satisfaction, Randomised controlled trial, Students, medical/*psychology",
author = "Boehler, {Margaret L.} and Rogers, {David A.} and Schwind, {Cathy J.} and Ruth Mayforth and Jacquelyn Quin and Williams, {Reed G.} and Gary Dunnington",
year = "2006",
month = "8",
doi = "10.1111/j.1365-2929.2006.02503.x",
language = "English (US)",
volume = "40",
pages = "746--749",
journal = "Medical Education",
issn = "0308-0110",
publisher = "Wiley-Blackwell",
number = "8",

}

TY - JOUR

T1 - An investigation of medical student reactions to feedback

T2 - A randomised controlled trial

AU - Boehler, Margaret L.

AU - Rogers, David A.

AU - Schwind, Cathy J.

AU - Mayforth, Ruth

AU - Quin, Jacquelyn

AU - Williams, Reed G.

AU - Dunnington, Gary

PY - 2006/8

Y1 - 2006/8

N2 - BACKGROUND: Medical educators have indicated that feedback is one of the main catalysts required for performance improvement. However, medical students appear to be persistently dissatisfied with the feedback that they receive. The purpose of this study was to evaluate learning outcomes and perceptions in students who received feedback compared to those who received general compliments. METHODS: All subjects received identical instruction on two-handed surgical knot-tying. Group 1 received specific, constructive feedback on how to improve their knot-tying skill. Group 2 received only general compliments. Performance was videotaped before and after instruction and after feedback. Subjects completed the study by indicating their global level of satisfaction. Three faculty evaluators observed and scored blinded videotapes of each performance. Intra-observer agreement among expert ratings of performance was calculated using 2-way random effects intraclass correlation (ICC) methods. Satisfaction scores and performance scores were compared using paired samples t-tests and independent samples t-tests. RESULTS: Performance data from 33 subjects were analysed. Inter-rater reliability exceeded 0.8 for ratings of pre-test, pre-intervention and post-intervention performances. The average performance of students who received specific feedback improved (21.98 versus 15.87, P <0.001), whereas there was no significant change in the performance score in the group who received only compliments (17.00 versus 15.39, P = 0.181) The average satisfaction rating in the group that received compliments was significantly higher than the group that received feedback (6.00 versus 5.00, P = 0.005). DISCUSSION: Student satisfaction is not an accurate measure of the quality of feedback. It appears that satisfaction ratings respond to praise more than feedback, while learning is more a function of feedback.

AB - BACKGROUND: Medical educators have indicated that feedback is one of the main catalysts required for performance improvement. However, medical students appear to be persistently dissatisfied with the feedback that they receive. The purpose of this study was to evaluate learning outcomes and perceptions in students who received feedback compared to those who received general compliments. METHODS: All subjects received identical instruction on two-handed surgical knot-tying. Group 1 received specific, constructive feedback on how to improve their knot-tying skill. Group 2 received only general compliments. Performance was videotaped before and after instruction and after feedback. Subjects completed the study by indicating their global level of satisfaction. Three faculty evaluators observed and scored blinded videotapes of each performance. Intra-observer agreement among expert ratings of performance was calculated using 2-way random effects intraclass correlation (ICC) methods. Satisfaction scores and performance scores were compared using paired samples t-tests and independent samples t-tests. RESULTS: Performance data from 33 subjects were analysed. Inter-rater reliability exceeded 0.8 for ratings of pre-test, pre-intervention and post-intervention performances. The average performance of students who received specific feedback improved (21.98 versus 15.87, P <0.001), whereas there was no significant change in the performance score in the group who received only compliments (17.00 versus 15.39, P = 0.181) The average satisfaction rating in the group that received compliments was significantly higher than the group that received feedback (6.00 versus 5.00, P = 0.005). DISCUSSION: Student satisfaction is not an accurate measure of the quality of feedback. It appears that satisfaction ratings respond to praise more than feedback, while learning is more a function of feedback.

KW - education, medical, undergraduate

KW - Feedback, psychological

KW - Humans

KW - Personal satisfaction

KW - Randomised controlled trial

KW - Students, medical/psychology

UR - http://www.scopus.com/inward/record.url?scp=33746568970&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33746568970&partnerID=8YFLogxK

U2 - 10.1111/j.1365-2929.2006.02503.x

DO - 10.1111/j.1365-2929.2006.02503.x

M3 - Article

VL - 40

SP - 746

EP - 749

JO - Medical Education

JF - Medical Education

SN - 0308-0110

IS - 8

ER -