The use of standardized patients for mock oral board exams in neurology

A pilot study

Brett Kissela, Steven Harris, Dawn Kleindorfer, Christopher Lindsell, Robert Pascuzzi, Daniel Woo, Jerzy Szaflarski, Daniel Kanter, Alex Schneider, Michael Sostok, Joseph Broderick

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Background: Mock oral board exams, fashioned after the live patient hour of the American Board of Psychiatry and Neurology exam, are commonly part of resident assessment during residency training. Exams using real patients selected from clinics or hospitals are not standardized and do not allow comparisons of resident performance across the residency program. We sought to create a standardized patient mock oral board exam that would allow comparison of residents' clinical performance. Methods: Three cases were created and then used for this mock oral boards exercise utilizing trained standardized patients. Residents from the University of Cincinnati and Indiana University participated in the exam. Residents were scored by attending physician examiners who directly observed the encounter with the standardized patient. The standardized patient also assessed each resident. A post-test survey was administered to ascertain participant's satisfaction with the examination process. Results: Resident scores were grouped within one standard deviation of the mean, with the exception of one resident who was also subjectively felt to "fail" the exam. In exams with two faculty "evaluators", scores were highly correlated. The survey showed satisfaction with the examination process in general. Conclusion: Standardized patients can be used for mock oral boards in the live patient format. Our initial experience with this examination process was positive. Further testing is needed to determine if this examination format is more reliable and valid than traditional methods of assessing resident competency.

Original languageEnglish
Article number22
JournalBMC Medical Education
Volume6
DOIs
StatePublished - Apr 25 2006

Fingerprint

neurology
Neurology
resident
examination
Internship and Residency
examiner
Psychiatry
psychiatry
performance
Exercise
Physicians
physician

ASJC Scopus subject areas

  • Medicine(all)

Cite this

The use of standardized patients for mock oral board exams in neurology : A pilot study. / Kissela, Brett; Harris, Steven; Kleindorfer, Dawn; Lindsell, Christopher; Pascuzzi, Robert; Woo, Daniel; Szaflarski, Jerzy; Kanter, Daniel; Schneider, Alex; Sostok, Michael; Broderick, Joseph.

In: BMC Medical Education, Vol. 6, 22, 25.04.2006.

Research output: Contribution to journalArticle

Kissela, B, Harris, S, Kleindorfer, D, Lindsell, C, Pascuzzi, R, Woo, D, Szaflarski, J, Kanter, D, Schneider, A, Sostok, M & Broderick, J 2006, 'The use of standardized patients for mock oral board exams in neurology: A pilot study', BMC Medical Education, vol. 6, 22. https://doi.org/10.1186/1472-6920-6-22
Kissela, Brett ; Harris, Steven ; Kleindorfer, Dawn ; Lindsell, Christopher ; Pascuzzi, Robert ; Woo, Daniel ; Szaflarski, Jerzy ; Kanter, Daniel ; Schneider, Alex ; Sostok, Michael ; Broderick, Joseph. / The use of standardized patients for mock oral board exams in neurology : A pilot study. In: BMC Medical Education. 2006 ; Vol. 6.
@article{8daf1efbf5f7481eb796007cb5276fbc,
title = "The use of standardized patients for mock oral board exams in neurology: A pilot study",
abstract = "Background: Mock oral board exams, fashioned after the live patient hour of the American Board of Psychiatry and Neurology exam, are commonly part of resident assessment during residency training. Exams using real patients selected from clinics or hospitals are not standardized and do not allow comparisons of resident performance across the residency program. We sought to create a standardized patient mock oral board exam that would allow comparison of residents' clinical performance. Methods: Three cases were created and then used for this mock oral boards exercise utilizing trained standardized patients. Residents from the University of Cincinnati and Indiana University participated in the exam. Residents were scored by attending physician examiners who directly observed the encounter with the standardized patient. The standardized patient also assessed each resident. A post-test survey was administered to ascertain participant's satisfaction with the examination process. Results: Resident scores were grouped within one standard deviation of the mean, with the exception of one resident who was also subjectively felt to {"}fail{"} the exam. In exams with two faculty {"}evaluators{"}, scores were highly correlated. The survey showed satisfaction with the examination process in general. Conclusion: Standardized patients can be used for mock oral boards in the live patient format. Our initial experience with this examination process was positive. Further testing is needed to determine if this examination format is more reliable and valid than traditional methods of assessing resident competency.",
author = "Brett Kissela and Steven Harris and Dawn Kleindorfer and Christopher Lindsell and Robert Pascuzzi and Daniel Woo and Jerzy Szaflarski and Daniel Kanter and Alex Schneider and Michael Sostok and Joseph Broderick",
year = "2006",
month = "4",
day = "25",
doi = "10.1186/1472-6920-6-22",
language = "English",
volume = "6",
journal = "BMC Medical Education",
issn = "1472-6920",
publisher = "BioMed Central",

}

TY - JOUR

T1 - The use of standardized patients for mock oral board exams in neurology

T2 - A pilot study

AU - Kissela, Brett

AU - Harris, Steven

AU - Kleindorfer, Dawn

AU - Lindsell, Christopher

AU - Pascuzzi, Robert

AU - Woo, Daniel

AU - Szaflarski, Jerzy

AU - Kanter, Daniel

AU - Schneider, Alex

AU - Sostok, Michael

AU - Broderick, Joseph

PY - 2006/4/25

Y1 - 2006/4/25

N2 - Background: Mock oral board exams, fashioned after the live patient hour of the American Board of Psychiatry and Neurology exam, are commonly part of resident assessment during residency training. Exams using real patients selected from clinics or hospitals are not standardized and do not allow comparisons of resident performance across the residency program. We sought to create a standardized patient mock oral board exam that would allow comparison of residents' clinical performance. Methods: Three cases were created and then used for this mock oral boards exercise utilizing trained standardized patients. Residents from the University of Cincinnati and Indiana University participated in the exam. Residents were scored by attending physician examiners who directly observed the encounter with the standardized patient. The standardized patient also assessed each resident. A post-test survey was administered to ascertain participant's satisfaction with the examination process. Results: Resident scores were grouped within one standard deviation of the mean, with the exception of one resident who was also subjectively felt to "fail" the exam. In exams with two faculty "evaluators", scores were highly correlated. The survey showed satisfaction with the examination process in general. Conclusion: Standardized patients can be used for mock oral boards in the live patient format. Our initial experience with this examination process was positive. Further testing is needed to determine if this examination format is more reliable and valid than traditional methods of assessing resident competency.

AB - Background: Mock oral board exams, fashioned after the live patient hour of the American Board of Psychiatry and Neurology exam, are commonly part of resident assessment during residency training. Exams using real patients selected from clinics or hospitals are not standardized and do not allow comparisons of resident performance across the residency program. We sought to create a standardized patient mock oral board exam that would allow comparison of residents' clinical performance. Methods: Three cases were created and then used for this mock oral boards exercise utilizing trained standardized patients. Residents from the University of Cincinnati and Indiana University participated in the exam. Residents were scored by attending physician examiners who directly observed the encounter with the standardized patient. The standardized patient also assessed each resident. A post-test survey was administered to ascertain participant's satisfaction with the examination process. Results: Resident scores were grouped within one standard deviation of the mean, with the exception of one resident who was also subjectively felt to "fail" the exam. In exams with two faculty "evaluators", scores were highly correlated. The survey showed satisfaction with the examination process in general. Conclusion: Standardized patients can be used for mock oral boards in the live patient format. Our initial experience with this examination process was positive. Further testing is needed to determine if this examination format is more reliable and valid than traditional methods of assessing resident competency.

UR - http://www.scopus.com/inward/record.url?scp=33646762512&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33646762512&partnerID=8YFLogxK

U2 - 10.1186/1472-6920-6-22

DO - 10.1186/1472-6920-6-22

M3 - Article

VL - 6

JO - BMC Medical Education

JF - BMC Medical Education

SN - 1472-6920

M1 - 22

ER -