Patient Assessment and Management Examination

lack of correlation between faculty assessment and resident self-assessment

Joseph R. Schneider, Michael J. Verta, Elizabeth Ryan, Julia F. Corcoran, Debra A. DaRosa

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Background: The Patient Assessment and Management Examination (PAME) is a standardized patient examination designed to assess management skills of senior residents. This study explored the relationship between faculty and resident self-evaluation by using PAME. Methods: Nine postgraduate year (PGY) 4 and PGY5 residents were examined with a 5 case PAME. Faculty rated interactions between residents and standardized patients and residents rated themselves based on review of audio-video recordings of their interactions. We examined correlations between faculty and resident self-assessments. Results: Faculty and resident ratings of physical examination skills was the only competency that correlated significantly. Correlations were not significant for the other 15 competencies (Pearson r, -.197 to .262). Correlation was no better when examined within each case. Conclusions: Although PAME may be a useful tool, this study suggests that even senior residents do not assess their performance as clinicians similarly to faculty. Further research is needed to better understand the source of these disagreements.

Original languageEnglish (US)
Pages (from-to)16-19
Number of pages4
JournalAmerican Journal of Surgery
Volume195
Issue number1
DOIs
StatePublished - Jan 1 2008
Externally publishedYes

Fingerprint

Video Recording
Diagnostic Self Evaluation
Physical Examination
Self-Assessment
Research

Keywords

  • Assessment
  • Core competency
  • Patient Assessment and Management Examination
  • Performance evaluation
  • Practice-based learning
  • Self-assessment
  • Standardized patients
  • Surgery
  • Testing

ASJC Scopus subject areas

  • Surgery

Cite this

Patient Assessment and Management Examination : lack of correlation between faculty assessment and resident self-assessment. / Schneider, Joseph R.; Verta, Michael J.; Ryan, Elizabeth; Corcoran, Julia F.; DaRosa, Debra A.

In: American Journal of Surgery, Vol. 195, No. 1, 01.01.2008, p. 16-19.

Research output: Contribution to journalArticle

Schneider, Joseph R. ; Verta, Michael J. ; Ryan, Elizabeth ; Corcoran, Julia F. ; DaRosa, Debra A. / Patient Assessment and Management Examination : lack of correlation between faculty assessment and resident self-assessment. In: American Journal of Surgery. 2008 ; Vol. 195, No. 1. pp. 16-19.
@article{3de8d6ba8f0d47f592338aacbff98c1e,
title = "Patient Assessment and Management Examination: lack of correlation between faculty assessment and resident self-assessment",
abstract = "Background: The Patient Assessment and Management Examination (PAME) is a standardized patient examination designed to assess management skills of senior residents. This study explored the relationship between faculty and resident self-evaluation by using PAME. Methods: Nine postgraduate year (PGY) 4 and PGY5 residents were examined with a 5 case PAME. Faculty rated interactions between residents and standardized patients and residents rated themselves based on review of audio-video recordings of their interactions. We examined correlations between faculty and resident self-assessments. Results: Faculty and resident ratings of physical examination skills was the only competency that correlated significantly. Correlations were not significant for the other 15 competencies (Pearson r, -.197 to .262). Correlation was no better when examined within each case. Conclusions: Although PAME may be a useful tool, this study suggests that even senior residents do not assess their performance as clinicians similarly to faculty. Further research is needed to better understand the source of these disagreements.",
keywords = "Assessment, Core competency, Patient Assessment and Management Examination, Performance evaluation, Practice-based learning, Self-assessment, Standardized patients, Surgery, Testing",
author = "Schneider, {Joseph R.} and Verta, {Michael J.} and Elizabeth Ryan and Corcoran, {Julia F.} and DaRosa, {Debra A.}",
year = "2008",
month = "1",
day = "1",
doi = "10.1016/j.amjsurg.2007.08.050",
language = "English (US)",
volume = "195",
pages = "16--19",
journal = "American Journal of Surgery",
issn = "0002-9610",
publisher = "Elsevier Inc.",
number = "1",

}

TY - JOUR

T1 - Patient Assessment and Management Examination

T2 - lack of correlation between faculty assessment and resident self-assessment

AU - Schneider, Joseph R.

AU - Verta, Michael J.

AU - Ryan, Elizabeth

AU - Corcoran, Julia F.

AU - DaRosa, Debra A.

PY - 2008/1/1

Y1 - 2008/1/1

N2 - Background: The Patient Assessment and Management Examination (PAME) is a standardized patient examination designed to assess management skills of senior residents. This study explored the relationship between faculty and resident self-evaluation by using PAME. Methods: Nine postgraduate year (PGY) 4 and PGY5 residents were examined with a 5 case PAME. Faculty rated interactions between residents and standardized patients and residents rated themselves based on review of audio-video recordings of their interactions. We examined correlations between faculty and resident self-assessments. Results: Faculty and resident ratings of physical examination skills was the only competency that correlated significantly. Correlations were not significant for the other 15 competencies (Pearson r, -.197 to .262). Correlation was no better when examined within each case. Conclusions: Although PAME may be a useful tool, this study suggests that even senior residents do not assess their performance as clinicians similarly to faculty. Further research is needed to better understand the source of these disagreements.

AB - Background: The Patient Assessment and Management Examination (PAME) is a standardized patient examination designed to assess management skills of senior residents. This study explored the relationship between faculty and resident self-evaluation by using PAME. Methods: Nine postgraduate year (PGY) 4 and PGY5 residents were examined with a 5 case PAME. Faculty rated interactions between residents and standardized patients and residents rated themselves based on review of audio-video recordings of their interactions. We examined correlations between faculty and resident self-assessments. Results: Faculty and resident ratings of physical examination skills was the only competency that correlated significantly. Correlations were not significant for the other 15 competencies (Pearson r, -.197 to .262). Correlation was no better when examined within each case. Conclusions: Although PAME may be a useful tool, this study suggests that even senior residents do not assess their performance as clinicians similarly to faculty. Further research is needed to better understand the source of these disagreements.

KW - Assessment

KW - Core competency

KW - Patient Assessment and Management Examination

KW - Performance evaluation

KW - Practice-based learning

KW - Self-assessment

KW - Standardized patients

KW - Surgery

KW - Testing

UR - http://www.scopus.com/inward/record.url?scp=36849037522&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=36849037522&partnerID=8YFLogxK

U2 - 10.1016/j.amjsurg.2007.08.050

DO - 10.1016/j.amjsurg.2007.08.050

M3 - Article

VL - 195

SP - 16

EP - 19

JO - American Journal of Surgery

JF - American Journal of Surgery

SN - 0002-9610

IS - 1

ER -