Verification of proficiency in basic skills for postgraduate year 1 residents

Hilary Sanfey, Janet Ketchum, Jennifer Bartlett, Stephen Markwell, Andreas H. Meier, Reed Williams, Gary Dunnington

Research output: Contribution to journalArticle

27 Scopus citations

Abstract

Background: The American College of Surgeons and Association of Program Directors in Surgery Phase 1 curriculum involves basic surgical skills instructional modules and Verification of Proficiency. This article is a study and revision of beta versions of the Verification of Proficiency instruments. Methods: Postgraduate year 1 residents were tested on 11 skills after undergoing lab instruction and practice. Deidentified videotaped performances were scored and data were analyzed to identify correlations between individual checklist items and failure. Results: In all, 23 residents underwent Verification of Proficiency over 2 years; 8 (35%) passed all Verification of Proficiency examinations at the first attempt, 15 (65%) failed at least 1 module, and 11 (48%) failed at least 2 modules. Residents who failed to demonstrate proficiency underwent mandatory remediation and retested until their scores were considered proficient. Scrutiny of the results revealed checklist items that were predictive independently of overall failure. The pass rate was significantly greater in 2009 compared with 2008 after the introduction of rater training and consequences for failure. Conclusion: Verification of Proficiency provides a framework to evaluate learner progress toward skills proficiency. That we achieved 100% faculty compliance with more than 250 performances speaks to the feasibility of Verification of Proficiency. This approach should facilitate a more widespread Verification of Proficiency acceptance as a step closer to developing a final proficiency examination for basic surgical skills in postgraduate year 1 residents.

Original languageEnglish (US)
Pages (from-to)759-767
Number of pages9
JournalSurgery
Volume148
Issue number4
DOIs
StatePublished - Oct 1 2010

    Fingerprint

ASJC Scopus subject areas

  • Surgery

Cite this

Sanfey, H., Ketchum, J., Bartlett, J., Markwell, S., Meier, A. H., Williams, R., & Dunnington, G. (2010). Verification of proficiency in basic skills for postgraduate year 1 residents. Surgery, 148(4), 759-767. https://doi.org/10.1016/j.surg.2010.07.018