Verification of proficiency in basic skills for postgraduate year 1 residents

Hilary Sanfey, Janet Ketchum, Jennifer Bartlett, Stephen Markwell, Andreas H. Meier, Reed Williams, Gary Dunnington

Research output: Contribution to journalArticle

26 Citations (Scopus)

Abstract

Background: The American College of Surgeons and Association of Program Directors in Surgery Phase 1 curriculum involves basic surgical skills instructional modules and Verification of Proficiency. This article is a study and revision of beta versions of the Verification of Proficiency instruments. Methods: Postgraduate year 1 residents were tested on 11 skills after undergoing lab instruction and practice. Deidentified videotaped performances were scored and data were analyzed to identify correlations between individual checklist items and failure. Results: In all, 23 residents underwent Verification of Proficiency over 2 years; 8 (35%) passed all Verification of Proficiency examinations at the first attempt, 15 (65%) failed at least 1 module, and 11 (48%) failed at least 2 modules. Residents who failed to demonstrate proficiency underwent mandatory remediation and retested until their scores were considered proficient. Scrutiny of the results revealed checklist items that were predictive independently of overall failure. The pass rate was significantly greater in 2009 compared with 2008 after the introduction of rater training and consequences for failure. Conclusion: Verification of Proficiency provides a framework to evaluate learner progress toward skills proficiency. That we achieved 100% faculty compliance with more than 250 performances speaks to the feasibility of Verification of Proficiency. This approach should facilitate a more widespread Verification of Proficiency acceptance as a step closer to developing a final proficiency examination for basic surgical skills in postgraduate year 1 residents.

Original languageEnglish (US)
Pages (from-to)759-767
Number of pages9
JournalSurgery
Volume148
Issue number4
DOIs
StatePublished - Oct 2010
Externally publishedYes

Fingerprint

Checklist
Curriculum

ASJC Scopus subject areas

  • Surgery
  • Medicine(all)

Cite this

Sanfey, H., Ketchum, J., Bartlett, J., Markwell, S., Meier, A. H., Williams, R., & Dunnington, G. (2010). Verification of proficiency in basic skills for postgraduate year 1 residents. Surgery, 148(4), 759-767. https://doi.org/10.1016/j.surg.2010.07.018

Verification of proficiency in basic skills for postgraduate year 1 residents. / Sanfey, Hilary; Ketchum, Janet; Bartlett, Jennifer; Markwell, Stephen; Meier, Andreas H.; Williams, Reed; Dunnington, Gary.

In: Surgery, Vol. 148, No. 4, 10.2010, p. 759-767.

Research output: Contribution to journalArticle

Sanfey, H, Ketchum, J, Bartlett, J, Markwell, S, Meier, AH, Williams, R & Dunnington, G 2010, 'Verification of proficiency in basic skills for postgraduate year 1 residents', Surgery, vol. 148, no. 4, pp. 759-767. https://doi.org/10.1016/j.surg.2010.07.018
Sanfey H, Ketchum J, Bartlett J, Markwell S, Meier AH, Williams R et al. Verification of proficiency in basic skills for postgraduate year 1 residents. Surgery. 2010 Oct;148(4):759-767. https://doi.org/10.1016/j.surg.2010.07.018
Sanfey, Hilary ; Ketchum, Janet ; Bartlett, Jennifer ; Markwell, Stephen ; Meier, Andreas H. ; Williams, Reed ; Dunnington, Gary. / Verification of proficiency in basic skills for postgraduate year 1 residents. In: Surgery. 2010 ; Vol. 148, No. 4. pp. 759-767.
@article{3e54e6a7a8004ead8546513f645c2752,
title = "Verification of proficiency in basic skills for postgraduate year 1 residents",
abstract = "Background: The American College of Surgeons and Association of Program Directors in Surgery Phase 1 curriculum involves basic surgical skills instructional modules and Verification of Proficiency. This article is a study and revision of beta versions of the Verification of Proficiency instruments. Methods: Postgraduate year 1 residents were tested on 11 skills after undergoing lab instruction and practice. Deidentified videotaped performances were scored and data were analyzed to identify correlations between individual checklist items and failure. Results: In all, 23 residents underwent Verification of Proficiency over 2 years; 8 (35{\%}) passed all Verification of Proficiency examinations at the first attempt, 15 (65{\%}) failed at least 1 module, and 11 (48{\%}) failed at least 2 modules. Residents who failed to demonstrate proficiency underwent mandatory remediation and retested until their scores were considered proficient. Scrutiny of the results revealed checklist items that were predictive independently of overall failure. The pass rate was significantly greater in 2009 compared with 2008 after the introduction of rater training and consequences for failure. Conclusion: Verification of Proficiency provides a framework to evaluate learner progress toward skills proficiency. That we achieved 100{\%} faculty compliance with more than 250 performances speaks to the feasibility of Verification of Proficiency. This approach should facilitate a more widespread Verification of Proficiency acceptance as a step closer to developing a final proficiency examination for basic surgical skills in postgraduate year 1 residents.",
author = "Hilary Sanfey and Janet Ketchum and Jennifer Bartlett and Stephen Markwell and Meier, {Andreas H.} and Reed Williams and Gary Dunnington",
year = "2010",
month = "10",
doi = "10.1016/j.surg.2010.07.018",
language = "English (US)",
volume = "148",
pages = "759--767",
journal = "Surgery",
issn = "0039-6060",
publisher = "Mosby Inc.",
number = "4",

}

TY - JOUR

T1 - Verification of proficiency in basic skills for postgraduate year 1 residents

AU - Sanfey, Hilary

AU - Ketchum, Janet

AU - Bartlett, Jennifer

AU - Markwell, Stephen

AU - Meier, Andreas H.

AU - Williams, Reed

AU - Dunnington, Gary

PY - 2010/10

Y1 - 2010/10

N2 - Background: The American College of Surgeons and Association of Program Directors in Surgery Phase 1 curriculum involves basic surgical skills instructional modules and Verification of Proficiency. This article is a study and revision of beta versions of the Verification of Proficiency instruments. Methods: Postgraduate year 1 residents were tested on 11 skills after undergoing lab instruction and practice. Deidentified videotaped performances were scored and data were analyzed to identify correlations between individual checklist items and failure. Results: In all, 23 residents underwent Verification of Proficiency over 2 years; 8 (35%) passed all Verification of Proficiency examinations at the first attempt, 15 (65%) failed at least 1 module, and 11 (48%) failed at least 2 modules. Residents who failed to demonstrate proficiency underwent mandatory remediation and retested until their scores were considered proficient. Scrutiny of the results revealed checklist items that were predictive independently of overall failure. The pass rate was significantly greater in 2009 compared with 2008 after the introduction of rater training and consequences for failure. Conclusion: Verification of Proficiency provides a framework to evaluate learner progress toward skills proficiency. That we achieved 100% faculty compliance with more than 250 performances speaks to the feasibility of Verification of Proficiency. This approach should facilitate a more widespread Verification of Proficiency acceptance as a step closer to developing a final proficiency examination for basic surgical skills in postgraduate year 1 residents.

AB - Background: The American College of Surgeons and Association of Program Directors in Surgery Phase 1 curriculum involves basic surgical skills instructional modules and Verification of Proficiency. This article is a study and revision of beta versions of the Verification of Proficiency instruments. Methods: Postgraduate year 1 residents were tested on 11 skills after undergoing lab instruction and practice. Deidentified videotaped performances were scored and data were analyzed to identify correlations between individual checklist items and failure. Results: In all, 23 residents underwent Verification of Proficiency over 2 years; 8 (35%) passed all Verification of Proficiency examinations at the first attempt, 15 (65%) failed at least 1 module, and 11 (48%) failed at least 2 modules. Residents who failed to demonstrate proficiency underwent mandatory remediation and retested until their scores were considered proficient. Scrutiny of the results revealed checklist items that were predictive independently of overall failure. The pass rate was significantly greater in 2009 compared with 2008 after the introduction of rater training and consequences for failure. Conclusion: Verification of Proficiency provides a framework to evaluate learner progress toward skills proficiency. That we achieved 100% faculty compliance with more than 250 performances speaks to the feasibility of Verification of Proficiency. This approach should facilitate a more widespread Verification of Proficiency acceptance as a step closer to developing a final proficiency examination for basic surgical skills in postgraduate year 1 residents.

UR - http://www.scopus.com/inward/record.url?scp=77956652229&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77956652229&partnerID=8YFLogxK

U2 - 10.1016/j.surg.2010.07.018

DO - 10.1016/j.surg.2010.07.018

M3 - Article

VL - 148

SP - 759

EP - 767

JO - Surgery

JF - Surgery

SN - 0039-6060

IS - 4

ER -