Multicenter validation of a customizable scoring tool for selection of trainees for a residency or fellowship program the EAST-IST study

Gabriel Bosslet, William Carlos, David J. Tybor, Jennifer McCallister, Candace Huebert, Ashley Henderson, Matthew C. Miles, Homer Twigg, Catherine Sears, Cynthia Brown, Mark O. Farber, Tim Lahm, John D. Buckley

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Rationale: Few data have been published regarding scoring tools for selection of postgraduate medical trainee candidates that have wide applicability. Objectives: The authors present a novel scoring tool developed to assist postgraduate programs in generating an institution-specific rank list derived from selected elements of the U.S. Electronic Residency Application System (ERAS) application. Methods: The authors developed and validated an ERAS and interview day scoring tool at five pulmonary and critical care fellowship programs: The ERAS Application Scoring Tool-Interview Scoring Tool. This scoring tool was then tested for intrarater correlation versus subjective rankings of ERAS applications. The process for development of the tool was performed at four other institutions, and it was performed alongside and compared with the "traditional" ranking methods at the five programs and compared with the submitted National Residency Match Program rank list. Results: The ERAS Application Scoring Tool correlated highly with subjective faculty rankings at the primary institution (average Spearman's r = 0.77). The ERAS Application Scoring Tool-Interview Scoring Tool method correlated well with traditional ranking methodology at all five institutions (Spearman's r = 0.54, 0.65, 0.72, 0.77, and 0.84). Conclusions: This study validates a process for selecting and weighting components of the ERAS application and interview day to create a customizable, institution-specific tool for ranking candidates to postgraduate medical education programs. This scoring system can be used in future studies to compare the outcomes of fellowship training.

Original languageEnglish (US)
Pages (from-to)517-523
Number of pages7
JournalAnnals of the American Thoracic Society
Volume14
Issue number4
DOIs
StatePublished - Apr 1 2017

Fingerprint

Internship and Residency
Interviews
Critical Care
Medical Education
Research Design
Lung

Keywords

  • Education
  • Internship and residency
  • Job application

ASJC Scopus subject areas

  • Medicine(all)
  • Pulmonary and Respiratory Medicine

Cite this

Multicenter validation of a customizable scoring tool for selection of trainees for a residency or fellowship program the EAST-IST study. / Bosslet, Gabriel; Carlos, William; Tybor, David J.; McCallister, Jennifer; Huebert, Candace; Henderson, Ashley; Miles, Matthew C.; Twigg, Homer; Sears, Catherine; Brown, Cynthia; Farber, Mark O.; Lahm, Tim; Buckley, John D.

In: Annals of the American Thoracic Society, Vol. 14, No. 4, 01.04.2017, p. 517-523.

Research output: Contribution to journalArticle

Bosslet, Gabriel ; Carlos, William ; Tybor, David J. ; McCallister, Jennifer ; Huebert, Candace ; Henderson, Ashley ; Miles, Matthew C. ; Twigg, Homer ; Sears, Catherine ; Brown, Cynthia ; Farber, Mark O. ; Lahm, Tim ; Buckley, John D. / Multicenter validation of a customizable scoring tool for selection of trainees for a residency or fellowship program the EAST-IST study. In: Annals of the American Thoracic Society. 2017 ; Vol. 14, No. 4. pp. 517-523.
@article{e32a8489b2a5448d93d3c86fbd6cc1fa,
title = "Multicenter validation of a customizable scoring tool for selection of trainees for a residency or fellowship program the EAST-IST study",
abstract = "Rationale: Few data have been published regarding scoring tools for selection of postgraduate medical trainee candidates that have wide applicability. Objectives: The authors present a novel scoring tool developed to assist postgraduate programs in generating an institution-specific rank list derived from selected elements of the U.S. Electronic Residency Application System (ERAS) application. Methods: The authors developed and validated an ERAS and interview day scoring tool at five pulmonary and critical care fellowship programs: The ERAS Application Scoring Tool-Interview Scoring Tool. This scoring tool was then tested for intrarater correlation versus subjective rankings of ERAS applications. The process for development of the tool was performed at four other institutions, and it was performed alongside and compared with the {"}traditional{"} ranking methods at the five programs and compared with the submitted National Residency Match Program rank list. Results: The ERAS Application Scoring Tool correlated highly with subjective faculty rankings at the primary institution (average Spearman's r = 0.77). The ERAS Application Scoring Tool-Interview Scoring Tool method correlated well with traditional ranking methodology at all five institutions (Spearman's r = 0.54, 0.65, 0.72, 0.77, and 0.84). Conclusions: This study validates a process for selecting and weighting components of the ERAS application and interview day to create a customizable, institution-specific tool for ranking candidates to postgraduate medical education programs. This scoring system can be used in future studies to compare the outcomes of fellowship training.",
keywords = "Education, Internship and residency, Job application",
author = "Gabriel Bosslet and William Carlos and Tybor, {David J.} and Jennifer McCallister and Candace Huebert and Ashley Henderson and Miles, {Matthew C.} and Homer Twigg and Catherine Sears and Cynthia Brown and Farber, {Mark O.} and Tim Lahm and Buckley, {John D.}",
year = "2017",
month = "4",
day = "1",
doi = "10.1513/AnnalsATS.201611-938OC",
language = "English (US)",
volume = "14",
pages = "517--523",
journal = "Annals of the American Thoracic Society",
issn = "2325-6621",
publisher = "American Thoracic Society",
number = "4",

}

TY - JOUR

T1 - Multicenter validation of a customizable scoring tool for selection of trainees for a residency or fellowship program the EAST-IST study

AU - Bosslet, Gabriel

AU - Carlos, William

AU - Tybor, David J.

AU - McCallister, Jennifer

AU - Huebert, Candace

AU - Henderson, Ashley

AU - Miles, Matthew C.

AU - Twigg, Homer

AU - Sears, Catherine

AU - Brown, Cynthia

AU - Farber, Mark O.

AU - Lahm, Tim

AU - Buckley, John D.

PY - 2017/4/1

Y1 - 2017/4/1

N2 - Rationale: Few data have been published regarding scoring tools for selection of postgraduate medical trainee candidates that have wide applicability. Objectives: The authors present a novel scoring tool developed to assist postgraduate programs in generating an institution-specific rank list derived from selected elements of the U.S. Electronic Residency Application System (ERAS) application. Methods: The authors developed and validated an ERAS and interview day scoring tool at five pulmonary and critical care fellowship programs: The ERAS Application Scoring Tool-Interview Scoring Tool. This scoring tool was then tested for intrarater correlation versus subjective rankings of ERAS applications. The process for development of the tool was performed at four other institutions, and it was performed alongside and compared with the "traditional" ranking methods at the five programs and compared with the submitted National Residency Match Program rank list. Results: The ERAS Application Scoring Tool correlated highly with subjective faculty rankings at the primary institution (average Spearman's r = 0.77). The ERAS Application Scoring Tool-Interview Scoring Tool method correlated well with traditional ranking methodology at all five institutions (Spearman's r = 0.54, 0.65, 0.72, 0.77, and 0.84). Conclusions: This study validates a process for selecting and weighting components of the ERAS application and interview day to create a customizable, institution-specific tool for ranking candidates to postgraduate medical education programs. This scoring system can be used in future studies to compare the outcomes of fellowship training.

AB - Rationale: Few data have been published regarding scoring tools for selection of postgraduate medical trainee candidates that have wide applicability. Objectives: The authors present a novel scoring tool developed to assist postgraduate programs in generating an institution-specific rank list derived from selected elements of the U.S. Electronic Residency Application System (ERAS) application. Methods: The authors developed and validated an ERAS and interview day scoring tool at five pulmonary and critical care fellowship programs: The ERAS Application Scoring Tool-Interview Scoring Tool. This scoring tool was then tested for intrarater correlation versus subjective rankings of ERAS applications. The process for development of the tool was performed at four other institutions, and it was performed alongside and compared with the "traditional" ranking methods at the five programs and compared with the submitted National Residency Match Program rank list. Results: The ERAS Application Scoring Tool correlated highly with subjective faculty rankings at the primary institution (average Spearman's r = 0.77). The ERAS Application Scoring Tool-Interview Scoring Tool method correlated well with traditional ranking methodology at all five institutions (Spearman's r = 0.54, 0.65, 0.72, 0.77, and 0.84). Conclusions: This study validates a process for selecting and weighting components of the ERAS application and interview day to create a customizable, institution-specific tool for ranking candidates to postgraduate medical education programs. This scoring system can be used in future studies to compare the outcomes of fellowship training.

KW - Education

KW - Internship and residency

KW - Job application

UR - http://www.scopus.com/inward/record.url?scp=85017276275&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017276275&partnerID=8YFLogxK

U2 - 10.1513/AnnalsATS.201611-938OC

DO - 10.1513/AnnalsATS.201611-938OC

M3 - Article

C2 - 28362524

AN - SCOPUS:85017276275

VL - 14

SP - 517

EP - 523

JO - Annals of the American Thoracic Society

JF - Annals of the American Thoracic Society

SN - 2325-6621

IS - 4

ER -