A multicenter analysis of the ophthalmic knowledge assessment program and American board of ophthalmology written qualifying examination performance

Andrew G. Lee, Thomas A. Oetting, Preston H. Blomquist, Geoffrey Bradford, Susan M. Culican, Carolyn Kloek, Chandrasekharan Krishnan, Andreas K. Lauer, Leah Levi, Ayman Naseri, Steven E. Rubin, Ingrid U. Scott, Jeremiah Tao, Sonal Tuli, Martha M. Wright, Darrell WuDunn, M. Bridget Zimmerman

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Objective: To compare the performance on the American Board of Ophthalmology Written Qualifying Examination (WQE) with the performance on step 1 of the United States Medical Licensing Examination (USMLE) and the Ophthalmic Knowledge Assessment Program (OKAP) examination for residents in multiple residency programs. Design: Comparative case series. Participants: Fifteen residency programs with 339 total residents participated in this study. The data were extracted from the 5-year American Board of Ophthalmology report to each participating program in 2009 and included residency graduating classes from 2003 through 2007. Residents were included if data were available for the USMLE, OKAP examination in ophthalmology years 1 through 3, and the WQE score. Residents were excluded if one or more of the test scores were not available. Methods: Two-sample t tests, logistic regression analysis, and receiver operating characteristic (ROC) curves were used to examine the association of the various tests (USMLE, OKAP examination year 1, OKAP examination year 2, OKAP examination year 3, and maximum OKAP examination score) as a predictor for a passing or failing grade on the WQE. Main Outcome Measures: The primary outcome measure of this study was first time pass rate for the WQE. Results: Using ROC analysis, the OKAP examination taken at the third year of ophthalmology residency best predicted performance on the WQE. For the OKAP examination taken during the third year of residency, the probability of passing the WQE was at least 80% for a score of 35 or higher and at least 95% for a score of 72 or higher. Conclusions: The OKAP examination, especially in the third year of residency, can be useful to residents to predict the likelihood of success on the high-stakes WQE examination. Financial Disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article.

Original languageEnglish
Pages (from-to)1949-1953
Number of pages5
JournalOphthalmology
Volume119
Issue number10
DOIs
StatePublished - Oct 2012

Fingerprint

Ophthalmology
Internship and Residency
Licensure
Outcome Assessment (Health Care)
ROC Curve
Disclosure
Logistic Models
Regression Analysis

ASJC Scopus subject areas

  • Ophthalmology

Cite this

Lee, A. G., Oetting, T. A., Blomquist, P. H., Bradford, G., Culican, S. M., Kloek, C., ... Zimmerman, M. B. (2012). A multicenter analysis of the ophthalmic knowledge assessment program and American board of ophthalmology written qualifying examination performance. Ophthalmology, 119(10), 1949-1953. https://doi.org/10.1016/j.ophtha.2012.06.010

A multicenter analysis of the ophthalmic knowledge assessment program and American board of ophthalmology written qualifying examination performance. / Lee, Andrew G.; Oetting, Thomas A.; Blomquist, Preston H.; Bradford, Geoffrey; Culican, Susan M.; Kloek, Carolyn; Krishnan, Chandrasekharan; Lauer, Andreas K.; Levi, Leah; Naseri, Ayman; Rubin, Steven E.; Scott, Ingrid U.; Tao, Jeremiah; Tuli, Sonal; Wright, Martha M.; WuDunn, Darrell; Zimmerman, M. Bridget.

In: Ophthalmology, Vol. 119, No. 10, 10.2012, p. 1949-1953.

Research output: Contribution to journalArticle

Lee, AG, Oetting, TA, Blomquist, PH, Bradford, G, Culican, SM, Kloek, C, Krishnan, C, Lauer, AK, Levi, L, Naseri, A, Rubin, SE, Scott, IU, Tao, J, Tuli, S, Wright, MM, WuDunn, D & Zimmerman, MB 2012, 'A multicenter analysis of the ophthalmic knowledge assessment program and American board of ophthalmology written qualifying examination performance', Ophthalmology, vol. 119, no. 10, pp. 1949-1953. https://doi.org/10.1016/j.ophtha.2012.06.010
Lee, Andrew G. ; Oetting, Thomas A. ; Blomquist, Preston H. ; Bradford, Geoffrey ; Culican, Susan M. ; Kloek, Carolyn ; Krishnan, Chandrasekharan ; Lauer, Andreas K. ; Levi, Leah ; Naseri, Ayman ; Rubin, Steven E. ; Scott, Ingrid U. ; Tao, Jeremiah ; Tuli, Sonal ; Wright, Martha M. ; WuDunn, Darrell ; Zimmerman, M. Bridget. / A multicenter analysis of the ophthalmic knowledge assessment program and American board of ophthalmology written qualifying examination performance. In: Ophthalmology. 2012 ; Vol. 119, No. 10. pp. 1949-1953.
@article{013dca7308944ab9b35079990d666ad3,
title = "A multicenter analysis of the ophthalmic knowledge assessment program and American board of ophthalmology written qualifying examination performance",
abstract = "Objective: To compare the performance on the American Board of Ophthalmology Written Qualifying Examination (WQE) with the performance on step 1 of the United States Medical Licensing Examination (USMLE) and the Ophthalmic Knowledge Assessment Program (OKAP) examination for residents in multiple residency programs. Design: Comparative case series. Participants: Fifteen residency programs with 339 total residents participated in this study. The data were extracted from the 5-year American Board of Ophthalmology report to each participating program in 2009 and included residency graduating classes from 2003 through 2007. Residents were included if data were available for the USMLE, OKAP examination in ophthalmology years 1 through 3, and the WQE score. Residents were excluded if one or more of the test scores were not available. Methods: Two-sample t tests, logistic regression analysis, and receiver operating characteristic (ROC) curves were used to examine the association of the various tests (USMLE, OKAP examination year 1, OKAP examination year 2, OKAP examination year 3, and maximum OKAP examination score) as a predictor for a passing or failing grade on the WQE. Main Outcome Measures: The primary outcome measure of this study was first time pass rate for the WQE. Results: Using ROC analysis, the OKAP examination taken at the third year of ophthalmology residency best predicted performance on the WQE. For the OKAP examination taken during the third year of residency, the probability of passing the WQE was at least 80{\%} for a score of 35 or higher and at least 95{\%} for a score of 72 or higher. Conclusions: The OKAP examination, especially in the third year of residency, can be useful to residents to predict the likelihood of success on the high-stakes WQE examination. Financial Disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article.",
author = "Lee, {Andrew G.} and Oetting, {Thomas A.} and Blomquist, {Preston H.} and Geoffrey Bradford and Culican, {Susan M.} and Carolyn Kloek and Chandrasekharan Krishnan and Lauer, {Andreas K.} and Leah Levi and Ayman Naseri and Rubin, {Steven E.} and Scott, {Ingrid U.} and Jeremiah Tao and Sonal Tuli and Wright, {Martha M.} and Darrell WuDunn and Zimmerman, {M. Bridget}",
year = "2012",
month = "10",
doi = "10.1016/j.ophtha.2012.06.010",
language = "English",
volume = "119",
pages = "1949--1953",
journal = "Ophthalmology",
issn = "0161-6420",
publisher = "Elsevier Inc.",
number = "10",

}

TY - JOUR

T1 - A multicenter analysis of the ophthalmic knowledge assessment program and American board of ophthalmology written qualifying examination performance

AU - Lee, Andrew G.

AU - Oetting, Thomas A.

AU - Blomquist, Preston H.

AU - Bradford, Geoffrey

AU - Culican, Susan M.

AU - Kloek, Carolyn

AU - Krishnan, Chandrasekharan

AU - Lauer, Andreas K.

AU - Levi, Leah

AU - Naseri, Ayman

AU - Rubin, Steven E.

AU - Scott, Ingrid U.

AU - Tao, Jeremiah

AU - Tuli, Sonal

AU - Wright, Martha M.

AU - WuDunn, Darrell

AU - Zimmerman, M. Bridget

PY - 2012/10

Y1 - 2012/10

N2 - Objective: To compare the performance on the American Board of Ophthalmology Written Qualifying Examination (WQE) with the performance on step 1 of the United States Medical Licensing Examination (USMLE) and the Ophthalmic Knowledge Assessment Program (OKAP) examination for residents in multiple residency programs. Design: Comparative case series. Participants: Fifteen residency programs with 339 total residents participated in this study. The data were extracted from the 5-year American Board of Ophthalmology report to each participating program in 2009 and included residency graduating classes from 2003 through 2007. Residents were included if data were available for the USMLE, OKAP examination in ophthalmology years 1 through 3, and the WQE score. Residents were excluded if one or more of the test scores were not available. Methods: Two-sample t tests, logistic regression analysis, and receiver operating characteristic (ROC) curves were used to examine the association of the various tests (USMLE, OKAP examination year 1, OKAP examination year 2, OKAP examination year 3, and maximum OKAP examination score) as a predictor for a passing or failing grade on the WQE. Main Outcome Measures: The primary outcome measure of this study was first time pass rate for the WQE. Results: Using ROC analysis, the OKAP examination taken at the third year of ophthalmology residency best predicted performance on the WQE. For the OKAP examination taken during the third year of residency, the probability of passing the WQE was at least 80% for a score of 35 or higher and at least 95% for a score of 72 or higher. Conclusions: The OKAP examination, especially in the third year of residency, can be useful to residents to predict the likelihood of success on the high-stakes WQE examination. Financial Disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article.

AB - Objective: To compare the performance on the American Board of Ophthalmology Written Qualifying Examination (WQE) with the performance on step 1 of the United States Medical Licensing Examination (USMLE) and the Ophthalmic Knowledge Assessment Program (OKAP) examination for residents in multiple residency programs. Design: Comparative case series. Participants: Fifteen residency programs with 339 total residents participated in this study. The data were extracted from the 5-year American Board of Ophthalmology report to each participating program in 2009 and included residency graduating classes from 2003 through 2007. Residents were included if data were available for the USMLE, OKAP examination in ophthalmology years 1 through 3, and the WQE score. Residents were excluded if one or more of the test scores were not available. Methods: Two-sample t tests, logistic regression analysis, and receiver operating characteristic (ROC) curves were used to examine the association of the various tests (USMLE, OKAP examination year 1, OKAP examination year 2, OKAP examination year 3, and maximum OKAP examination score) as a predictor for a passing or failing grade on the WQE. Main Outcome Measures: The primary outcome measure of this study was first time pass rate for the WQE. Results: Using ROC analysis, the OKAP examination taken at the third year of ophthalmology residency best predicted performance on the WQE. For the OKAP examination taken during the third year of residency, the probability of passing the WQE was at least 80% for a score of 35 or higher and at least 95% for a score of 72 or higher. Conclusions: The OKAP examination, especially in the third year of residency, can be useful to residents to predict the likelihood of success on the high-stakes WQE examination. Financial Disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article.

UR - http://www.scopus.com/inward/record.url?scp=84867093947&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867093947&partnerID=8YFLogxK

U2 - 10.1016/j.ophtha.2012.06.010

DO - 10.1016/j.ophtha.2012.06.010

M3 - Article

VL - 119

SP - 1949

EP - 1953

JO - Ophthalmology

JF - Ophthalmology

SN - 0161-6420

IS - 10

ER -