Facilitated versus self-guided training of non-ophthalmologists for grading pre-plus and plus disease using fundus images for retinopathy of prematurity screening

Nikolas N. Raufi, Caleb K. Morris, Sharon F. Freedman, David K. Wallace, S. Grace Prakalapakorn

Research output: Contribution to journalArticle

Abstract

Purpose: Retinopathy of prematurity (ROP) is an important cause of preventable blindness; barriers to screening necessitate novel approaches. Although trained non-ophthalmologists can accurately grade retinal images for ROP, effective training protocols are not established. This study compares the effectiveness of facilitated versus self-guided training of non-ophthalmologists for grading retinal images for pre-plus or plus disease in ROP. Methods: Forty-eight undergraduate and graduate students were trained to grade retinal images for the presence of pre-plus or plus disease. Students were randomly assigned to one of two training protocols. Both used identical electronic slideshows: one was guided by an in-person facilitator and the other was self-guided. After completing their respective training, students proficient in grading pre-plus and plus disease graded images in a telemedicine screening scenario. Accuracy of grading was compared to the reference standard of clinical examination. Results: Eighty-three percent (40 of 48) of trained students (91% in the facilitated vs 77% in the self-guided group, P = .26) were proficient and qualified to grade the ROP telemedicine screening scenario. Median accuracy for grading normal, pre-plus, or plus disease was 69% (70% in the facilitated vs 68% in the self-guided group, P = .91). When considering the designation of pre-plus or plus disease by graders as a screening test for detecting plus disease (confirmed on clinical examination), the median sensitivity and specificity of all students were 95% and 64%, respectively. Conclusions: Both facilitated and self-guided teaching protocols yielded similar performance in ROP image grading for pre-plus or plus disease. Self-guided training protocols may be adequate to train non-ophthalmologists to grade retinal images for pre-plus and plus disease with high sensitivity.

Original languageEnglish (US)
Pages (from-to)179-185
Number of pages7
JournalJournal of Pediatric Ophthalmology and Strabismus
Volume53
Issue number3
DOIs
StatePublished - Jan 1 2016
Externally publishedYes

Fingerprint

Retinopathy of Prematurity
Students
Telemedicine
Blindness
Teaching
Sensitivity and Specificity

ASJC Scopus subject areas

  • Pediatrics, Perinatology, and Child Health
  • Ophthalmology

Cite this

Facilitated versus self-guided training of non-ophthalmologists for grading pre-plus and plus disease using fundus images for retinopathy of prematurity screening. / Raufi, Nikolas N.; Morris, Caleb K.; Freedman, Sharon F.; Wallace, David K.; Grace Prakalapakorn, S.

In: Journal of Pediatric Ophthalmology and Strabismus, Vol. 53, No. 3, 01.01.2016, p. 179-185.

Research output: Contribution to journalArticle

@article{61c01a6b55954eae9d5d9bc23773ce8f,
title = "Facilitated versus self-guided training of non-ophthalmologists for grading pre-plus and plus disease using fundus images for retinopathy of prematurity screening",
abstract = "Purpose: Retinopathy of prematurity (ROP) is an important cause of preventable blindness; barriers to screening necessitate novel approaches. Although trained non-ophthalmologists can accurately grade retinal images for ROP, effective training protocols are not established. This study compares the effectiveness of facilitated versus self-guided training of non-ophthalmologists for grading retinal images for pre-plus or plus disease in ROP. Methods: Forty-eight undergraduate and graduate students were trained to grade retinal images for the presence of pre-plus or plus disease. Students were randomly assigned to one of two training protocols. Both used identical electronic slideshows: one was guided by an in-person facilitator and the other was self-guided. After completing their respective training, students proficient in grading pre-plus and plus disease graded images in a telemedicine screening scenario. Accuracy of grading was compared to the reference standard of clinical examination. Results: Eighty-three percent (40 of 48) of trained students (91{\%} in the facilitated vs 77{\%} in the self-guided group, P = .26) were proficient and qualified to grade the ROP telemedicine screening scenario. Median accuracy for grading normal, pre-plus, or plus disease was 69{\%} (70{\%} in the facilitated vs 68{\%} in the self-guided group, P = .91). When considering the designation of pre-plus or plus disease by graders as a screening test for detecting plus disease (confirmed on clinical examination), the median sensitivity and specificity of all students were 95{\%} and 64{\%}, respectively. Conclusions: Both facilitated and self-guided teaching protocols yielded similar performance in ROP image grading for pre-plus or plus disease. Self-guided training protocols may be adequate to train non-ophthalmologists to grade retinal images for pre-plus and plus disease with high sensitivity.",
author = "Raufi, {Nikolas N.} and Morris, {Caleb K.} and Freedman, {Sharon F.} and Wallace, {David K.} and {Grace Prakalapakorn}, S.",
year = "2016",
month = "1",
day = "1",
doi = "10.3928/01913913-20160314-01",
language = "English (US)",
volume = "53",
pages = "179--185",
journal = "Journal of Pediatric Ophthalmology and Strabismus",
issn = "0191-3913",
publisher = "Slack Incorporated",
number = "3",

}

TY - JOUR

T1 - Facilitated versus self-guided training of non-ophthalmologists for grading pre-plus and plus disease using fundus images for retinopathy of prematurity screening

AU - Raufi, Nikolas N.

AU - Morris, Caleb K.

AU - Freedman, Sharon F.

AU - Wallace, David K.

AU - Grace Prakalapakorn, S.

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Purpose: Retinopathy of prematurity (ROP) is an important cause of preventable blindness; barriers to screening necessitate novel approaches. Although trained non-ophthalmologists can accurately grade retinal images for ROP, effective training protocols are not established. This study compares the effectiveness of facilitated versus self-guided training of non-ophthalmologists for grading retinal images for pre-plus or plus disease in ROP. Methods: Forty-eight undergraduate and graduate students were trained to grade retinal images for the presence of pre-plus or plus disease. Students were randomly assigned to one of two training protocols. Both used identical electronic slideshows: one was guided by an in-person facilitator and the other was self-guided. After completing their respective training, students proficient in grading pre-plus and plus disease graded images in a telemedicine screening scenario. Accuracy of grading was compared to the reference standard of clinical examination. Results: Eighty-three percent (40 of 48) of trained students (91% in the facilitated vs 77% in the self-guided group, P = .26) were proficient and qualified to grade the ROP telemedicine screening scenario. Median accuracy for grading normal, pre-plus, or plus disease was 69% (70% in the facilitated vs 68% in the self-guided group, P = .91). When considering the designation of pre-plus or plus disease by graders as a screening test for detecting plus disease (confirmed on clinical examination), the median sensitivity and specificity of all students were 95% and 64%, respectively. Conclusions: Both facilitated and self-guided teaching protocols yielded similar performance in ROP image grading for pre-plus or plus disease. Self-guided training protocols may be adequate to train non-ophthalmologists to grade retinal images for pre-plus and plus disease with high sensitivity.

AB - Purpose: Retinopathy of prematurity (ROP) is an important cause of preventable blindness; barriers to screening necessitate novel approaches. Although trained non-ophthalmologists can accurately grade retinal images for ROP, effective training protocols are not established. This study compares the effectiveness of facilitated versus self-guided training of non-ophthalmologists for grading retinal images for pre-plus or plus disease in ROP. Methods: Forty-eight undergraduate and graduate students were trained to grade retinal images for the presence of pre-plus or plus disease. Students were randomly assigned to one of two training protocols. Both used identical electronic slideshows: one was guided by an in-person facilitator and the other was self-guided. After completing their respective training, students proficient in grading pre-plus and plus disease graded images in a telemedicine screening scenario. Accuracy of grading was compared to the reference standard of clinical examination. Results: Eighty-three percent (40 of 48) of trained students (91% in the facilitated vs 77% in the self-guided group, P = .26) were proficient and qualified to grade the ROP telemedicine screening scenario. Median accuracy for grading normal, pre-plus, or plus disease was 69% (70% in the facilitated vs 68% in the self-guided group, P = .91). When considering the designation of pre-plus or plus disease by graders as a screening test for detecting plus disease (confirmed on clinical examination), the median sensitivity and specificity of all students were 95% and 64%, respectively. Conclusions: Both facilitated and self-guided teaching protocols yielded similar performance in ROP image grading for pre-plus or plus disease. Self-guided training protocols may be adequate to train non-ophthalmologists to grade retinal images for pre-plus and plus disease with high sensitivity.

UR - http://www.scopus.com/inward/record.url?scp=84971673874&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84971673874&partnerID=8YFLogxK

U2 - 10.3928/01913913-20160314-01

DO - 10.3928/01913913-20160314-01

M3 - Article

VL - 53

SP - 179

EP - 185

JO - Journal of Pediatric Ophthalmology and Strabismus

JF - Journal of Pediatric Ophthalmology and Strabismus

SN - 0191-3913

IS - 3

ER -