Augmented visual instruction for surgical practice and training

Daniel Andersen, Chengyuan Lin, Voicu Popescu, Edgar Rojas Munoz, Maria Eugenia Cabrera, Brian Mullis, Ben Zarzaur, Sherri Marley, Juan Wachs

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents two positions about the use of augmented reality (AR) in healthcare scenarios, informed by the authors' experience as an interdisciplinary team of academics and medical practicioners who have been researching, implementing, and validating an AR surgical telementoring system. First, AR has the potential to greatly improve the areas of surgical telementoring and of medical training on patient simulators. In austere environments, surgical telementoring that connects surgeons with remote experts can be enhanced with the use of AR annotations visualized directly in the surgeon's field of view. Patient simulators can gain additional value for medical training by overlaying the current and future steps of procedures as AR imagery onto a physical simulator. Second, AR annotations for telementoring and for simulator-based training can be delivered either by video see-through tablet displays or by AR head-mounted displays (HMDs). The paper discusses the two AR approaches by looking at accuracy, depth perception, visualization continuity, visualization latency, and user encumbrance. Specific advantages and disadvantages to each approach mean that the choice of one display method or another must be carefully tailored to the healthcare application in which it is being used.

Original languageEnglish (US)
Title of host publication2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538659779
DOIs
StatePublished - Dec 13 2018
Externally publishedYes
Event2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018 - Reutlingen, Germany
Duration: Mar 18 2018 → …

Other

Other2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018
CountryGermany
CityReutlingen
Period3/18/18 → …

Fingerprint

visual instruction
Augmented reality
Simulators
Display devices
visualization
Visualization
Depth perception
continuity
video
expert
scenario

Keywords

  • Applied computing - Health care information systems
  • Human-centered computing - Mixed / augmented reality

ASJC Scopus subject areas

  • Media Technology
  • Education

Cite this

Andersen, D., Lin, C., Popescu, V., Munoz, E. R., Eugenia Cabrera, M., Mullis, B., ... Wachs, J. (2018). Augmented visual instruction for surgical practice and training. In 2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018 [8576884] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VAR4GOOD.2018.8576884

Augmented visual instruction for surgical practice and training. / Andersen, Daniel; Lin, Chengyuan; Popescu, Voicu; Munoz, Edgar Rojas; Eugenia Cabrera, Maria; Mullis, Brian; Zarzaur, Ben; Marley, Sherri; Wachs, Juan.

2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018. Institute of Electrical and Electronics Engineers Inc., 2018. 8576884.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Andersen, D, Lin, C, Popescu, V, Munoz, ER, Eugenia Cabrera, M, Mullis, B, Zarzaur, B, Marley, S & Wachs, J 2018, Augmented visual instruction for surgical practice and training. in 2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018., 8576884, Institute of Electrical and Electronics Engineers Inc., 2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018, Reutlingen, Germany, 3/18/18. https://doi.org/10.1109/VAR4GOOD.2018.8576884
Andersen D, Lin C, Popescu V, Munoz ER, Eugenia Cabrera M, Mullis B et al. Augmented visual instruction for surgical practice and training. In 2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018. Institute of Electrical and Electronics Engineers Inc. 2018. 8576884 https://doi.org/10.1109/VAR4GOOD.2018.8576884
Andersen, Daniel ; Lin, Chengyuan ; Popescu, Voicu ; Munoz, Edgar Rojas ; Eugenia Cabrera, Maria ; Mullis, Brian ; Zarzaur, Ben ; Marley, Sherri ; Wachs, Juan. / Augmented visual instruction for surgical practice and training. 2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018. Institute of Electrical and Electronics Engineers Inc., 2018.
@inproceedings{d3aaee6fc1284832b8503a6da674b350,
title = "Augmented visual instruction for surgical practice and training",
abstract = "This paper presents two positions about the use of augmented reality (AR) in healthcare scenarios, informed by the authors' experience as an interdisciplinary team of academics and medical practicioners who have been researching, implementing, and validating an AR surgical telementoring system. First, AR has the potential to greatly improve the areas of surgical telementoring and of medical training on patient simulators. In austere environments, surgical telementoring that connects surgeons with remote experts can be enhanced with the use of AR annotations visualized directly in the surgeon's field of view. Patient simulators can gain additional value for medical training by overlaying the current and future steps of procedures as AR imagery onto a physical simulator. Second, AR annotations for telementoring and for simulator-based training can be delivered either by video see-through tablet displays or by AR head-mounted displays (HMDs). The paper discusses the two AR approaches by looking at accuracy, depth perception, visualization continuity, visualization latency, and user encumbrance. Specific advantages and disadvantages to each approach mean that the choice of one display method or another must be carefully tailored to the healthcare application in which it is being used.",
keywords = "Applied computing - Health care information systems, Human-centered computing - Mixed / augmented reality",
author = "Daniel Andersen and Chengyuan Lin and Voicu Popescu and Munoz, {Edgar Rojas} and {Eugenia Cabrera}, Maria and Brian Mullis and Ben Zarzaur and Sherri Marley and Juan Wachs",
year = "2018",
month = "12",
day = "13",
doi = "10.1109/VAR4GOOD.2018.8576884",
language = "English (US)",
booktitle = "2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Augmented visual instruction for surgical practice and training

AU - Andersen, Daniel

AU - Lin, Chengyuan

AU - Popescu, Voicu

AU - Munoz, Edgar Rojas

AU - Eugenia Cabrera, Maria

AU - Mullis, Brian

AU - Zarzaur, Ben

AU - Marley, Sherri

AU - Wachs, Juan

PY - 2018/12/13

Y1 - 2018/12/13

N2 - This paper presents two positions about the use of augmented reality (AR) in healthcare scenarios, informed by the authors' experience as an interdisciplinary team of academics and medical practicioners who have been researching, implementing, and validating an AR surgical telementoring system. First, AR has the potential to greatly improve the areas of surgical telementoring and of medical training on patient simulators. In austere environments, surgical telementoring that connects surgeons with remote experts can be enhanced with the use of AR annotations visualized directly in the surgeon's field of view. Patient simulators can gain additional value for medical training by overlaying the current and future steps of procedures as AR imagery onto a physical simulator. Second, AR annotations for telementoring and for simulator-based training can be delivered either by video see-through tablet displays or by AR head-mounted displays (HMDs). The paper discusses the two AR approaches by looking at accuracy, depth perception, visualization continuity, visualization latency, and user encumbrance. Specific advantages and disadvantages to each approach mean that the choice of one display method or another must be carefully tailored to the healthcare application in which it is being used.

AB - This paper presents two positions about the use of augmented reality (AR) in healthcare scenarios, informed by the authors' experience as an interdisciplinary team of academics and medical practicioners who have been researching, implementing, and validating an AR surgical telementoring system. First, AR has the potential to greatly improve the areas of surgical telementoring and of medical training on patient simulators. In austere environments, surgical telementoring that connects surgeons with remote experts can be enhanced with the use of AR annotations visualized directly in the surgeon's field of view. Patient simulators can gain additional value for medical training by overlaying the current and future steps of procedures as AR imagery onto a physical simulator. Second, AR annotations for telementoring and for simulator-based training can be delivered either by video see-through tablet displays or by AR head-mounted displays (HMDs). The paper discusses the two AR approaches by looking at accuracy, depth perception, visualization continuity, visualization latency, and user encumbrance. Specific advantages and disadvantages to each approach mean that the choice of one display method or another must be carefully tailored to the healthcare application in which it is being used.

KW - Applied computing - Health care information systems

KW - Human-centered computing - Mixed / augmented reality

UR - http://www.scopus.com/inward/record.url?scp=85060488180&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060488180&partnerID=8YFLogxK

U2 - 10.1109/VAR4GOOD.2018.8576884

DO - 10.1109/VAR4GOOD.2018.8576884

M3 - Conference contribution

BT - 2018 IEEE Workshop on Augmented and Virtual Realities for Good, VAR4Good 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -