Avoiding focus shifts in surgical telementoring using an augmented reality transparent display

Daniel Andersen, Voicu Popescu, Maria Eugenia Cabrera, Aditya Shanghavi, Gerardo Gomez, Sherri Marley, Brian Mullis, Juan Wachs

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.

Original languageEnglish (US)
Title of host publicationStudies in Health Technology and Informatics
PublisherIOS Press
Pages9-14
Number of pages6
Volume220
ISBN (Print)9781614996248
DOIs
StatePublished - 2016
EventMedicine Meets Virtual Reality 22, NextMed/MMVR 2016 - Los Angeles, United States
Duration: Apr 7 2016Apr 9 2016

Publication series

NameStudies in Health Technology and Informatics
Volume220
ISSN (Print)09269630
ISSN (Electronic)18798365

Other

OtherMedicine Meets Virtual Reality 22, NextMed/MMVR 2016
CountryUnited States
CityLos Angeles
Period4/7/164/9/16

Fingerprint

Mentors
Augmented reality
Display devices
Medical Students
Color
Technology
Students
Geometry
Experiments

Keywords

  • Augmented reality
  • Telemedicine
  • Telementoring
  • Transparent displays

ASJC Scopus subject areas

  • Biomedical Engineering
  • Health Informatics
  • Health Information Management

Cite this

Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Gomez, G., Marley, S., ... Wachs, J. (2016). Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. In Studies in Health Technology and Informatics (Vol. 220, pp. 9-14). (Studies in Health Technology and Informatics; Vol. 220). IOS Press. https://doi.org/10.3233/978-1-61499-625-5-9

Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. / Andersen, Daniel; Popescu, Voicu; Cabrera, Maria Eugenia; Shanghavi, Aditya; Gomez, Gerardo; Marley, Sherri; Mullis, Brian; Wachs, Juan.

Studies in Health Technology and Informatics. Vol. 220 IOS Press, 2016. p. 9-14 (Studies in Health Technology and Informatics; Vol. 220).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Andersen, D, Popescu, V, Cabrera, ME, Shanghavi, A, Gomez, G, Marley, S, Mullis, B & Wachs, J 2016, Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. in Studies in Health Technology and Informatics. vol. 220, Studies in Health Technology and Informatics, vol. 220, IOS Press, pp. 9-14, Medicine Meets Virtual Reality 22, NextMed/MMVR 2016, Los Angeles, United States, 4/7/16. https://doi.org/10.3233/978-1-61499-625-5-9
Andersen D, Popescu V, Cabrera ME, Shanghavi A, Gomez G, Marley S et al. Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. In Studies in Health Technology and Informatics. Vol. 220. IOS Press. 2016. p. 9-14. (Studies in Health Technology and Informatics). https://doi.org/10.3233/978-1-61499-625-5-9
Andersen, Daniel ; Popescu, Voicu ; Cabrera, Maria Eugenia ; Shanghavi, Aditya ; Gomez, Gerardo ; Marley, Sherri ; Mullis, Brian ; Wachs, Juan. / Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. Studies in Health Technology and Informatics. Vol. 220 IOS Press, 2016. pp. 9-14 (Studies in Health Technology and Informatics).
@inproceedings{638df2bed5b648618dc80017df9d71c7,
title = "Avoiding focus shifts in surgical telementoring using an augmented reality transparent display",
abstract = "Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.",
keywords = "Augmented reality, Telemedicine, Telementoring, Transparent displays",
author = "Daniel Andersen and Voicu Popescu and Cabrera, {Maria Eugenia} and Aditya Shanghavi and Gerardo Gomez and Sherri Marley and Brian Mullis and Juan Wachs",
year = "2016",
doi = "10.3233/978-1-61499-625-5-9",
language = "English (US)",
isbn = "9781614996248",
volume = "220",
series = "Studies in Health Technology and Informatics",
publisher = "IOS Press",
pages = "9--14",
booktitle = "Studies in Health Technology and Informatics",

}

TY - GEN

T1 - Avoiding focus shifts in surgical telementoring using an augmented reality transparent display

AU - Andersen, Daniel

AU - Popescu, Voicu

AU - Cabrera, Maria Eugenia

AU - Shanghavi, Aditya

AU - Gomez, Gerardo

AU - Marley, Sherri

AU - Mullis, Brian

AU - Wachs, Juan

PY - 2016

Y1 - 2016

N2 - Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.

AB - Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.

KW - Augmented reality

KW - Telemedicine

KW - Telementoring

KW - Transparent displays

UR - http://www.scopus.com/inward/record.url?scp=84965025901&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84965025901&partnerID=8YFLogxK

U2 - 10.3233/978-1-61499-625-5-9

DO - 10.3233/978-1-61499-625-5-9

M3 - Conference contribution

C2 - 27046545

AN - SCOPUS:84965025901

SN - 9781614996248

VL - 220

T3 - Studies in Health Technology and Informatics

SP - 9

EP - 14

BT - Studies in Health Technology and Informatics

PB - IOS Press

ER -