Avoiding focus shifts in surgical telementoring using an augmented reality transparent display

Daniel Andersen, Voicu Popescu, Maria Eugenia Cabrera, Aditya Shanghavi, Gerardo Gomez, Sherri Marley, Brian Mullis, Juan Wachs

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Conventional surgical telementoring systems require the trainee to shift focus away from the operating field to a nearby monitor to receive mentor guidance. This paper presents the next generation of telementoring systems. Our system, STAR (System for Telementoring with Augmented Reality) avoids focus shifts by placing mentor annotations directly into the trainee's field of view using augmented reality transparent display technology. This prototype was tested with pre-medical and medical students. Experiments were conducted where participants were asked to identify precise operating field locations communicated to them using either STAR or a conventional telementoring system. STAR was shown to improve accuracy and to reduce focus shifts. The initial STAR prototype only provides an approximate transparent display effect, without visual continuity between the display and the surrounding area. The current version of our transparent display provides visual continuity by showing the geometry and color of the operating field from the trainee's viewpoint.

Original languageEnglish (US)
Title of host publicationMedicine Meets Virtual Reality 22, NextMed/MMVR 22
EditorsLi Fellander-Tsai, Kirby G. Vosburgh, James D. Westwood, Steven Senger, Susan W. Westwood, Cali M. Fidopiastis, Alan Liu
PublisherIOS Press
Pages9-14
Number of pages6
ISBN (Electronic)9781614996248
DOIs
StatePublished - Jan 1 2016
EventMedicine Meets Virtual Reality 22, NextMed/MMVR 2016 - Los Angeles, United States
Duration: Apr 7 2016Apr 9 2016

Publication series

NameStudies in Health Technology and Informatics
Volume220
ISSN (Print)0926-9630
ISSN (Electronic)1879-8365

Other

OtherMedicine Meets Virtual Reality 22, NextMed/MMVR 2016
CountryUnited States
CityLos Angeles
Period4/7/164/9/16

Keywords

  • Augmented reality
  • Telemedicine
  • Telementoring
  • Transparent displays

ASJC Scopus subject areas

  • Biomedical Engineering
  • Health Informatics
  • Health Information Management

Fingerprint Dive into the research topics of 'Avoiding focus shifts in surgical telementoring using an augmented reality transparent display'. Together they form a unique fingerprint.

  • Cite this

    Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Gomez, G., Marley, S., Mullis, B., & Wachs, J. (2016). Avoiding focus shifts in surgical telementoring using an augmented reality transparent display. In L. Fellander-Tsai, K. G. Vosburgh, J. D. Westwood, S. Senger, S. W. Westwood, C. M. Fidopiastis, & A. Liu (Eds.), Medicine Meets Virtual Reality 22, NextMed/MMVR 22 (pp. 9-14). (Studies in Health Technology and Informatics; Vol. 220). IOS Press. https://doi.org/10.3233/978-1-61499-625-5-9