An augmented reality-based approach for surgical telementoring in austere environments

Dan Andersen, Voicu Popescu, Maria Eugenia Cabrera, Aditya Shanghavi, Brian Mullis, Sherri Marley, Gerardo Gomez, Juan P. Wachs

Research output: Contribution to journalArticle

5 Scopus citations

Abstract

Telementoring can improve treatment of combat trauma injuries by connecting remote experienced surgeons with local less-experienced surgeons in an austere environment. Current surgical telementoring systems force the local surgeon to regularly shift focus away from the operating field to receive expert guidance, which can lead to surgery delays or even errors. The System for Telementoring with Augmented Reality (STAR) integrates expert-created annotations directly into the local surgeon’s field of view. The local surgeon views the operating field by looking at a tablet display suspended between the patient and the surgeon that captures video of the surgical field. The remote surgeon remotely adds graphical annotations to the video. The annotations are sent back and displayed to the local surgeon while being automatically anchored to the operating field elements they describe. A technical evaluation demonstrates that STAR robustly anchors annotations despite tablet repositioning and occlusions. In a user study, participants used either STAR or a conventional telementoring system to precisely mark locations on a surgical simulator under a remote surgeon’s guidance. Participants who used STAR completed the task with fewer focus shifts and with greater accuracy. The STAR reduces the local surgeon’s need to shift attention during surgery, allowing him or her to continuously work while looking “through” the tablet screen.

Original languageEnglish (US)
Article number310
Pages (from-to)310-315
Number of pages6
JournalMilitary medicine
Volume182
DOIs
StatePublished - Mar 2017

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Fingerprint Dive into the research topics of 'An augmented reality-based approach for surgical telementoring in austere environments'. Together they form a unique fingerprint.

  • Cite this

    Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Mullis, B., Marley, S., Gomez, G., & Wachs, J. P. (2017). An augmented reality-based approach for surgical telementoring in austere environments. Military medicine, 182, 310-315. [310]. https://doi.org/10.7205/MILMED-D-16-00051