An augmented reality-based approach for surgical telementoring in austere environments

Dan Andersen, Voicu Popescu, Maria Eugenia Cabrera, Aditya Shanghavi, Brian Mullis, Sherri Marley, Gerardo Gomez, Juan P. Wachs

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Telementoring can improve treatment of combat trauma injuries by connecting remote experienced surgeons with local less-experienced surgeons in an austere environment. Current surgical telementoring systems force the local surgeon to regularly shift focus away from the operating field to receive expert guidance, which can lead to surgery delays or even errors. The System for Telementoring with Augmented Reality (STAR) integrates expert-created annotations directly into the local surgeon’s field of view. The local surgeon views the operating field by looking at a tablet display suspended between the patient and the surgeon that captures video of the surgical field. The remote surgeon remotely adds graphical annotations to the video. The annotations are sent back and displayed to the local surgeon while being automatically anchored to the operating field elements they describe. A technical evaluation demonstrates that STAR robustly anchors annotations despite tablet repositioning and occlusions. In a user study, participants used either STAR or a conventional telementoring system to precisely mark locations on a surgical simulator under a remote surgeon’s guidance. Participants who used STAR completed the task with fewer focus shifts and with greater accuracy. The STAR reduces the local surgeon’s need to shift attention during surgery, allowing him or her to continuously work while looking “through” the tablet screen.

Original languageEnglish (US)
Article number310
Pages (from-to)310-315
Number of pages6
JournalMilitary Medicine
Volume182
DOIs
StatePublished - Mar 1 2017

Fingerprint

Tablets
Surgeons
Wounds and Injuries
Therapeutics

ASJC Scopus subject areas

  • Medicine(all)
  • Public Health, Environmental and Occupational Health

Cite this

Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Mullis, B., Marley, S., ... Wachs, J. P. (2017). An augmented reality-based approach for surgical telementoring in austere environments. Military Medicine, 182, 310-315. [310]. https://doi.org/10.7205/MILMED-D-16-00051

An augmented reality-based approach for surgical telementoring in austere environments. / Andersen, Dan; Popescu, Voicu; Cabrera, Maria Eugenia; Shanghavi, Aditya; Mullis, Brian; Marley, Sherri; Gomez, Gerardo; Wachs, Juan P.

In: Military Medicine, Vol. 182, 310, 01.03.2017, p. 310-315.

Research output: Contribution to journalArticle

Andersen, D, Popescu, V, Cabrera, ME, Shanghavi, A, Mullis, B, Marley, S, Gomez, G & Wachs, JP 2017, 'An augmented reality-based approach for surgical telementoring in austere environments', Military Medicine, vol. 182, 310, pp. 310-315. https://doi.org/10.7205/MILMED-D-16-00051
Andersen, Dan ; Popescu, Voicu ; Cabrera, Maria Eugenia ; Shanghavi, Aditya ; Mullis, Brian ; Marley, Sherri ; Gomez, Gerardo ; Wachs, Juan P. / An augmented reality-based approach for surgical telementoring in austere environments. In: Military Medicine. 2017 ; Vol. 182. pp. 310-315.
@article{93a556b6f4b14fcca90c6a58e49c114b,
title = "An augmented reality-based approach for surgical telementoring in austere environments",
abstract = "Telementoring can improve treatment of combat trauma injuries by connecting remote experienced surgeons with local less-experienced surgeons in an austere environment. Current surgical telementoring systems force the local surgeon to regularly shift focus away from the operating field to receive expert guidance, which can lead to surgery delays or even errors. The System for Telementoring with Augmented Reality (STAR) integrates expert-created annotations directly into the local surgeon’s field of view. The local surgeon views the operating field by looking at a tablet display suspended between the patient and the surgeon that captures video of the surgical field. The remote surgeon remotely adds graphical annotations to the video. The annotations are sent back and displayed to the local surgeon while being automatically anchored to the operating field elements they describe. A technical evaluation demonstrates that STAR robustly anchors annotations despite tablet repositioning and occlusions. In a user study, participants used either STAR or a conventional telementoring system to precisely mark locations on a surgical simulator under a remote surgeon’s guidance. Participants who used STAR completed the task with fewer focus shifts and with greater accuracy. The STAR reduces the local surgeon’s need to shift attention during surgery, allowing him or her to continuously work while looking “through” the tablet screen.",
author = "Dan Andersen and Voicu Popescu and Cabrera, {Maria Eugenia} and Aditya Shanghavi and Brian Mullis and Sherri Marley and Gerardo Gomez and Wachs, {Juan P.}",
year = "2017",
month = "3",
day = "1",
doi = "10.7205/MILMED-D-16-00051",
language = "English (US)",
volume = "182",
pages = "310--315",
journal = "Military Medicine",
issn = "0026-4075",
publisher = "Association of Military Surgeons of the US",

}

TY - JOUR

T1 - An augmented reality-based approach for surgical telementoring in austere environments

AU - Andersen, Dan

AU - Popescu, Voicu

AU - Cabrera, Maria Eugenia

AU - Shanghavi, Aditya

AU - Mullis, Brian

AU - Marley, Sherri

AU - Gomez, Gerardo

AU - Wachs, Juan P.

PY - 2017/3/1

Y1 - 2017/3/1

N2 - Telementoring can improve treatment of combat trauma injuries by connecting remote experienced surgeons with local less-experienced surgeons in an austere environment. Current surgical telementoring systems force the local surgeon to regularly shift focus away from the operating field to receive expert guidance, which can lead to surgery delays or even errors. The System for Telementoring with Augmented Reality (STAR) integrates expert-created annotations directly into the local surgeon’s field of view. The local surgeon views the operating field by looking at a tablet display suspended between the patient and the surgeon that captures video of the surgical field. The remote surgeon remotely adds graphical annotations to the video. The annotations are sent back and displayed to the local surgeon while being automatically anchored to the operating field elements they describe. A technical evaluation demonstrates that STAR robustly anchors annotations despite tablet repositioning and occlusions. In a user study, participants used either STAR or a conventional telementoring system to precisely mark locations on a surgical simulator under a remote surgeon’s guidance. Participants who used STAR completed the task with fewer focus shifts and with greater accuracy. The STAR reduces the local surgeon’s need to shift attention during surgery, allowing him or her to continuously work while looking “through” the tablet screen.

AB - Telementoring can improve treatment of combat trauma injuries by connecting remote experienced surgeons with local less-experienced surgeons in an austere environment. Current surgical telementoring systems force the local surgeon to regularly shift focus away from the operating field to receive expert guidance, which can lead to surgery delays or even errors. The System for Telementoring with Augmented Reality (STAR) integrates expert-created annotations directly into the local surgeon’s field of view. The local surgeon views the operating field by looking at a tablet display suspended between the patient and the surgeon that captures video of the surgical field. The remote surgeon remotely adds graphical annotations to the video. The annotations are sent back and displayed to the local surgeon while being automatically anchored to the operating field elements they describe. A technical evaluation demonstrates that STAR robustly anchors annotations despite tablet repositioning and occlusions. In a user study, participants used either STAR or a conventional telementoring system to precisely mark locations on a surgical simulator under a remote surgeon’s guidance. Participants who used STAR completed the task with fewer focus shifts and with greater accuracy. The STAR reduces the local surgeon’s need to shift attention during surgery, allowing him or her to continuously work while looking “through” the tablet screen.

UR - http://www.scopus.com/inward/record.url?scp=85015211870&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015211870&partnerID=8YFLogxK

U2 - 10.7205/MILMED-D-16-00051

DO - 10.7205/MILMED-D-16-00051

M3 - Article

VL - 182

SP - 310

EP - 315

JO - Military Medicine

JF - Military Medicine

SN - 0026-4075

M1 - 310

ER -