Augmented reality as a medium for improved telementoring

Edgar Rojas-Munõz, Dan Andersen, Maria Eugenia Cabrera, Voicu Popescu, Sherri Marley, Ben Zarzaur, Brian Mullis, Juan P. Wachs

Research output: Contribution to journalArticle

Abstract

Combat trauma injuries require urgent and specialized care. When patient evacuation is infeasible, critical life-saving care must be given at the point of injury in real-time and under austere conditions associated to forward operating bases. Surgical telementoring allows local generalists to receive remote instruction from specialists thousands of miles away. However, current telementoring systems have limited annotation capabilities and lack of direct visualization of the future result of the surgical actions by the specialist. The System for Telementoring with Augmented Reality (STAR) is a surgical telementoring platform that improves the transfer of medical expertise by integrating a full-size interaction table for mentors to create graphical annotations, with augmented reality (AR) devices to display surgical annotations directly onto the generalist's field of view. Along with the explanation of the system's features, this paper provides results of user studies that validate STAR as a comprehensive AR surgical telementoring platform. In addition, potential future applications of STAR are discussed, which are desired features that state-of-the-art AR medical telementoring platforms should have when combat trauma scenarios are in the spotlight of such technologies.

Original languageEnglish (US)
Pages (from-to)57-64
Number of pages8
JournalMilitary Medicine
Volume184
DOIs
StatePublished - Mar 1 2019

Fingerprint

Wounds and Injuries
Mentors
Ambulatory Care
Technology
Equipment and Supplies

Keywords

  • augmented reality
  • surgical telementoring
  • telemedicine

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

Rojas-Munõz, E., Andersen, D., Cabrera, M. E., Popescu, V., Marley, S., Zarzaur, B., ... Wachs, J. P. (2019). Augmented reality as a medium for improved telementoring. Military Medicine, 184, 57-64. https://doi.org/10.1093/milmed/usy300

Augmented reality as a medium for improved telementoring. / Rojas-Munõz, Edgar; Andersen, Dan; Cabrera, Maria Eugenia; Popescu, Voicu; Marley, Sherri; Zarzaur, Ben; Mullis, Brian; Wachs, Juan P.

In: Military Medicine, Vol. 184, 01.03.2019, p. 57-64.

Research output: Contribution to journalArticle

Rojas-Munõz, E, Andersen, D, Cabrera, ME, Popescu, V, Marley, S, Zarzaur, B, Mullis, B & Wachs, JP 2019, 'Augmented reality as a medium for improved telementoring', Military Medicine, vol. 184, pp. 57-64. https://doi.org/10.1093/milmed/usy300
Rojas-Munõz E, Andersen D, Cabrera ME, Popescu V, Marley S, Zarzaur B et al. Augmented reality as a medium for improved telementoring. Military Medicine. 2019 Mar 1;184:57-64. https://doi.org/10.1093/milmed/usy300
Rojas-Munõz, Edgar ; Andersen, Dan ; Cabrera, Maria Eugenia ; Popescu, Voicu ; Marley, Sherri ; Zarzaur, Ben ; Mullis, Brian ; Wachs, Juan P. / Augmented reality as a medium for improved telementoring. In: Military Medicine. 2019 ; Vol. 184. pp. 57-64.
@article{0e73546a6105463bbb7ee68f1efa1fe4,
title = "Augmented reality as a medium for improved telementoring",
abstract = "Combat trauma injuries require urgent and specialized care. When patient evacuation is infeasible, critical life-saving care must be given at the point of injury in real-time and under austere conditions associated to forward operating bases. Surgical telementoring allows local generalists to receive remote instruction from specialists thousands of miles away. However, current telementoring systems have limited annotation capabilities and lack of direct visualization of the future result of the surgical actions by the specialist. The System for Telementoring with Augmented Reality (STAR) is a surgical telementoring platform that improves the transfer of medical expertise by integrating a full-size interaction table for mentors to create graphical annotations, with augmented reality (AR) devices to display surgical annotations directly onto the generalist's field of view. Along with the explanation of the system's features, this paper provides results of user studies that validate STAR as a comprehensive AR surgical telementoring platform. In addition, potential future applications of STAR are discussed, which are desired features that state-of-the-art AR medical telementoring platforms should have when combat trauma scenarios are in the spotlight of such technologies.",
keywords = "augmented reality, surgical telementoring, telemedicine",
author = "Edgar Rojas-Mun{\~o}z and Dan Andersen and Cabrera, {Maria Eugenia} and Voicu Popescu and Sherri Marley and Ben Zarzaur and Brian Mullis and Wachs, {Juan P.}",
year = "2019",
month = "3",
day = "1",
doi = "10.1093/milmed/usy300",
language = "English (US)",
volume = "184",
pages = "57--64",
journal = "Military Medicine",
issn = "0026-4075",
publisher = "Association of Military Surgeons of the US",

}

TY - JOUR

T1 - Augmented reality as a medium for improved telementoring

AU - Rojas-Munõz, Edgar

AU - Andersen, Dan

AU - Cabrera, Maria Eugenia

AU - Popescu, Voicu

AU - Marley, Sherri

AU - Zarzaur, Ben

AU - Mullis, Brian

AU - Wachs, Juan P.

PY - 2019/3/1

Y1 - 2019/3/1

N2 - Combat trauma injuries require urgent and specialized care. When patient evacuation is infeasible, critical life-saving care must be given at the point of injury in real-time and under austere conditions associated to forward operating bases. Surgical telementoring allows local generalists to receive remote instruction from specialists thousands of miles away. However, current telementoring systems have limited annotation capabilities and lack of direct visualization of the future result of the surgical actions by the specialist. The System for Telementoring with Augmented Reality (STAR) is a surgical telementoring platform that improves the transfer of medical expertise by integrating a full-size interaction table for mentors to create graphical annotations, with augmented reality (AR) devices to display surgical annotations directly onto the generalist's field of view. Along with the explanation of the system's features, this paper provides results of user studies that validate STAR as a comprehensive AR surgical telementoring platform. In addition, potential future applications of STAR are discussed, which are desired features that state-of-the-art AR medical telementoring platforms should have when combat trauma scenarios are in the spotlight of such technologies.

AB - Combat trauma injuries require urgent and specialized care. When patient evacuation is infeasible, critical life-saving care must be given at the point of injury in real-time and under austere conditions associated to forward operating bases. Surgical telementoring allows local generalists to receive remote instruction from specialists thousands of miles away. However, current telementoring systems have limited annotation capabilities and lack of direct visualization of the future result of the surgical actions by the specialist. The System for Telementoring with Augmented Reality (STAR) is a surgical telementoring platform that improves the transfer of medical expertise by integrating a full-size interaction table for mentors to create graphical annotations, with augmented reality (AR) devices to display surgical annotations directly onto the generalist's field of view. Along with the explanation of the system's features, this paper provides results of user studies that validate STAR as a comprehensive AR surgical telementoring platform. In addition, potential future applications of STAR are discussed, which are desired features that state-of-the-art AR medical telementoring platforms should have when combat trauma scenarios are in the spotlight of such technologies.

KW - augmented reality

KW - surgical telementoring

KW - telemedicine

UR - http://www.scopus.com/inward/record.url?scp=85063691710&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063691710&partnerID=8YFLogxK

U2 - 10.1093/milmed/usy300

DO - 10.1093/milmed/usy300

M3 - Article

VL - 184

SP - 57

EP - 64

JO - Military Medicine

JF - Military Medicine

SN - 0026-4075

ER -