Medical telementoring using an augmented reality transparent display

Daniel Andersen, Voicu Popescu, Maria Eugenia Cabrera, Aditya Shanghavi, Gerardo Gomez, Sherri Marley, Brian Mullis, Juan P. Wachs

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

Background: The goal of this study was to design and implement a novel surgical telementoring system called the System for Telementoring with Augmented Reality (STAR) that uses a virtual transparent display to convey precise locations in the operating field to a trainee surgeon. This system was compared with a conventional system based on a telestrator for surgical instruction. Methods: A telementoring system was developed and evaluated in a study which used a 1 × 2 between-subjects design with telementoring system, that is, STAR or conventional, as the independent variable. The participants in the study were 20 premedical or medical students who had no prior experience with telementoring. Each participant completed a task of port placement and a task of abdominal incision under telementoring using either the STAR or the conventional system. The metrics used to test performance when using the system were placement error, number of focus shifts, and time to task completion. Results: When compared with the conventional system, participants using STAR completed the 2 tasks with less placement error (45% and 68%) and with fewer focus shifts (86% and 44%), but more slowly (19% for each task). Conclusions: Using STAR resulted in decreased annotation placement error, fewer focus shifts, but greater times to task completion. STAR placed virtual annotations directly onto the trainee surgeon's field of view of the operating field by conveying location with great accuracy; this technology helped to avoid shifts in focus, decreased depth perception, and enabled fine-tuning execution of the task to match telementored instruction, but led to greater times to task completion.

Original languageEnglish (US)
JournalSurgery
DOIs
StateAccepted/In press - 2016

Fingerprint

Premedical Students
Depth Perception
Medical Students
Technology
Surgeons

ASJC Scopus subject areas

  • Surgery

Cite this

Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Gomez, G., Marley, S., ... Wachs, J. P. (Accepted/In press). Medical telementoring using an augmented reality transparent display. Surgery. https://doi.org/10.1016/j.surg.2015.12.016

Medical telementoring using an augmented reality transparent display. / Andersen, Daniel; Popescu, Voicu; Cabrera, Maria Eugenia; Shanghavi, Aditya; Gomez, Gerardo; Marley, Sherri; Mullis, Brian; Wachs, Juan P.

In: Surgery, 2016.

Research output: Contribution to journalArticle

Andersen, D, Popescu, V, Cabrera, ME, Shanghavi, A, Gomez, G, Marley, S, Mullis, B & Wachs, JP 2016, 'Medical telementoring using an augmented reality transparent display', Surgery. https://doi.org/10.1016/j.surg.2015.12.016
Andersen D, Popescu V, Cabrera ME, Shanghavi A, Gomez G, Marley S et al. Medical telementoring using an augmented reality transparent display. Surgery. 2016. https://doi.org/10.1016/j.surg.2015.12.016
Andersen, Daniel ; Popescu, Voicu ; Cabrera, Maria Eugenia ; Shanghavi, Aditya ; Gomez, Gerardo ; Marley, Sherri ; Mullis, Brian ; Wachs, Juan P. / Medical telementoring using an augmented reality transparent display. In: Surgery. 2016.
@article{a91c00cf847a41dea3fd36916341ab8e,
title = "Medical telementoring using an augmented reality transparent display",
abstract = "Background: The goal of this study was to design and implement a novel surgical telementoring system called the System for Telementoring with Augmented Reality (STAR) that uses a virtual transparent display to convey precise locations in the operating field to a trainee surgeon. This system was compared with a conventional system based on a telestrator for surgical instruction. Methods: A telementoring system was developed and evaluated in a study which used a 1 × 2 between-subjects design with telementoring system, that is, STAR or conventional, as the independent variable. The participants in the study were 20 premedical or medical students who had no prior experience with telementoring. Each participant completed a task of port placement and a task of abdominal incision under telementoring using either the STAR or the conventional system. The metrics used to test performance when using the system were placement error, number of focus shifts, and time to task completion. Results: When compared with the conventional system, participants using STAR completed the 2 tasks with less placement error (45{\%} and 68{\%}) and with fewer focus shifts (86{\%} and 44{\%}), but more slowly (19{\%} for each task). Conclusions: Using STAR resulted in decreased annotation placement error, fewer focus shifts, but greater times to task completion. STAR placed virtual annotations directly onto the trainee surgeon's field of view of the operating field by conveying location with great accuracy; this technology helped to avoid shifts in focus, decreased depth perception, and enabled fine-tuning execution of the task to match telementored instruction, but led to greater times to task completion.",
author = "Daniel Andersen and Voicu Popescu and Cabrera, {Maria Eugenia} and Aditya Shanghavi and Gerardo Gomez and Sherri Marley and Brian Mullis and Wachs, {Juan P.}",
year = "2016",
doi = "10.1016/j.surg.2015.12.016",
language = "English (US)",
journal = "Surgery",
issn = "0039-6060",
publisher = "Mosby Inc.",

}

TY - JOUR

T1 - Medical telementoring using an augmented reality transparent display

AU - Andersen, Daniel

AU - Popescu, Voicu

AU - Cabrera, Maria Eugenia

AU - Shanghavi, Aditya

AU - Gomez, Gerardo

AU - Marley, Sherri

AU - Mullis, Brian

AU - Wachs, Juan P.

PY - 2016

Y1 - 2016

N2 - Background: The goal of this study was to design and implement a novel surgical telementoring system called the System for Telementoring with Augmented Reality (STAR) that uses a virtual transparent display to convey precise locations in the operating field to a trainee surgeon. This system was compared with a conventional system based on a telestrator for surgical instruction. Methods: A telementoring system was developed and evaluated in a study which used a 1 × 2 between-subjects design with telementoring system, that is, STAR or conventional, as the independent variable. The participants in the study were 20 premedical or medical students who had no prior experience with telementoring. Each participant completed a task of port placement and a task of abdominal incision under telementoring using either the STAR or the conventional system. The metrics used to test performance when using the system were placement error, number of focus shifts, and time to task completion. Results: When compared with the conventional system, participants using STAR completed the 2 tasks with less placement error (45% and 68%) and with fewer focus shifts (86% and 44%), but more slowly (19% for each task). Conclusions: Using STAR resulted in decreased annotation placement error, fewer focus shifts, but greater times to task completion. STAR placed virtual annotations directly onto the trainee surgeon's field of view of the operating field by conveying location with great accuracy; this technology helped to avoid shifts in focus, decreased depth perception, and enabled fine-tuning execution of the task to match telementored instruction, but led to greater times to task completion.

AB - Background: The goal of this study was to design and implement a novel surgical telementoring system called the System for Telementoring with Augmented Reality (STAR) that uses a virtual transparent display to convey precise locations in the operating field to a trainee surgeon. This system was compared with a conventional system based on a telestrator for surgical instruction. Methods: A telementoring system was developed and evaluated in a study which used a 1 × 2 between-subjects design with telementoring system, that is, STAR or conventional, as the independent variable. The participants in the study were 20 premedical or medical students who had no prior experience with telementoring. Each participant completed a task of port placement and a task of abdominal incision under telementoring using either the STAR or the conventional system. The metrics used to test performance when using the system were placement error, number of focus shifts, and time to task completion. Results: When compared with the conventional system, participants using STAR completed the 2 tasks with less placement error (45% and 68%) and with fewer focus shifts (86% and 44%), but more slowly (19% for each task). Conclusions: Using STAR resulted in decreased annotation placement error, fewer focus shifts, but greater times to task completion. STAR placed virtual annotations directly onto the trainee surgeon's field of view of the operating field by conveying location with great accuracy; this technology helped to avoid shifts in focus, decreased depth perception, and enabled fine-tuning execution of the task to match telementored instruction, but led to greater times to task completion.

UR - http://www.scopus.com/inward/record.url?scp=84955462088&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84955462088&partnerID=8YFLogxK

U2 - 10.1016/j.surg.2015.12.016

DO - 10.1016/j.surg.2015.12.016

M3 - Article

JO - Surgery

JF - Surgery

SN - 0039-6060

ER -