Virtual annotations of the surgical field through an augmented reality transparent display

Daniel Andersen, Voicu Popescu, Maria Eugenia Cabrera, Aditya Shanghavi, Gerardo Gomez, Sherri Marley, Brian Mullis, Juan Wachs

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Existing telestrator-based surgical telementoring systems require a trainee surgeon to shift focus frequently between the operating field and a nearby monitor to acquire and apply instructions from a remote mentor. We present a novel approach to surgical telementoring where annotations are superimposed directly onto the surgical field using an augmented reality (AR) simulated transparent display. We present our first steps towards realizing this vision, using two networked conventional tablets to allow a mentor to remotely annotate the operating field as seen by a trainee. Annotations are anchored to the surgical field as the trainee tablet moves and as the surgical field deforms or becomes occluded. The system is built exclusively from compact commodity-level components—all imaging and processing are performed on the two tablets.

Original languageEnglish (US)
JournalVisual Computer
DOIs
StateAccepted/In press - May 27 2015

Fingerprint

Augmented reality
Display devices
Imaging techniques
Processing

Keywords

  • Annotation anchoring
  • Augmented reality
  • Telemedicine
  • Telementoring

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Cite this

Andersen, D., Popescu, V., Cabrera, M. E., Shanghavi, A., Gomez, G., Marley, S., ... Wachs, J. (Accepted/In press). Virtual annotations of the surgical field through an augmented reality transparent display. Visual Computer. https://doi.org/10.1007/s00371-015-1135-6

Virtual annotations of the surgical field through an augmented reality transparent display. / Andersen, Daniel; Popescu, Voicu; Cabrera, Maria Eugenia; Shanghavi, Aditya; Gomez, Gerardo; Marley, Sherri; Mullis, Brian; Wachs, Juan.

In: Visual Computer, 27.05.2015.

Research output: Contribution to journalArticle

Andersen, Daniel ; Popescu, Voicu ; Cabrera, Maria Eugenia ; Shanghavi, Aditya ; Gomez, Gerardo ; Marley, Sherri ; Mullis, Brian ; Wachs, Juan. / Virtual annotations of the surgical field through an augmented reality transparent display. In: Visual Computer. 2015.
@article{41835198425a49ea87e0489c04117493,
title = "Virtual annotations of the surgical field through an augmented reality transparent display",
abstract = "Existing telestrator-based surgical telementoring systems require a trainee surgeon to shift focus frequently between the operating field and a nearby monitor to acquire and apply instructions from a remote mentor. We present a novel approach to surgical telementoring where annotations are superimposed directly onto the surgical field using an augmented reality (AR) simulated transparent display. We present our first steps towards realizing this vision, using two networked conventional tablets to allow a mentor to remotely annotate the operating field as seen by a trainee. Annotations are anchored to the surgical field as the trainee tablet moves and as the surgical field deforms or becomes occluded. The system is built exclusively from compact commodity-level components—all imaging and processing are performed on the two tablets.",
keywords = "Annotation anchoring, Augmented reality, Telemedicine, Telementoring",
author = "Daniel Andersen and Voicu Popescu and Cabrera, {Maria Eugenia} and Aditya Shanghavi and Gerardo Gomez and Sherri Marley and Brian Mullis and Juan Wachs",
year = "2015",
month = "5",
day = "27",
doi = "10.1007/s00371-015-1135-6",
language = "English (US)",
journal = "Visual Computer",
issn = "0178-2789",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - Virtual annotations of the surgical field through an augmented reality transparent display

AU - Andersen, Daniel

AU - Popescu, Voicu

AU - Cabrera, Maria Eugenia

AU - Shanghavi, Aditya

AU - Gomez, Gerardo

AU - Marley, Sherri

AU - Mullis, Brian

AU - Wachs, Juan

PY - 2015/5/27

Y1 - 2015/5/27

N2 - Existing telestrator-based surgical telementoring systems require a trainee surgeon to shift focus frequently between the operating field and a nearby monitor to acquire and apply instructions from a remote mentor. We present a novel approach to surgical telementoring where annotations are superimposed directly onto the surgical field using an augmented reality (AR) simulated transparent display. We present our first steps towards realizing this vision, using two networked conventional tablets to allow a mentor to remotely annotate the operating field as seen by a trainee. Annotations are anchored to the surgical field as the trainee tablet moves and as the surgical field deforms or becomes occluded. The system is built exclusively from compact commodity-level components—all imaging and processing are performed on the two tablets.

AB - Existing telestrator-based surgical telementoring systems require a trainee surgeon to shift focus frequently between the operating field and a nearby monitor to acquire and apply instructions from a remote mentor. We present a novel approach to surgical telementoring where annotations are superimposed directly onto the surgical field using an augmented reality (AR) simulated transparent display. We present our first steps towards realizing this vision, using two networked conventional tablets to allow a mentor to remotely annotate the operating field as seen by a trainee. Annotations are anchored to the surgical field as the trainee tablet moves and as the surgical field deforms or becomes occluded. The system is built exclusively from compact commodity-level components—all imaging and processing are performed on the two tablets.

KW - Annotation anchoring

KW - Augmented reality

KW - Telemedicine

KW - Telementoring

UR - http://www.scopus.com/inward/record.url?scp=84930146301&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930146301&partnerID=8YFLogxK

U2 - 10.1007/s00371-015-1135-6

DO - 10.1007/s00371-015-1135-6

M3 - Article

JO - Visual Computer

JF - Visual Computer

SN - 0178-2789

ER -