Collaboration with a robotic scrub nurse

Mithun George Jacob, Yu Ting Li, George A. Akingba, Juan P. Wachs

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

The main use of robotics in surgery is not to replace the surgeon or surgical nurses but to work with them during surgery. A significant advantage of gesture-based communication is it requires no special training by the surgeon. Gesturing comes naturally to surgeons since their hands are already their main tools. Moreover, hand signs are the standard method for requesting surgical instruments, and gestures are not affected by ambient noise in the OR. A multimodal solution combining voice and gesture provides redundancy needed to assure proper instrument delivery. Gestures for robotic control have been the focus of much research since the early 1980s. Early work was done with Richard A. Bolt's Put-That-There interface followed by others using magnetic sensors or gloves to encode hand signs. The streaming depth maps captured through the Kinect sensor are processed by the gesture recognition module while a microphone concurrently captures voice commands interpreted by the speech recognition module. Following recognition, a command is transmitted to the robot through an application that controls a Fanuc LR Mate 200iC robotic arm across the network through a Telnet interface.

Original languageEnglish
Pages (from-to)68-75
Number of pages8
JournalCommunications of the ACM
Volume56
Issue number5
DOIs
StatePublished - May 2013

Fingerprint

Surgery
Robotics
Magnetic sensors
Gesture recognition
Robotic arms
Bolts
Microphones
Speech recognition
Redundancy
Robots
Communication
Sensors

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Jacob, M. G., Li, Y. T., Akingba, G. A., & Wachs, J. P. (2013). Collaboration with a robotic scrub nurse. Communications of the ACM, 56(5), 68-75. https://doi.org/10.1145/2447976.2447993

Collaboration with a robotic scrub nurse. / Jacob, Mithun George; Li, Yu Ting; Akingba, George A.; Wachs, Juan P.

In: Communications of the ACM, Vol. 56, No. 5, 05.2013, p. 68-75.

Research output: Contribution to journalArticle

Jacob, MG, Li, YT, Akingba, GA & Wachs, JP 2013, 'Collaboration with a robotic scrub nurse', Communications of the ACM, vol. 56, no. 5, pp. 68-75. https://doi.org/10.1145/2447976.2447993
Jacob, Mithun George ; Li, Yu Ting ; Akingba, George A. ; Wachs, Juan P. / Collaboration with a robotic scrub nurse. In: Communications of the ACM. 2013 ; Vol. 56, No. 5. pp. 68-75.
@article{6d6ef0bd86194113bfd3ca72450a9a6a,
title = "Collaboration with a robotic scrub nurse",
abstract = "The main use of robotics in surgery is not to replace the surgeon or surgical nurses but to work with them during surgery. A significant advantage of gesture-based communication is it requires no special training by the surgeon. Gesturing comes naturally to surgeons since their hands are already their main tools. Moreover, hand signs are the standard method for requesting surgical instruments, and gestures are not affected by ambient noise in the OR. A multimodal solution combining voice and gesture provides redundancy needed to assure proper instrument delivery. Gestures for robotic control have been the focus of much research since the early 1980s. Early work was done with Richard A. Bolt's Put-That-There interface followed by others using magnetic sensors or gloves to encode hand signs. The streaming depth maps captured through the Kinect sensor are processed by the gesture recognition module while a microphone concurrently captures voice commands interpreted by the speech recognition module. Following recognition, a command is transmitted to the robot through an application that controls a Fanuc LR Mate 200iC robotic arm across the network through a Telnet interface.",
author = "Jacob, {Mithun George} and Li, {Yu Ting} and Akingba, {George A.} and Wachs, {Juan P.}",
year = "2013",
month = "5",
doi = "10.1145/2447976.2447993",
language = "English",
volume = "56",
pages = "68--75",
journal = "Communications of the ACM",
issn = "0001-0782",
publisher = "Association for Computing Machinery (ACM)",
number = "5",

}

TY - JOUR

T1 - Collaboration with a robotic scrub nurse

AU - Jacob, Mithun George

AU - Li, Yu Ting

AU - Akingba, George A.

AU - Wachs, Juan P.

PY - 2013/5

Y1 - 2013/5

N2 - The main use of robotics in surgery is not to replace the surgeon or surgical nurses but to work with them during surgery. A significant advantage of gesture-based communication is it requires no special training by the surgeon. Gesturing comes naturally to surgeons since their hands are already their main tools. Moreover, hand signs are the standard method for requesting surgical instruments, and gestures are not affected by ambient noise in the OR. A multimodal solution combining voice and gesture provides redundancy needed to assure proper instrument delivery. Gestures for robotic control have been the focus of much research since the early 1980s. Early work was done with Richard A. Bolt's Put-That-There interface followed by others using magnetic sensors or gloves to encode hand signs. The streaming depth maps captured through the Kinect sensor are processed by the gesture recognition module while a microphone concurrently captures voice commands interpreted by the speech recognition module. Following recognition, a command is transmitted to the robot through an application that controls a Fanuc LR Mate 200iC robotic arm across the network through a Telnet interface.

AB - The main use of robotics in surgery is not to replace the surgeon or surgical nurses but to work with them during surgery. A significant advantage of gesture-based communication is it requires no special training by the surgeon. Gesturing comes naturally to surgeons since their hands are already their main tools. Moreover, hand signs are the standard method for requesting surgical instruments, and gestures are not affected by ambient noise in the OR. A multimodal solution combining voice and gesture provides redundancy needed to assure proper instrument delivery. Gestures for robotic control have been the focus of much research since the early 1980s. Early work was done with Richard A. Bolt's Put-That-There interface followed by others using magnetic sensors or gloves to encode hand signs. The streaming depth maps captured through the Kinect sensor are processed by the gesture recognition module while a microphone concurrently captures voice commands interpreted by the speech recognition module. Following recognition, a command is transmitted to the robot through an application that controls a Fanuc LR Mate 200iC robotic arm across the network through a Telnet interface.

UR - http://www.scopus.com/inward/record.url?scp=84877902419&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84877902419&partnerID=8YFLogxK

U2 - 10.1145/2447976.2447993

DO - 10.1145/2447976.2447993

M3 - Article

VL - 56

SP - 68

EP - 75

JO - Communications of the ACM

JF - Communications of the ACM

SN - 0001-0782

IS - 5

ER -