Gestonurse

A robotic surgical nurse for handling surgical instruments in the operating room

Mithun Jacob, Yu Ting Li, George Akingba, Juan P. Wachs

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

While surgeon-scrub nurse collaboration provides a fast, straightforward and inexpensive method of delivering surgical instruments to the surgeon, it often results in "mistakes" (e. g. missing information, ambiguity of instructions and delays). It has been shown that these errors can have a negative impact on the outcome of the surgery. These errors could potentially be reduced or eliminated by introducing robotics into the operating room. Gesture control is a natural and fundamentally sound alternative that allows interaction without disturbing the normal flow of surgery. This paper describes the development of a robotic scrub nurse Gestonurse to support surgeons by passing surgical instruments during surgery as required. The robot responds to recognized hand signals detected through sophisticated computer vision and pattern recognition techniques. Experimental results show that 95% of the gestures were recognized correctly. The gesture recognition algorithm presented is robust to changes in scale and rotation of the hand gestures. The system was compared to human task performance and was found to be only 0.83 s slower on average.

Original languageEnglish
Pages (from-to)53-63
Number of pages11
JournalJournal of Robotic Surgery
Volume6
Issue number1
DOIs
StatePublished - Mar 2012

Fingerprint

Gestures
Robotics
Operating Rooms
Surgical Instruments
Nurses
Hand
Task Performance and Analysis
Surgeons

Keywords

  • Gesture recognition
  • Human robot interfaces
  • Surgical robot

ASJC Scopus subject areas

  • Surgery
  • Health Informatics

Cite this

Gestonurse : A robotic surgical nurse for handling surgical instruments in the operating room. / Jacob, Mithun; Li, Yu Ting; Akingba, George; Wachs, Juan P.

In: Journal of Robotic Surgery, Vol. 6, No. 1, 03.2012, p. 53-63.

Research output: Contribution to journalArticle

Jacob, Mithun ; Li, Yu Ting ; Akingba, George ; Wachs, Juan P. / Gestonurse : A robotic surgical nurse for handling surgical instruments in the operating room. In: Journal of Robotic Surgery. 2012 ; Vol. 6, No. 1. pp. 53-63.
@article{735cd2675b804e6f80ad401a5f1cc793,
title = "Gestonurse: A robotic surgical nurse for handling surgical instruments in the operating room",
abstract = "While surgeon-scrub nurse collaboration provides a fast, straightforward and inexpensive method of delivering surgical instruments to the surgeon, it often results in {"}mistakes{"} (e. g. missing information, ambiguity of instructions and delays). It has been shown that these errors can have a negative impact on the outcome of the surgery. These errors could potentially be reduced or eliminated by introducing robotics into the operating room. Gesture control is a natural and fundamentally sound alternative that allows interaction without disturbing the normal flow of surgery. This paper describes the development of a robotic scrub nurse Gestonurse to support surgeons by passing surgical instruments during surgery as required. The robot responds to recognized hand signals detected through sophisticated computer vision and pattern recognition techniques. Experimental results show that 95{\%} of the gestures were recognized correctly. The gesture recognition algorithm presented is robust to changes in scale and rotation of the hand gestures. The system was compared to human task performance and was found to be only 0.83 s slower on average.",
keywords = "Gesture recognition, Human robot interfaces, Surgical robot",
author = "Mithun Jacob and Li, {Yu Ting} and George Akingba and Wachs, {Juan P.}",
year = "2012",
month = "3",
doi = "10.1007/s11701-011-0325-0",
language = "English",
volume = "6",
pages = "53--63",
journal = "Journal of Robotic Surgery",
issn = "1863-2483",
publisher = "Springer London",
number = "1",

}

TY - JOUR

T1 - Gestonurse

T2 - A robotic surgical nurse for handling surgical instruments in the operating room

AU - Jacob, Mithun

AU - Li, Yu Ting

AU - Akingba, George

AU - Wachs, Juan P.

PY - 2012/3

Y1 - 2012/3

N2 - While surgeon-scrub nurse collaboration provides a fast, straightforward and inexpensive method of delivering surgical instruments to the surgeon, it often results in "mistakes" (e. g. missing information, ambiguity of instructions and delays). It has been shown that these errors can have a negative impact on the outcome of the surgery. These errors could potentially be reduced or eliminated by introducing robotics into the operating room. Gesture control is a natural and fundamentally sound alternative that allows interaction without disturbing the normal flow of surgery. This paper describes the development of a robotic scrub nurse Gestonurse to support surgeons by passing surgical instruments during surgery as required. The robot responds to recognized hand signals detected through sophisticated computer vision and pattern recognition techniques. Experimental results show that 95% of the gestures were recognized correctly. The gesture recognition algorithm presented is robust to changes in scale and rotation of the hand gestures. The system was compared to human task performance and was found to be only 0.83 s slower on average.

AB - While surgeon-scrub nurse collaboration provides a fast, straightforward and inexpensive method of delivering surgical instruments to the surgeon, it often results in "mistakes" (e. g. missing information, ambiguity of instructions and delays). It has been shown that these errors can have a negative impact on the outcome of the surgery. These errors could potentially be reduced or eliminated by introducing robotics into the operating room. Gesture control is a natural and fundamentally sound alternative that allows interaction without disturbing the normal flow of surgery. This paper describes the development of a robotic scrub nurse Gestonurse to support surgeons by passing surgical instruments during surgery as required. The robot responds to recognized hand signals detected through sophisticated computer vision and pattern recognition techniques. Experimental results show that 95% of the gestures were recognized correctly. The gesture recognition algorithm presented is robust to changes in scale and rotation of the hand gestures. The system was compared to human task performance and was found to be only 0.83 s slower on average.

KW - Gesture recognition

KW - Human robot interfaces

KW - Surgical robot

UR - http://www.scopus.com/inward/record.url?scp=84857648029&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84857648029&partnerID=8YFLogxK

U2 - 10.1007/s11701-011-0325-0

DO - 10.1007/s11701-011-0325-0

M3 - Article

VL - 6

SP - 53

EP - 63

JO - Journal of Robotic Surgery

JF - Journal of Robotic Surgery

SN - 1863-2483

IS - 1

ER -