Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training

Chuhao Wu, Jackie Cha, Jay Sulek, Tian Zhou, Chandru P. Sundaram, Juan Wachs, Denny Yu

Research output: Contribution to journalArticle

Abstract

Objective: The aim of this study is to assess the relationship between eye-tracking measures and perceived workload in robotic surgical tasks. Background: Robotic techniques provide improved dexterity, stereoscopic vision, and ergonomic control system over laparoscopic surgery, but the complexity of the interfaces and operations may pose new challenges to surgeons and compromise patient safety. Limited studies have objectively quantified workload and its impact on performance in robotic surgery. Although not yet implemented in robotic surgery, minimally intrusive and continuous eye-tracking metrics have been shown to be sensitive to changes in workload in other domains. Methods: Eight surgical trainees participated in 15 robotic skills simulation sessions. In each session, participants performed up to 12 simulated exercises. Correlation and mixed-effects analyses were conducted to explore the relationships between eye-tracking metrics and perceived workload. Machine learning classifiers were used to determine the sensitivity of differentiating between low and high workload with eye-tracking features. Results: Gaze entropy increased as perceived workload increased, with a correlation of.51. Pupil diameter and gaze entropy distinguished differences in workload between task difficulty levels, and both metrics increased as task level difficulty increased. The classification model using eye-tracking features achieved an accuracy of 84.7% in predicting workload levels. Conclusion: Eye-tracking measures can detect perceived workload during robotic tasks. They can potentially be used to identify task contributors to high workload and provide measures for robotic surgery training. Application: Workload assessment can be used for real-time monitoring of workload in robotic surgical training and provide assessments for performance and learning.

Original languageEnglish (US)
JournalHuman Factors
DOIs
StateAccepted/In press - Jan 1 2019
Externally publishedYes

Fingerprint

Robotics
Workload
workload
Entropy
surgery
Ergonomics
Surgery
Learning systems
entropy
Classifiers
Control systems
Monitoring
Depth Perception
Human Engineering
Robotic surgery
Patient Safety
Pupil
trainee
control system
Laparoscopy

Keywords

  • eye movements
  • perceived workload
  • robotics and telesurgery
  • simulation training
  • statistics and data analysis

ASJC Scopus subject areas

  • Human Factors and Ergonomics
  • Applied Psychology
  • Behavioral Neuroscience

Cite this

Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training. / Wu, Chuhao; Cha, Jackie; Sulek, Jay; Zhou, Tian; Sundaram, Chandru P.; Wachs, Juan; Yu, Denny.

In: Human Factors, 01.01.2019.

Research output: Contribution to journalArticle

Wu, Chuhao ; Cha, Jackie ; Sulek, Jay ; Zhou, Tian ; Sundaram, Chandru P. ; Wachs, Juan ; Yu, Denny. / Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training. In: Human Factors. 2019.
@article{99313bdd205242b6ad7cc6bf038c4cbc,
title = "Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training",
abstract = "Objective: The aim of this study is to assess the relationship between eye-tracking measures and perceived workload in robotic surgical tasks. Background: Robotic techniques provide improved dexterity, stereoscopic vision, and ergonomic control system over laparoscopic surgery, but the complexity of the interfaces and operations may pose new challenges to surgeons and compromise patient safety. Limited studies have objectively quantified workload and its impact on performance in robotic surgery. Although not yet implemented in robotic surgery, minimally intrusive and continuous eye-tracking metrics have been shown to be sensitive to changes in workload in other domains. Methods: Eight surgical trainees participated in 15 robotic skills simulation sessions. In each session, participants performed up to 12 simulated exercises. Correlation and mixed-effects analyses were conducted to explore the relationships between eye-tracking metrics and perceived workload. Machine learning classifiers were used to determine the sensitivity of differentiating between low and high workload with eye-tracking features. Results: Gaze entropy increased as perceived workload increased, with a correlation of.51. Pupil diameter and gaze entropy distinguished differences in workload between task difficulty levels, and both metrics increased as task level difficulty increased. The classification model using eye-tracking features achieved an accuracy of 84.7{\%} in predicting workload levels. Conclusion: Eye-tracking measures can detect perceived workload during robotic tasks. They can potentially be used to identify task contributors to high workload and provide measures for robotic surgery training. Application: Workload assessment can be used for real-time monitoring of workload in robotic surgical training and provide assessments for performance and learning.",
keywords = "eye movements, perceived workload, robotics and telesurgery, simulation training, statistics and data analysis",
author = "Chuhao Wu and Jackie Cha and Jay Sulek and Tian Zhou and Sundaram, {Chandru P.} and Juan Wachs and Denny Yu",
year = "2019",
month = "1",
day = "1",
doi = "10.1177/0018720819874544",
language = "English (US)",
journal = "Human Factors",
issn = "0018-7208",
publisher = "SAGE Publications Inc.",

}

TY - JOUR

T1 - Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training

AU - Wu, Chuhao

AU - Cha, Jackie

AU - Sulek, Jay

AU - Zhou, Tian

AU - Sundaram, Chandru P.

AU - Wachs, Juan

AU - Yu, Denny

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Objective: The aim of this study is to assess the relationship between eye-tracking measures and perceived workload in robotic surgical tasks. Background: Robotic techniques provide improved dexterity, stereoscopic vision, and ergonomic control system over laparoscopic surgery, but the complexity of the interfaces and operations may pose new challenges to surgeons and compromise patient safety. Limited studies have objectively quantified workload and its impact on performance in robotic surgery. Although not yet implemented in robotic surgery, minimally intrusive and continuous eye-tracking metrics have been shown to be sensitive to changes in workload in other domains. Methods: Eight surgical trainees participated in 15 robotic skills simulation sessions. In each session, participants performed up to 12 simulated exercises. Correlation and mixed-effects analyses were conducted to explore the relationships between eye-tracking metrics and perceived workload. Machine learning classifiers were used to determine the sensitivity of differentiating between low and high workload with eye-tracking features. Results: Gaze entropy increased as perceived workload increased, with a correlation of.51. Pupil diameter and gaze entropy distinguished differences in workload between task difficulty levels, and both metrics increased as task level difficulty increased. The classification model using eye-tracking features achieved an accuracy of 84.7% in predicting workload levels. Conclusion: Eye-tracking measures can detect perceived workload during robotic tasks. They can potentially be used to identify task contributors to high workload and provide measures for robotic surgery training. Application: Workload assessment can be used for real-time monitoring of workload in robotic surgical training and provide assessments for performance and learning.

AB - Objective: The aim of this study is to assess the relationship between eye-tracking measures and perceived workload in robotic surgical tasks. Background: Robotic techniques provide improved dexterity, stereoscopic vision, and ergonomic control system over laparoscopic surgery, but the complexity of the interfaces and operations may pose new challenges to surgeons and compromise patient safety. Limited studies have objectively quantified workload and its impact on performance in robotic surgery. Although not yet implemented in robotic surgery, minimally intrusive and continuous eye-tracking metrics have been shown to be sensitive to changes in workload in other domains. Methods: Eight surgical trainees participated in 15 robotic skills simulation sessions. In each session, participants performed up to 12 simulated exercises. Correlation and mixed-effects analyses were conducted to explore the relationships between eye-tracking metrics and perceived workload. Machine learning classifiers were used to determine the sensitivity of differentiating between low and high workload with eye-tracking features. Results: Gaze entropy increased as perceived workload increased, with a correlation of.51. Pupil diameter and gaze entropy distinguished differences in workload between task difficulty levels, and both metrics increased as task level difficulty increased. The classification model using eye-tracking features achieved an accuracy of 84.7% in predicting workload levels. Conclusion: Eye-tracking measures can detect perceived workload during robotic tasks. They can potentially be used to identify task contributors to high workload and provide measures for robotic surgery training. Application: Workload assessment can be used for real-time monitoring of workload in robotic surgical training and provide assessments for performance and learning.

KW - eye movements

KW - perceived workload

KW - robotics and telesurgery

KW - simulation training

KW - statistics and data analysis

UR - http://www.scopus.com/inward/record.url?scp=85074030741&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074030741&partnerID=8YFLogxK

U2 - 10.1177/0018720819874544

DO - 10.1177/0018720819874544

M3 - Article

AN - SCOPUS:85074030741

JO - Human Factors

JF - Human Factors

SN - 0018-7208

ER -