Comparative usability evaluation of consultation order templates in a simulated primary care environment

April Savoy, Himalaya Patel, Mindy E. Flanagan, Joanne Daggy, Alissa L. Russ, Michael Weiner

Research output: Contribution to journalArticle

Abstract

Communication breakdowns in the referral process negatively impact clinical workflow and patient safety. There is a lack of evidence demonstrating the impact of published design recommendations addressing contributing issues with consultation order templates. This study translated the recommendations into a computer-based prototype and conducted a comparative usability evaluation. With a scenario-based simulation, 30 clinicians (referrers) participated in a within-group, counterbalanced experiment comparing the prototype with their present electronic order entry system. The prototype significantly increased satisfaction (Cohen's d = 1.80, 95% CI [1.19, 2.41], p <.001), and required significantly less mental effort (d = 0.67 [0.14, 1.20], p <.001). Regarding efficiency, the prototype required significantly fewer mouse clicks (mean difference = 29 clicks, p <.001). Although overall task time did not differ significantly (d = −0.05 [−0.56, 0.47]), the prototype significantly quickened identification of the appropriate specialty clinic (mean difference = 12 s, d = 0.98 [0.43, 1.52], p <.001). The experimental evidence demonstrated that clinician-centered interfaces significantly improved system usability during ordering of consultations.

Original languageEnglish (US)
Pages (from-to)22-32
Number of pages11
JournalApplied Ergonomics
Volume73
DOIs
StatePublished - Nov 1 2018

Fingerprint

Primary Health Care
Referral and Consultation
Communication
workflow
evaluation
evidence
Workflow
Experiments
electronics
Patient Safety
scenario
efficiency
simulation
communication
lack
present
experiment
Group
time

Keywords

  • Communication and teamwork in health care
  • Health information technology
  • Mental workload
  • Outpatient care
  • Referrals
  • Usability/acceptance measurement and research

ASJC Scopus subject areas

  • Human Factors and Ergonomics
  • Physical Therapy, Sports Therapy and Rehabilitation
  • Safety, Risk, Reliability and Quality
  • Engineering (miscellaneous)

Cite this

Comparative usability evaluation of consultation order templates in a simulated primary care environment. / Savoy, April; Patel, Himalaya; Flanagan, Mindy E.; Daggy, Joanne; Russ, Alissa L.; Weiner, Michael.

In: Applied Ergonomics, Vol. 73, 01.11.2018, p. 22-32.

Research output: Contribution to journalArticle

Savoy, April ; Patel, Himalaya ; Flanagan, Mindy E. ; Daggy, Joanne ; Russ, Alissa L. ; Weiner, Michael. / Comparative usability evaluation of consultation order templates in a simulated primary care environment. In: Applied Ergonomics. 2018 ; Vol. 73. pp. 22-32.
@article{3dfb6aa88b834d7eb249bb10bbc6ee87,
title = "Comparative usability evaluation of consultation order templates in a simulated primary care environment",
abstract = "Communication breakdowns in the referral process negatively impact clinical workflow and patient safety. There is a lack of evidence demonstrating the impact of published design recommendations addressing contributing issues with consultation order templates. This study translated the recommendations into a computer-based prototype and conducted a comparative usability evaluation. With a scenario-based simulation, 30 clinicians (referrers) participated in a within-group, counterbalanced experiment comparing the prototype with their present electronic order entry system. The prototype significantly increased satisfaction (Cohen's d = 1.80, 95{\%} CI [1.19, 2.41], p <.001), and required significantly less mental effort (d = 0.67 [0.14, 1.20], p <.001). Regarding efficiency, the prototype required significantly fewer mouse clicks (mean difference = 29 clicks, p <.001). Although overall task time did not differ significantly (d = −0.05 [−0.56, 0.47]), the prototype significantly quickened identification of the appropriate specialty clinic (mean difference = 12 s, d = 0.98 [0.43, 1.52], p <.001). The experimental evidence demonstrated that clinician-centered interfaces significantly improved system usability during ordering of consultations.",
keywords = "Communication and teamwork in health care, Health information technology, Mental workload, Outpatient care, Referrals, Usability/acceptance measurement and research",
author = "April Savoy and Himalaya Patel and Flanagan, {Mindy E.} and Joanne Daggy and Russ, {Alissa L.} and Michael Weiner",
year = "2018",
month = "11",
day = "1",
doi = "10.1016/j.apergo.2018.05.013",
language = "English (US)",
volume = "73",
pages = "22--32",
journal = "Applied Ergonomics",
issn = "0003-6870",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Comparative usability evaluation of consultation order templates in a simulated primary care environment

AU - Savoy, April

AU - Patel, Himalaya

AU - Flanagan, Mindy E.

AU - Daggy, Joanne

AU - Russ, Alissa L.

AU - Weiner, Michael

PY - 2018/11/1

Y1 - 2018/11/1

N2 - Communication breakdowns in the referral process negatively impact clinical workflow and patient safety. There is a lack of evidence demonstrating the impact of published design recommendations addressing contributing issues with consultation order templates. This study translated the recommendations into a computer-based prototype and conducted a comparative usability evaluation. With a scenario-based simulation, 30 clinicians (referrers) participated in a within-group, counterbalanced experiment comparing the prototype with their present electronic order entry system. The prototype significantly increased satisfaction (Cohen's d = 1.80, 95% CI [1.19, 2.41], p <.001), and required significantly less mental effort (d = 0.67 [0.14, 1.20], p <.001). Regarding efficiency, the prototype required significantly fewer mouse clicks (mean difference = 29 clicks, p <.001). Although overall task time did not differ significantly (d = −0.05 [−0.56, 0.47]), the prototype significantly quickened identification of the appropriate specialty clinic (mean difference = 12 s, d = 0.98 [0.43, 1.52], p <.001). The experimental evidence demonstrated that clinician-centered interfaces significantly improved system usability during ordering of consultations.

AB - Communication breakdowns in the referral process negatively impact clinical workflow and patient safety. There is a lack of evidence demonstrating the impact of published design recommendations addressing contributing issues with consultation order templates. This study translated the recommendations into a computer-based prototype and conducted a comparative usability evaluation. With a scenario-based simulation, 30 clinicians (referrers) participated in a within-group, counterbalanced experiment comparing the prototype with their present electronic order entry system. The prototype significantly increased satisfaction (Cohen's d = 1.80, 95% CI [1.19, 2.41], p <.001), and required significantly less mental effort (d = 0.67 [0.14, 1.20], p <.001). Regarding efficiency, the prototype required significantly fewer mouse clicks (mean difference = 29 clicks, p <.001). Although overall task time did not differ significantly (d = −0.05 [−0.56, 0.47]), the prototype significantly quickened identification of the appropriate specialty clinic (mean difference = 12 s, d = 0.98 [0.43, 1.52], p <.001). The experimental evidence demonstrated that clinician-centered interfaces significantly improved system usability during ordering of consultations.

KW - Communication and teamwork in health care

KW - Health information technology

KW - Mental workload

KW - Outpatient care

KW - Referrals

KW - Usability/acceptance measurement and research

UR - http://www.scopus.com/inward/record.url?scp=85048584059&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85048584059&partnerID=8YFLogxK

U2 - 10.1016/j.apergo.2018.05.013

DO - 10.1016/j.apergo.2018.05.013

M3 - Article

C2 - 30098639

AN - SCOPUS:85048584059

VL - 73

SP - 22

EP - 32

JO - Applied Ergonomics

JF - Applied Ergonomics

SN - 0003-6870

ER -