A six-year repeated evaluation of computerized clinical decision support system user acceptability

Randall W. Grout, Erika R. Cheng, Aaron Carroll, Nerissa Bauer, Stephen Downs

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Objective: Long-term acceptability among computerized clinical decision support system (CDSS) users in pediatrics is unknown. We examine user acceptance patterns over six years of our continuous computerized CDSS integration and updates. Materials and methods: Users of Child Health Improvement through Computer Automation (CHICA), a CDSS integrated into clinical workflows and used in several urban pediatric community clinics, completed annual surveys including 11 questions covering user acceptability. We compared responses across years within a single healthcare system and between two healthcare systems. We used logistic regression to assess the odds of a favorable response to each question by survey year, clinic role, part-time status, and frequency of CHICA use. Results: Data came from 380 completed surveys between 2011 and 2016. Responses were significantly more favorable for all but one measure by 2016 (OR range 2.90–12.17, all p < 0.01). Increasing system maturity was associated with improved perceived function of CHICA (OR range 4.24–7.58, p < 0.03). User familiarity was positively associated with perceived CDSS function (OR range 3.44–8.17, p < 0.05) and usability (OR range 9.71–15.89, p < 0.01) opinions. Conclusion: We present a long-term, repeated follow-up of user acceptability of a CDSS. Favorable opinions of the CDSS were more likely in frequent users, physicians and advanced practitioners, and full-time workers. CHICA acceptability increased as it matured and users become more familiar with it. System quality improvement, user support, and patience are important in achieving wide-ranging, sustainable acceptance of CDSS.

Original languageEnglish (US)
Pages (from-to)74-81
Number of pages8
JournalInternational Journal of Medical Informatics
Volume112
DOIs
StatePublished - Apr 1 2018

Fingerprint

Clinical Decision Support Systems
Automation
Pediatrics
Systems Integration
Delivery of Health Care
Workflow
Quality Improvement
Logistic Models
Physicians
Child Health

Keywords

  • Computerized decision support system
  • Decision support
  • Quality improvement
  • User acceptability
  • User satisfaction

ASJC Scopus subject areas

  • Health Informatics

Cite this

A six-year repeated evaluation of computerized clinical decision support system user acceptability. / Grout, Randall W.; Cheng, Erika R.; Carroll, Aaron; Bauer, Nerissa; Downs, Stephen.

In: International Journal of Medical Informatics, Vol. 112, 01.04.2018, p. 74-81.

Research output: Contribution to journalArticle

@article{6042e5adda2644ebbaa121ea8b8bb5dc,
title = "A six-year repeated evaluation of computerized clinical decision support system user acceptability",
abstract = "Objective: Long-term acceptability among computerized clinical decision support system (CDSS) users in pediatrics is unknown. We examine user acceptance patterns over six years of our continuous computerized CDSS integration and updates. Materials and methods: Users of Child Health Improvement through Computer Automation (CHICA), a CDSS integrated into clinical workflows and used in several urban pediatric community clinics, completed annual surveys including 11 questions covering user acceptability. We compared responses across years within a single healthcare system and between two healthcare systems. We used logistic regression to assess the odds of a favorable response to each question by survey year, clinic role, part-time status, and frequency of CHICA use. Results: Data came from 380 completed surveys between 2011 and 2016. Responses were significantly more favorable for all but one measure by 2016 (OR range 2.90–12.17, all p < 0.01). Increasing system maturity was associated with improved perceived function of CHICA (OR range 4.24–7.58, p < 0.03). User familiarity was positively associated with perceived CDSS function (OR range 3.44–8.17, p < 0.05) and usability (OR range 9.71–15.89, p < 0.01) opinions. Conclusion: We present a long-term, repeated follow-up of user acceptability of a CDSS. Favorable opinions of the CDSS were more likely in frequent users, physicians and advanced practitioners, and full-time workers. CHICA acceptability increased as it matured and users become more familiar with it. System quality improvement, user support, and patience are important in achieving wide-ranging, sustainable acceptance of CDSS.",
keywords = "Computerized decision support system, Decision support, Quality improvement, User acceptability, User satisfaction",
author = "Grout, {Randall W.} and Cheng, {Erika R.} and Aaron Carroll and Nerissa Bauer and Stephen Downs",
year = "2018",
month = "4",
day = "1",
doi = "10.1016/j.ijmedinf.2018.01.011",
language = "English (US)",
volume = "112",
pages = "74--81",
journal = "International Journal of Medical Informatics",
issn = "1386-5056",
publisher = "Elsevier Ireland Ltd",

}

TY - JOUR

T1 - A six-year repeated evaluation of computerized clinical decision support system user acceptability

AU - Grout, Randall W.

AU - Cheng, Erika R.

AU - Carroll, Aaron

AU - Bauer, Nerissa

AU - Downs, Stephen

PY - 2018/4/1

Y1 - 2018/4/1

N2 - Objective: Long-term acceptability among computerized clinical decision support system (CDSS) users in pediatrics is unknown. We examine user acceptance patterns over six years of our continuous computerized CDSS integration and updates. Materials and methods: Users of Child Health Improvement through Computer Automation (CHICA), a CDSS integrated into clinical workflows and used in several urban pediatric community clinics, completed annual surveys including 11 questions covering user acceptability. We compared responses across years within a single healthcare system and between two healthcare systems. We used logistic regression to assess the odds of a favorable response to each question by survey year, clinic role, part-time status, and frequency of CHICA use. Results: Data came from 380 completed surveys between 2011 and 2016. Responses were significantly more favorable for all but one measure by 2016 (OR range 2.90–12.17, all p < 0.01). Increasing system maturity was associated with improved perceived function of CHICA (OR range 4.24–7.58, p < 0.03). User familiarity was positively associated with perceived CDSS function (OR range 3.44–8.17, p < 0.05) and usability (OR range 9.71–15.89, p < 0.01) opinions. Conclusion: We present a long-term, repeated follow-up of user acceptability of a CDSS. Favorable opinions of the CDSS were more likely in frequent users, physicians and advanced practitioners, and full-time workers. CHICA acceptability increased as it matured and users become more familiar with it. System quality improvement, user support, and patience are important in achieving wide-ranging, sustainable acceptance of CDSS.

AB - Objective: Long-term acceptability among computerized clinical decision support system (CDSS) users in pediatrics is unknown. We examine user acceptance patterns over six years of our continuous computerized CDSS integration and updates. Materials and methods: Users of Child Health Improvement through Computer Automation (CHICA), a CDSS integrated into clinical workflows and used in several urban pediatric community clinics, completed annual surveys including 11 questions covering user acceptability. We compared responses across years within a single healthcare system and between two healthcare systems. We used logistic regression to assess the odds of a favorable response to each question by survey year, clinic role, part-time status, and frequency of CHICA use. Results: Data came from 380 completed surveys between 2011 and 2016. Responses were significantly more favorable for all but one measure by 2016 (OR range 2.90–12.17, all p < 0.01). Increasing system maturity was associated with improved perceived function of CHICA (OR range 4.24–7.58, p < 0.03). User familiarity was positively associated with perceived CDSS function (OR range 3.44–8.17, p < 0.05) and usability (OR range 9.71–15.89, p < 0.01) opinions. Conclusion: We present a long-term, repeated follow-up of user acceptability of a CDSS. Favorable opinions of the CDSS were more likely in frequent users, physicians and advanced practitioners, and full-time workers. CHICA acceptability increased as it matured and users become more familiar with it. System quality improvement, user support, and patience are important in achieving wide-ranging, sustainable acceptance of CDSS.

KW - Computerized decision support system

KW - Decision support

KW - Quality improvement

KW - User acceptability

KW - User satisfaction

UR - http://www.scopus.com/inward/record.url?scp=85041381577&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85041381577&partnerID=8YFLogxK

U2 - 10.1016/j.ijmedinf.2018.01.011

DO - 10.1016/j.ijmedinf.2018.01.011

M3 - Article

C2 - 29500025

AN - SCOPUS:85041381577

VL - 112

SP - 74

EP - 81

JO - International Journal of Medical Informatics

JF - International Journal of Medical Informatics

SN - 1386-5056

ER -