Lessons learned from implementing service-oriented clinical decision support at four sites: A qualitative study

Adam Wright, Dean F. Sittig, Joan S. Ash, Jessica L. Erickson, Trang T. Hickman, Marilyn Paterno, Eric Gebhardt, Carmit McMullen, Ruslana Tsurikova, Brian Dixon, Greg Fraser, Linas Simonaitis, Frank A. Sonnenberg, Blackford Middleton

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

Objective: To identify challenges, lessons learned and best practices for service-oriented clinical decision support, based on the results of the Clinical Decision Support Consortium, a multi-site study which developed, implemented and evaluated clinical decision support services in a diverse range of electronic health records. Methods: Ethnographic investigation using the rapid assessment process, a procedure for agile qualitative data collection and analysis, including clinical observation, system demonstrations and analysis and 91 interviews. Results: We identified challenges and lessons learned in eight dimensions: (1) hardware and software computing infrastructure, (2) clinical content, (3) human-computer interface, (4) people, (5) workflow and communication, (6) internal organizational policies, procedures, environment and culture, (7) external rules, regulations, and pressures and (8) system measurement and monitoring. Key challenges included performance issues (particularly related to data retrieval), differences in terminologies used across sites, workflow variability and the need for a legal framework. Discussion: Based on the challenges and lessons learned, we identified eight best practices for developers and implementers of service-oriented clinical decision support: (1) optimize performance, or make asynchronous calls, (2) be liberal in what you accept (particularly for terminology), (3) foster clinical transparency, (4) develop a legal framework, (5) support a flexible front-end, (6) dedicate human resources, (7) support peer-to-peer communication, (8) improve standards. Conclusion: The Clinical Decision Support Consortium successfully developed a clinical decision support service and implemented it in four different electronic health records and four diverse clinical sites; however, the process was arduous. The lessons identified by the Consortium may be useful for other developers and implementers of clinical decision support services.

Original languageEnglish (US)
Article number3233
Pages (from-to)901-911
Number of pages11
JournalInternational Journal of Medical Informatics
Volume84
Issue number11
DOIs
StatePublished - Nov 1 2015

Fingerprint

Clinical Decision Support Systems
Workflow
Electronic Health Records
Practice Guidelines
Terminology
Communication
Organizational Policy
Organizational Culture
Process Assessment (Health Care)
Information Storage and Retrieval
Software
Observation
Interviews
Pressure

Keywords

  • Clinical decision support systems
  • Computerized
  • Distributed systems
  • Electronic health records
  • Medical record systems
  • Service-oriented architecture

ASJC Scopus subject areas

  • Health Informatics

Cite this

Wright, A., Sittig, D. F., Ash, J. S., Erickson, J. L., Hickman, T. T., Paterno, M., ... Middleton, B. (2015). Lessons learned from implementing service-oriented clinical decision support at four sites: A qualitative study. International Journal of Medical Informatics, 84(11), 901-911. [3233]. https://doi.org/10.1016/j.ijmedinf.2015.08.008

Lessons learned from implementing service-oriented clinical decision support at four sites : A qualitative study. / Wright, Adam; Sittig, Dean F.; Ash, Joan S.; Erickson, Jessica L.; Hickman, Trang T.; Paterno, Marilyn; Gebhardt, Eric; McMullen, Carmit; Tsurikova, Ruslana; Dixon, Brian; Fraser, Greg; Simonaitis, Linas; Sonnenberg, Frank A.; Middleton, Blackford.

In: International Journal of Medical Informatics, Vol. 84, No. 11, 3233, 01.11.2015, p. 901-911.

Research output: Contribution to journalArticle

Wright, A, Sittig, DF, Ash, JS, Erickson, JL, Hickman, TT, Paterno, M, Gebhardt, E, McMullen, C, Tsurikova, R, Dixon, B, Fraser, G, Simonaitis, L, Sonnenberg, FA & Middleton, B 2015, 'Lessons learned from implementing service-oriented clinical decision support at four sites: A qualitative study', International Journal of Medical Informatics, vol. 84, no. 11, 3233, pp. 901-911. https://doi.org/10.1016/j.ijmedinf.2015.08.008
Wright, Adam ; Sittig, Dean F. ; Ash, Joan S. ; Erickson, Jessica L. ; Hickman, Trang T. ; Paterno, Marilyn ; Gebhardt, Eric ; McMullen, Carmit ; Tsurikova, Ruslana ; Dixon, Brian ; Fraser, Greg ; Simonaitis, Linas ; Sonnenberg, Frank A. ; Middleton, Blackford. / Lessons learned from implementing service-oriented clinical decision support at four sites : A qualitative study. In: International Journal of Medical Informatics. 2015 ; Vol. 84, No. 11. pp. 901-911.
@article{9a1aded6cc664c0785cb8368340e262d,
title = "Lessons learned from implementing service-oriented clinical decision support at four sites: A qualitative study",
abstract = "Objective: To identify challenges, lessons learned and best practices for service-oriented clinical decision support, based on the results of the Clinical Decision Support Consortium, a multi-site study which developed, implemented and evaluated clinical decision support services in a diverse range of electronic health records. Methods: Ethnographic investigation using the rapid assessment process, a procedure for agile qualitative data collection and analysis, including clinical observation, system demonstrations and analysis and 91 interviews. Results: We identified challenges and lessons learned in eight dimensions: (1) hardware and software computing infrastructure, (2) clinical content, (3) human-computer interface, (4) people, (5) workflow and communication, (6) internal organizational policies, procedures, environment and culture, (7) external rules, regulations, and pressures and (8) system measurement and monitoring. Key challenges included performance issues (particularly related to data retrieval), differences in terminologies used across sites, workflow variability and the need for a legal framework. Discussion: Based on the challenges and lessons learned, we identified eight best practices for developers and implementers of service-oriented clinical decision support: (1) optimize performance, or make asynchronous calls, (2) be liberal in what you accept (particularly for terminology), (3) foster clinical transparency, (4) develop a legal framework, (5) support a flexible front-end, (6) dedicate human resources, (7) support peer-to-peer communication, (8) improve standards. Conclusion: The Clinical Decision Support Consortium successfully developed a clinical decision support service and implemented it in four different electronic health records and four diverse clinical sites; however, the process was arduous. The lessons identified by the Consortium may be useful for other developers and implementers of clinical decision support services.",
keywords = "Clinical decision support systems, Computerized, Distributed systems, Electronic health records, Medical record systems, Service-oriented architecture",
author = "Adam Wright and Sittig, {Dean F.} and Ash, {Joan S.} and Erickson, {Jessica L.} and Hickman, {Trang T.} and Marilyn Paterno and Eric Gebhardt and Carmit McMullen and Ruslana Tsurikova and Brian Dixon and Greg Fraser and Linas Simonaitis and Sonnenberg, {Frank A.} and Blackford Middleton",
year = "2015",
month = "11",
day = "1",
doi = "10.1016/j.ijmedinf.2015.08.008",
language = "English (US)",
volume = "84",
pages = "901--911",
journal = "International Journal of Medical Informatics",
issn = "1386-5056",
publisher = "Elsevier Ireland Ltd",
number = "11",

}

TY - JOUR

T1 - Lessons learned from implementing service-oriented clinical decision support at four sites

T2 - A qualitative study

AU - Wright, Adam

AU - Sittig, Dean F.

AU - Ash, Joan S.

AU - Erickson, Jessica L.

AU - Hickman, Trang T.

AU - Paterno, Marilyn

AU - Gebhardt, Eric

AU - McMullen, Carmit

AU - Tsurikova, Ruslana

AU - Dixon, Brian

AU - Fraser, Greg

AU - Simonaitis, Linas

AU - Sonnenberg, Frank A.

AU - Middleton, Blackford

PY - 2015/11/1

Y1 - 2015/11/1

N2 - Objective: To identify challenges, lessons learned and best practices for service-oriented clinical decision support, based on the results of the Clinical Decision Support Consortium, a multi-site study which developed, implemented and evaluated clinical decision support services in a diverse range of electronic health records. Methods: Ethnographic investigation using the rapid assessment process, a procedure for agile qualitative data collection and analysis, including clinical observation, system demonstrations and analysis and 91 interviews. Results: We identified challenges and lessons learned in eight dimensions: (1) hardware and software computing infrastructure, (2) clinical content, (3) human-computer interface, (4) people, (5) workflow and communication, (6) internal organizational policies, procedures, environment and culture, (7) external rules, regulations, and pressures and (8) system measurement and monitoring. Key challenges included performance issues (particularly related to data retrieval), differences in terminologies used across sites, workflow variability and the need for a legal framework. Discussion: Based on the challenges and lessons learned, we identified eight best practices for developers and implementers of service-oriented clinical decision support: (1) optimize performance, or make asynchronous calls, (2) be liberal in what you accept (particularly for terminology), (3) foster clinical transparency, (4) develop a legal framework, (5) support a flexible front-end, (6) dedicate human resources, (7) support peer-to-peer communication, (8) improve standards. Conclusion: The Clinical Decision Support Consortium successfully developed a clinical decision support service and implemented it in four different electronic health records and four diverse clinical sites; however, the process was arduous. The lessons identified by the Consortium may be useful for other developers and implementers of clinical decision support services.

AB - Objective: To identify challenges, lessons learned and best practices for service-oriented clinical decision support, based on the results of the Clinical Decision Support Consortium, a multi-site study which developed, implemented and evaluated clinical decision support services in a diverse range of electronic health records. Methods: Ethnographic investigation using the rapid assessment process, a procedure for agile qualitative data collection and analysis, including clinical observation, system demonstrations and analysis and 91 interviews. Results: We identified challenges and lessons learned in eight dimensions: (1) hardware and software computing infrastructure, (2) clinical content, (3) human-computer interface, (4) people, (5) workflow and communication, (6) internal organizational policies, procedures, environment and culture, (7) external rules, regulations, and pressures and (8) system measurement and monitoring. Key challenges included performance issues (particularly related to data retrieval), differences in terminologies used across sites, workflow variability and the need for a legal framework. Discussion: Based on the challenges and lessons learned, we identified eight best practices for developers and implementers of service-oriented clinical decision support: (1) optimize performance, or make asynchronous calls, (2) be liberal in what you accept (particularly for terminology), (3) foster clinical transparency, (4) develop a legal framework, (5) support a flexible front-end, (6) dedicate human resources, (7) support peer-to-peer communication, (8) improve standards. Conclusion: The Clinical Decision Support Consortium successfully developed a clinical decision support service and implemented it in four different electronic health records and four diverse clinical sites; however, the process was arduous. The lessons identified by the Consortium may be useful for other developers and implementers of clinical decision support services.

KW - Clinical decision support systems

KW - Computerized

KW - Distributed systems

KW - Electronic health records

KW - Medical record systems

KW - Service-oriented architecture

UR - http://www.scopus.com/inward/record.url?scp=84942551476&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84942551476&partnerID=8YFLogxK

U2 - 10.1016/j.ijmedinf.2015.08.008

DO - 10.1016/j.ijmedinf.2015.08.008

M3 - Article

C2 - 26343972

AN - SCOPUS:84942551476

VL - 84

SP - 901

EP - 911

JO - International Journal of Medical Informatics

JF - International Journal of Medical Informatics

SN - 1386-5056

IS - 11

M1 - 3233

ER -