Clinical information technology capabilities in four U.S. hospitals: Testing a new structural performance measure

Ruben Amarasingham, Marie Diener-West, Michael Weiner, Harold Lehmann, Jerome E. Herbers, Neil R. Powe

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Background: Few tools exist to quantify the performance of a hospital's information system from a user perspective. Objectives: Our objective was to develop and evaluate a survey-based metric that assesses the automation and usability of a hospital's information system. Research Design and Methods: This is a cross-sectional study of 117 physicians and 3 chief information officers (CIOs) working in 2 community hospitals with historically low investment in IT (Hospitals A and B), an academic hospital with an advanced IT system (Hospital C), or a major Veterans Affairs hospital (Hospital D). Respondents completed a survey assessing their institution's information system. The mean of 90 summed responses yields the clinical information technology (CIT) index, a global measure of a hospital's information system performance on a 100-point scale. Results: On the global CIT index, mean physician scores were significantly higher for hospitals with advanced IT (61.1 and 64.3 for C and D) compared with those with low investment in IT (32.6 and 29.4 for A and B, P < 0.001). These differences also were observed for each of 7 separate subdomains. The CIO scores, 74.7, 78.0 for Hospitals C and D, and 44.5 for Hospitals A and B, paralleled the mean physician scores for these hospitals. All measures exhibited low variance for each hospital (eg, standard deviations for the CIT index ranged from 5.9 to 8.1) and intraclass correlation was high (Chronbach's alpha >.70). Conclusions: This assessment tool demonstrates initial evidence of validity and reliability.

Original languageEnglish
Pages (from-to)216-224
Number of pages9
JournalMedical Care
Volume44
Issue number3
DOIs
StatePublished - Mar 2006

Fingerprint

Hospital Information Systems
information technology
Technology
performance
information system
Physicians
Veterans Hospitals
Automation
Community Hospital
Information Systems
Reproducibility of Results
physician
Research Design
Cross-Sectional Studies
hospital system
automation
cross-sectional study
research planning
research method
Surveys and Questionnaires

Keywords

  • Hospitals
  • Information technology
  • Performance measurement
  • Quality of care

ASJC Scopus subject areas

  • Nursing(all)
  • Public Health, Environmental and Occupational Health
  • Health(social science)
  • Health Professions(all)

Cite this

Clinical information technology capabilities in four U.S. hospitals : Testing a new structural performance measure. / Amarasingham, Ruben; Diener-West, Marie; Weiner, Michael; Lehmann, Harold; Herbers, Jerome E.; Powe, Neil R.

In: Medical Care, Vol. 44, No. 3, 03.2006, p. 216-224.

Research output: Contribution to journalArticle

Amarasingham, Ruben ; Diener-West, Marie ; Weiner, Michael ; Lehmann, Harold ; Herbers, Jerome E. ; Powe, Neil R. / Clinical information technology capabilities in four U.S. hospitals : Testing a new structural performance measure. In: Medical Care. 2006 ; Vol. 44, No. 3. pp. 216-224.
@article{132038dd8b0c42cc981b01c817b9fee0,
title = "Clinical information technology capabilities in four U.S. hospitals: Testing a new structural performance measure",
abstract = "Background: Few tools exist to quantify the performance of a hospital's information system from a user perspective. Objectives: Our objective was to develop and evaluate a survey-based metric that assesses the automation and usability of a hospital's information system. Research Design and Methods: This is a cross-sectional study of 117 physicians and 3 chief information officers (CIOs) working in 2 community hospitals with historically low investment in IT (Hospitals A and B), an academic hospital with an advanced IT system (Hospital C), or a major Veterans Affairs hospital (Hospital D). Respondents completed a survey assessing their institution's information system. The mean of 90 summed responses yields the clinical information technology (CIT) index, a global measure of a hospital's information system performance on a 100-point scale. Results: On the global CIT index, mean physician scores were significantly higher for hospitals with advanced IT (61.1 and 64.3 for C and D) compared with those with low investment in IT (32.6 and 29.4 for A and B, P < 0.001). These differences also were observed for each of 7 separate subdomains. The CIO scores, 74.7, 78.0 for Hospitals C and D, and 44.5 for Hospitals A and B, paralleled the mean physician scores for these hospitals. All measures exhibited low variance for each hospital (eg, standard deviations for the CIT index ranged from 5.9 to 8.1) and intraclass correlation was high (Chronbach's alpha >.70). Conclusions: This assessment tool demonstrates initial evidence of validity and reliability.",
keywords = "Hospitals, Information technology, Performance measurement, Quality of care",
author = "Ruben Amarasingham and Marie Diener-West and Michael Weiner and Harold Lehmann and Herbers, {Jerome E.} and Powe, {Neil R.}",
year = "2006",
month = "3",
doi = "10.1097/01.mlr.0000199648.06513.22",
language = "English",
volume = "44",
pages = "216--224",
journal = "Medical Care",
issn = "0025-7079",
publisher = "Lippincott Williams and Wilkins",
number = "3",

}

TY - JOUR

T1 - Clinical information technology capabilities in four U.S. hospitals

T2 - Testing a new structural performance measure

AU - Amarasingham, Ruben

AU - Diener-West, Marie

AU - Weiner, Michael

AU - Lehmann, Harold

AU - Herbers, Jerome E.

AU - Powe, Neil R.

PY - 2006/3

Y1 - 2006/3

N2 - Background: Few tools exist to quantify the performance of a hospital's information system from a user perspective. Objectives: Our objective was to develop and evaluate a survey-based metric that assesses the automation and usability of a hospital's information system. Research Design and Methods: This is a cross-sectional study of 117 physicians and 3 chief information officers (CIOs) working in 2 community hospitals with historically low investment in IT (Hospitals A and B), an academic hospital with an advanced IT system (Hospital C), or a major Veterans Affairs hospital (Hospital D). Respondents completed a survey assessing their institution's information system. The mean of 90 summed responses yields the clinical information technology (CIT) index, a global measure of a hospital's information system performance on a 100-point scale. Results: On the global CIT index, mean physician scores were significantly higher for hospitals with advanced IT (61.1 and 64.3 for C and D) compared with those with low investment in IT (32.6 and 29.4 for A and B, P < 0.001). These differences also were observed for each of 7 separate subdomains. The CIO scores, 74.7, 78.0 for Hospitals C and D, and 44.5 for Hospitals A and B, paralleled the mean physician scores for these hospitals. All measures exhibited low variance for each hospital (eg, standard deviations for the CIT index ranged from 5.9 to 8.1) and intraclass correlation was high (Chronbach's alpha >.70). Conclusions: This assessment tool demonstrates initial evidence of validity and reliability.

AB - Background: Few tools exist to quantify the performance of a hospital's information system from a user perspective. Objectives: Our objective was to develop and evaluate a survey-based metric that assesses the automation and usability of a hospital's information system. Research Design and Methods: This is a cross-sectional study of 117 physicians and 3 chief information officers (CIOs) working in 2 community hospitals with historically low investment in IT (Hospitals A and B), an academic hospital with an advanced IT system (Hospital C), or a major Veterans Affairs hospital (Hospital D). Respondents completed a survey assessing their institution's information system. The mean of 90 summed responses yields the clinical information technology (CIT) index, a global measure of a hospital's information system performance on a 100-point scale. Results: On the global CIT index, mean physician scores were significantly higher for hospitals with advanced IT (61.1 and 64.3 for C and D) compared with those with low investment in IT (32.6 and 29.4 for A and B, P < 0.001). These differences also were observed for each of 7 separate subdomains. The CIO scores, 74.7, 78.0 for Hospitals C and D, and 44.5 for Hospitals A and B, paralleled the mean physician scores for these hospitals. All measures exhibited low variance for each hospital (eg, standard deviations for the CIT index ranged from 5.9 to 8.1) and intraclass correlation was high (Chronbach's alpha >.70). Conclusions: This assessment tool demonstrates initial evidence of validity and reliability.

KW - Hospitals

KW - Information technology

KW - Performance measurement

KW - Quality of care

UR - http://www.scopus.com/inward/record.url?scp=33645233502&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33645233502&partnerID=8YFLogxK

U2 - 10.1097/01.mlr.0000199648.06513.22

DO - 10.1097/01.mlr.0000199648.06513.22

M3 - Article

C2 - 16501392

AN - SCOPUS:33645233502

VL - 44

SP - 216

EP - 224

JO - Medical Care

JF - Medical Care

SN - 0025-7079

IS - 3

ER -