An assessment of health care information and management systems society and Leapfrog data on computerized provider order entry

Mark L. Diana, Abby Swanson Kazley, Nir Menachemi

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Objective. To assess the internal consistency and agreement between the Health Care Information and Management Systems Society (HIMSS) and the Leapfrog computerized provider order entry (CPOE) data. Data Sources. Secondary hospital data collected by HIMSS Analytics, the Leapfrog Group, and the American Hospital Association from 2005 to 2007. Study Design. Dichotomous measures of full CPOE status were created for the HIMSS and Leapfrog datasets in each year. We assessed internal consistency by calculating the percent of full adopters in a given year that report full CPOE status in subsequent years. We assessed the level of agreement between the two datasets by calculating the κ statistic and McNemar's test. We examined responsiveness by assessing the change in full CPOE status rates, over time, reported by HIMSS and Leapfrog data, respectively. Principal Findings. Findings indicate minimal agreement between the two datasets regarding positive hospital CPOE status, but adequate agreement within a given dataset from year to year. Relative to each other, the HIMSS data tend to overestimate increases in full CPOE status over time, while the Leapfrog data may underestimate year over year increases in national CPOE status. Conclusions. Both Leapfrog and HIMSS data have strengths and weaknesses. Those interested in studying outcomes associated with CPOE use or adoption should be aware of the strengths and limitations of the Leapfrog and HIMSS datasets. Future development of a standard definition of CPOE status in hospitals will allow for a more comprehensive validation of these data.

Original languageEnglish (US)
Pages (from-to)1575-1591
Number of pages17
JournalHealth Services Research
Volume46
Issue number5
DOIs
StatePublished - Oct 1 2011
Externally publishedYes

Fingerprint

Medical Order Entry Systems
Health Information Management
Information Systems
Delivery of Health Care
American Hospital Association
Information Storage and Retrieval
Datasets

Keywords

  • Computerized provider order entry
  • HIMSS data
  • Leapfrog data
  • reliability
  • responsiveness
  • validity

ASJC Scopus subject areas

  • Health Policy

Cite this

An assessment of health care information and management systems society and Leapfrog data on computerized provider order entry. / Diana, Mark L.; Kazley, Abby Swanson; Menachemi, Nir.

In: Health Services Research, Vol. 46, No. 5, 01.10.2011, p. 1575-1591.

Research output: Contribution to journalArticle

@article{247e8b5d69b940d4b4cd3c96f479a38c,
title = "An assessment of health care information and management systems society and Leapfrog data on computerized provider order entry",
abstract = "Objective. To assess the internal consistency and agreement between the Health Care Information and Management Systems Society (HIMSS) and the Leapfrog computerized provider order entry (CPOE) data. Data Sources. Secondary hospital data collected by HIMSS Analytics, the Leapfrog Group, and the American Hospital Association from 2005 to 2007. Study Design. Dichotomous measures of full CPOE status were created for the HIMSS and Leapfrog datasets in each year. We assessed internal consistency by calculating the percent of full adopters in a given year that report full CPOE status in subsequent years. We assessed the level of agreement between the two datasets by calculating the κ statistic and McNemar's test. We examined responsiveness by assessing the change in full CPOE status rates, over time, reported by HIMSS and Leapfrog data, respectively. Principal Findings. Findings indicate minimal agreement between the two datasets regarding positive hospital CPOE status, but adequate agreement within a given dataset from year to year. Relative to each other, the HIMSS data tend to overestimate increases in full CPOE status over time, while the Leapfrog data may underestimate year over year increases in national CPOE status. Conclusions. Both Leapfrog and HIMSS data have strengths and weaknesses. Those interested in studying outcomes associated with CPOE use or adoption should be aware of the strengths and limitations of the Leapfrog and HIMSS datasets. Future development of a standard definition of CPOE status in hospitals will allow for a more comprehensive validation of these data.",
keywords = "Computerized provider order entry, HIMSS data, Leapfrog data, reliability, responsiveness, validity",
author = "Diana, {Mark L.} and Kazley, {Abby Swanson} and Nir Menachemi",
year = "2011",
month = "10",
day = "1",
doi = "10.1111/j.1475-6773.2011.01259.x",
language = "English (US)",
volume = "46",
pages = "1575--1591",
journal = "Health Services Research",
issn = "0017-9124",
publisher = "Wiley-Blackwell",
number = "5",

}

TY - JOUR

T1 - An assessment of health care information and management systems society and Leapfrog data on computerized provider order entry

AU - Diana, Mark L.

AU - Kazley, Abby Swanson

AU - Menachemi, Nir

PY - 2011/10/1

Y1 - 2011/10/1

N2 - Objective. To assess the internal consistency and agreement between the Health Care Information and Management Systems Society (HIMSS) and the Leapfrog computerized provider order entry (CPOE) data. Data Sources. Secondary hospital data collected by HIMSS Analytics, the Leapfrog Group, and the American Hospital Association from 2005 to 2007. Study Design. Dichotomous measures of full CPOE status were created for the HIMSS and Leapfrog datasets in each year. We assessed internal consistency by calculating the percent of full adopters in a given year that report full CPOE status in subsequent years. We assessed the level of agreement between the two datasets by calculating the κ statistic and McNemar's test. We examined responsiveness by assessing the change in full CPOE status rates, over time, reported by HIMSS and Leapfrog data, respectively. Principal Findings. Findings indicate minimal agreement between the two datasets regarding positive hospital CPOE status, but adequate agreement within a given dataset from year to year. Relative to each other, the HIMSS data tend to overestimate increases in full CPOE status over time, while the Leapfrog data may underestimate year over year increases in national CPOE status. Conclusions. Both Leapfrog and HIMSS data have strengths and weaknesses. Those interested in studying outcomes associated with CPOE use or adoption should be aware of the strengths and limitations of the Leapfrog and HIMSS datasets. Future development of a standard definition of CPOE status in hospitals will allow for a more comprehensive validation of these data.

AB - Objective. To assess the internal consistency and agreement between the Health Care Information and Management Systems Society (HIMSS) and the Leapfrog computerized provider order entry (CPOE) data. Data Sources. Secondary hospital data collected by HIMSS Analytics, the Leapfrog Group, and the American Hospital Association from 2005 to 2007. Study Design. Dichotomous measures of full CPOE status were created for the HIMSS and Leapfrog datasets in each year. We assessed internal consistency by calculating the percent of full adopters in a given year that report full CPOE status in subsequent years. We assessed the level of agreement between the two datasets by calculating the κ statistic and McNemar's test. We examined responsiveness by assessing the change in full CPOE status rates, over time, reported by HIMSS and Leapfrog data, respectively. Principal Findings. Findings indicate minimal agreement between the two datasets regarding positive hospital CPOE status, but adequate agreement within a given dataset from year to year. Relative to each other, the HIMSS data tend to overestimate increases in full CPOE status over time, while the Leapfrog data may underestimate year over year increases in national CPOE status. Conclusions. Both Leapfrog and HIMSS data have strengths and weaknesses. Those interested in studying outcomes associated with CPOE use or adoption should be aware of the strengths and limitations of the Leapfrog and HIMSS datasets. Future development of a standard definition of CPOE status in hospitals will allow for a more comprehensive validation of these data.

KW - Computerized provider order entry

KW - HIMSS data

KW - Leapfrog data

KW - reliability

KW - responsiveness

KW - validity

UR - http://www.scopus.com/inward/record.url?scp=80052518794&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052518794&partnerID=8YFLogxK

U2 - 10.1111/j.1475-6773.2011.01259.x

DO - 10.1111/j.1475-6773.2011.01259.x

M3 - Article

C2 - 21449956

AN - SCOPUS:80052518794

VL - 46

SP - 1575

EP - 1591

JO - Health Services Research

JF - Health Services Research

SN - 0017-9124

IS - 5

ER -