Development and validation of electronic quality measures to assess care for patients with transient ischemic attack and minor ischemic stroke

Dawn Bravata, Laura J. Myers, Eric Cheng, Mathew Reeves, Fitsum Baye, Zhangsheng Yu, Teresa Damush, Edward Miech, Jason Sico, Michael Phipps, Alan Zillich, Jason Johanning, Seemant Chaturvedi, Curt Austin, Jared Ferguson, Bailey Maryfield, Kathy Snow, Susan Ofner, Glenn Graham, Rachel RhudeLinda Williams, Gregory Arling

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Background-Despite interest in using electronic health record (EHR) data to assess quality of care, the accuracy of such data is largely unknown. We sought to develop and validate transient ischemic attack and minor ischemic stroke electronic quality measures (eQMs) using EHR data. Methods and Results-A random sample of patients with transient ischemic attack or minor ischemic stroke, cared for in Veterans Health Administration facilities (fiscal year 2011), was identified. We constructed 31 eQMs based on existing quality measures. Chart review was the criterion standard for validating the eQMs. To evaluate eQMs in terms of eligibility, we calculated the proportion of patients who were genuinely not eligible to receive a process (based on chart review) and who were correctly identified as not eligible by the EHR data (specificity). To assess eQMs about classification of whether patients received a process, we calculated the proportion of patients who actually received the process (based on chart review) and who were classified correctly by the EHR data as passing (sensitivity). Seven hundred sixty-Three patients were included. About eligibility, specificity varied from 25% (brain imaging; carotid imaging) to 99% (anticoagulation quality). About pass rates, sensitivity varied from 30% (antihypertensive class) to 100% (coronary risk assessment; international normalized ratio measured). The 16 eQMs with ≥70% specificity in eligibility and ≥70% sensitivity in pass rates included coronary risk assessment, international normalized ratio measured, HbA1c measurement, speech language pathology consultation, anticoagulation for atrial fibrillation, discharge on statin, lipid management, neurology consultation, Holter, deep vein thrombosis prophylaxis, oral hypoglycemic intensification, cholesterol medication intensification, antihypertensive intensification, antihypertensive class, carotid stenosis intervention, and substance abuse referral for alcohol. Conclusions-It is feasible to construct valid eQMs for processes of transient ischemic attack and minor ischemic stroke care. Healthcare systems with EHRs should consider using electronic data to evaluate care for their patients with transient ischemic attack and to complement and expand quality measurement programs currently focused on patients with stroke.

Original languageEnglish (US)
Article numbere003157
JournalCirculation: Cardiovascular Quality and Outcomes
Volume10
Issue number9
DOIs
StatePublished - Jun 1 2017
Externally publishedYes

Fingerprint

Transient Ischemic Attack
Patient Care
Electronic Health Records
Stroke
Antihypertensive Agents
International Normalized Ratio
Referral and Consultation
Speech-Language Pathology
Veterans Health
Hydroxymethylglutaryl-CoA Reductase Inhibitors
United States Department of Veterans Affairs
Process Assessment (Health Care)
Quality of Health Care
Carotid Stenosis
Health Facilities
Neurology
Hypoglycemic Agents
Neuroimaging
Venous Thrombosis
Atrial Fibrillation

Keywords

  • electronic health records
  • Ischemic attack
  • Sensitivity and specificity
  • Stroke
  • Transient

ASJC Scopus subject areas

  • Cardiology and Cardiovascular Medicine

Cite this

Development and validation of electronic quality measures to assess care for patients with transient ischemic attack and minor ischemic stroke. / Bravata, Dawn; Myers, Laura J.; Cheng, Eric; Reeves, Mathew; Baye, Fitsum; Yu, Zhangsheng; Damush, Teresa; Miech, Edward; Sico, Jason; Phipps, Michael; Zillich, Alan; Johanning, Jason; Chaturvedi, Seemant; Austin, Curt; Ferguson, Jared; Maryfield, Bailey; Snow, Kathy; Ofner, Susan; Graham, Glenn; Rhude, Rachel; Williams, Linda; Arling, Gregory.

In: Circulation: Cardiovascular Quality and Outcomes, Vol. 10, No. 9, e003157, 01.06.2017.

Research output: Contribution to journalArticle

Bravata, D, Myers, LJ, Cheng, E, Reeves, M, Baye, F, Yu, Z, Damush, T, Miech, E, Sico, J, Phipps, M, Zillich, A, Johanning, J, Chaturvedi, S, Austin, C, Ferguson, J, Maryfield, B, Snow, K, Ofner, S, Graham, G, Rhude, R, Williams, L & Arling, G 2017, 'Development and validation of electronic quality measures to assess care for patients with transient ischemic attack and minor ischemic stroke', Circulation: Cardiovascular Quality and Outcomes, vol. 10, no. 9, e003157. https://doi.org/10.1161/CIRCOUTCOMES.116.003157
Bravata, Dawn ; Myers, Laura J. ; Cheng, Eric ; Reeves, Mathew ; Baye, Fitsum ; Yu, Zhangsheng ; Damush, Teresa ; Miech, Edward ; Sico, Jason ; Phipps, Michael ; Zillich, Alan ; Johanning, Jason ; Chaturvedi, Seemant ; Austin, Curt ; Ferguson, Jared ; Maryfield, Bailey ; Snow, Kathy ; Ofner, Susan ; Graham, Glenn ; Rhude, Rachel ; Williams, Linda ; Arling, Gregory. / Development and validation of electronic quality measures to assess care for patients with transient ischemic attack and minor ischemic stroke. In: Circulation: Cardiovascular Quality and Outcomes. 2017 ; Vol. 10, No. 9.
@article{b748882763cd48c5a8ad87ec6c901b87,
title = "Development and validation of electronic quality measures to assess care for patients with transient ischemic attack and minor ischemic stroke",
abstract = "Background-Despite interest in using electronic health record (EHR) data to assess quality of care, the accuracy of such data is largely unknown. We sought to develop and validate transient ischemic attack and minor ischemic stroke electronic quality measures (eQMs) using EHR data. Methods and Results-A random sample of patients with transient ischemic attack or minor ischemic stroke, cared for in Veterans Health Administration facilities (fiscal year 2011), was identified. We constructed 31 eQMs based on existing quality measures. Chart review was the criterion standard for validating the eQMs. To evaluate eQMs in terms of eligibility, we calculated the proportion of patients who were genuinely not eligible to receive a process (based on chart review) and who were correctly identified as not eligible by the EHR data (specificity). To assess eQMs about classification of whether patients received a process, we calculated the proportion of patients who actually received the process (based on chart review) and who were classified correctly by the EHR data as passing (sensitivity). Seven hundred sixty-Three patients were included. About eligibility, specificity varied from 25{\%} (brain imaging; carotid imaging) to 99{\%} (anticoagulation quality). About pass rates, sensitivity varied from 30{\%} (antihypertensive class) to 100{\%} (coronary risk assessment; international normalized ratio measured). The 16 eQMs with ≥70{\%} specificity in eligibility and ≥70{\%} sensitivity in pass rates included coronary risk assessment, international normalized ratio measured, HbA1c measurement, speech language pathology consultation, anticoagulation for atrial fibrillation, discharge on statin, lipid management, neurology consultation, Holter, deep vein thrombosis prophylaxis, oral hypoglycemic intensification, cholesterol medication intensification, antihypertensive intensification, antihypertensive class, carotid stenosis intervention, and substance abuse referral for alcohol. Conclusions-It is feasible to construct valid eQMs for processes of transient ischemic attack and minor ischemic stroke care. Healthcare systems with EHRs should consider using electronic data to evaluate care for their patients with transient ischemic attack and to complement and expand quality measurement programs currently focused on patients with stroke.",
keywords = "electronic health records, Ischemic attack, Sensitivity and specificity, Stroke, Transient",
author = "Dawn Bravata and Myers, {Laura J.} and Eric Cheng and Mathew Reeves and Fitsum Baye and Zhangsheng Yu and Teresa Damush and Edward Miech and Jason Sico and Michael Phipps and Alan Zillich and Jason Johanning and Seemant Chaturvedi and Curt Austin and Jared Ferguson and Bailey Maryfield and Kathy Snow and Susan Ofner and Glenn Graham and Rachel Rhude and Linda Williams and Gregory Arling",
year = "2017",
month = "6",
day = "1",
doi = "10.1161/CIRCOUTCOMES.116.003157",
language = "English (US)",
volume = "10",
journal = "Circulation: Cardiovascular Quality and Outcomes",
issn = "1941-7713",
publisher = "Lippincott Williams and Wilkins",
number = "9",

}

TY - JOUR

T1 - Development and validation of electronic quality measures to assess care for patients with transient ischemic attack and minor ischemic stroke

AU - Bravata, Dawn

AU - Myers, Laura J.

AU - Cheng, Eric

AU - Reeves, Mathew

AU - Baye, Fitsum

AU - Yu, Zhangsheng

AU - Damush, Teresa

AU - Miech, Edward

AU - Sico, Jason

AU - Phipps, Michael

AU - Zillich, Alan

AU - Johanning, Jason

AU - Chaturvedi, Seemant

AU - Austin, Curt

AU - Ferguson, Jared

AU - Maryfield, Bailey

AU - Snow, Kathy

AU - Ofner, Susan

AU - Graham, Glenn

AU - Rhude, Rachel

AU - Williams, Linda

AU - Arling, Gregory

PY - 2017/6/1

Y1 - 2017/6/1

N2 - Background-Despite interest in using electronic health record (EHR) data to assess quality of care, the accuracy of such data is largely unknown. We sought to develop and validate transient ischemic attack and minor ischemic stroke electronic quality measures (eQMs) using EHR data. Methods and Results-A random sample of patients with transient ischemic attack or minor ischemic stroke, cared for in Veterans Health Administration facilities (fiscal year 2011), was identified. We constructed 31 eQMs based on existing quality measures. Chart review was the criterion standard for validating the eQMs. To evaluate eQMs in terms of eligibility, we calculated the proportion of patients who were genuinely not eligible to receive a process (based on chart review) and who were correctly identified as not eligible by the EHR data (specificity). To assess eQMs about classification of whether patients received a process, we calculated the proportion of patients who actually received the process (based on chart review) and who were classified correctly by the EHR data as passing (sensitivity). Seven hundred sixty-Three patients were included. About eligibility, specificity varied from 25% (brain imaging; carotid imaging) to 99% (anticoagulation quality). About pass rates, sensitivity varied from 30% (antihypertensive class) to 100% (coronary risk assessment; international normalized ratio measured). The 16 eQMs with ≥70% specificity in eligibility and ≥70% sensitivity in pass rates included coronary risk assessment, international normalized ratio measured, HbA1c measurement, speech language pathology consultation, anticoagulation for atrial fibrillation, discharge on statin, lipid management, neurology consultation, Holter, deep vein thrombosis prophylaxis, oral hypoglycemic intensification, cholesterol medication intensification, antihypertensive intensification, antihypertensive class, carotid stenosis intervention, and substance abuse referral for alcohol. Conclusions-It is feasible to construct valid eQMs for processes of transient ischemic attack and minor ischemic stroke care. Healthcare systems with EHRs should consider using electronic data to evaluate care for their patients with transient ischemic attack and to complement and expand quality measurement programs currently focused on patients with stroke.

AB - Background-Despite interest in using electronic health record (EHR) data to assess quality of care, the accuracy of such data is largely unknown. We sought to develop and validate transient ischemic attack and minor ischemic stroke electronic quality measures (eQMs) using EHR data. Methods and Results-A random sample of patients with transient ischemic attack or minor ischemic stroke, cared for in Veterans Health Administration facilities (fiscal year 2011), was identified. We constructed 31 eQMs based on existing quality measures. Chart review was the criterion standard for validating the eQMs. To evaluate eQMs in terms of eligibility, we calculated the proportion of patients who were genuinely not eligible to receive a process (based on chart review) and who were correctly identified as not eligible by the EHR data (specificity). To assess eQMs about classification of whether patients received a process, we calculated the proportion of patients who actually received the process (based on chart review) and who were classified correctly by the EHR data as passing (sensitivity). Seven hundred sixty-Three patients were included. About eligibility, specificity varied from 25% (brain imaging; carotid imaging) to 99% (anticoagulation quality). About pass rates, sensitivity varied from 30% (antihypertensive class) to 100% (coronary risk assessment; international normalized ratio measured). The 16 eQMs with ≥70% specificity in eligibility and ≥70% sensitivity in pass rates included coronary risk assessment, international normalized ratio measured, HbA1c measurement, speech language pathology consultation, anticoagulation for atrial fibrillation, discharge on statin, lipid management, neurology consultation, Holter, deep vein thrombosis prophylaxis, oral hypoglycemic intensification, cholesterol medication intensification, antihypertensive intensification, antihypertensive class, carotid stenosis intervention, and substance abuse referral for alcohol. Conclusions-It is feasible to construct valid eQMs for processes of transient ischemic attack and minor ischemic stroke care. Healthcare systems with EHRs should consider using electronic data to evaluate care for their patients with transient ischemic attack and to complement and expand quality measurement programs currently focused on patients with stroke.

KW - electronic health records

KW - Ischemic attack

KW - Sensitivity and specificity

KW - Stroke

KW - Transient

UR - http://www.scopus.com/inward/record.url?scp=85032196276&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85032196276&partnerID=8YFLogxK

U2 - 10.1161/CIRCOUTCOMES.116.003157

DO - 10.1161/CIRCOUTCOMES.116.003157

M3 - Article

C2 - 28912200

AN - SCOPUS:85032196276

VL - 10

JO - Circulation: Cardiovascular Quality and Outcomes

JF - Circulation: Cardiovascular Quality and Outcomes

SN - 1941-7713

IS - 9

M1 - e003157

ER -