Retrospective assessment of initial stroke severity with the NIH stroke scale

Linda Williams, Engin Y. Yilmaz, Alfredo M. Lopez-Yunez

Research output: Contribution to journalArticle

266 Citations (Scopus)

Abstract

Background and Purpose - It is important to adjust stroke outcomes for differences in initial stroke severity. The NIH Stroke Scale (NIHSS) is a commonly used stroke severity measure but has been validated for retrospective scoring only in a subset of stroke clinical trial participants. The purpose of this research was to assess the validity and reliability of an algorithm for retrospective NIHSS scoring in a setting with usual chart documentation. Methods - An algorithm for retrospective NIHSS scoring was developed with written history and physical admission notes. Missing physical examination data were scored as normal. One investigator prospectively scored the admission NIHSS in 32 consecutive stroke patients. Two raters retrospectively scored the NIHSS by applying the algorithm to photocopied admission notes. Linear regression was used to assess interrater reliability and agreement between prospective and retrospective NIHSS scores. The Wilcoxon signed rank test was used to assess systematic scoring bias. Weighted kappa statistics were calculated to assess the level of agreement of individual NIHSS items. Results - Only 1 admission note was complete for all NIHSS elements. Interrater reliability was near perfect (r2=0.98, P<0.001). Agreement between prospective and retrospective NIHSS score was also excellent (r2=0.94, P<0.001) and there was no systematic bias in retrospective scores. Agreement for individual items was moderate to high for all items except level of consciousness. Conclusions - Retrospective NIHSS scoring with the algorithm is reliable and unbiased even when physical examination elements are missing from the written record. Stroke research using retrospective review of charts or of administrative databases should adjust for differences in stroke severity using such an algorithm.

Original languageEnglish
Pages (from-to)858-862
Number of pages5
JournalStroke
Volume31
Issue number4
StatePublished - Apr 2000

Fingerprint

Stroke
Physical Examination
Nonparametric Statistics
Consciousness
Research
Reproducibility of Results
Documentation
Linear Models
History
Research Personnel
Clinical Trials
Databases

Keywords

  • Outcome
  • Prognosis
  • Stroke assessment

ASJC Scopus subject areas

  • Cardiology and Cardiovascular Medicine
  • Neuroscience(all)

Cite this

Williams, L., Yilmaz, E. Y., & Lopez-Yunez, A. M. (2000). Retrospective assessment of initial stroke severity with the NIH stroke scale. Stroke, 31(4), 858-862.

Retrospective assessment of initial stroke severity with the NIH stroke scale. / Williams, Linda; Yilmaz, Engin Y.; Lopez-Yunez, Alfredo M.

In: Stroke, Vol. 31, No. 4, 04.2000, p. 858-862.

Research output: Contribution to journalArticle

Williams, L, Yilmaz, EY & Lopez-Yunez, AM 2000, 'Retrospective assessment of initial stroke severity with the NIH stroke scale', Stroke, vol. 31, no. 4, pp. 858-862.
Williams, Linda ; Yilmaz, Engin Y. ; Lopez-Yunez, Alfredo M. / Retrospective assessment of initial stroke severity with the NIH stroke scale. In: Stroke. 2000 ; Vol. 31, No. 4. pp. 858-862.
@article{90b2e7835bf645228966cbc331c51627,
title = "Retrospective assessment of initial stroke severity with the NIH stroke scale",
abstract = "Background and Purpose - It is important to adjust stroke outcomes for differences in initial stroke severity. The NIH Stroke Scale (NIHSS) is a commonly used stroke severity measure but has been validated for retrospective scoring only in a subset of stroke clinical trial participants. The purpose of this research was to assess the validity and reliability of an algorithm for retrospective NIHSS scoring in a setting with usual chart documentation. Methods - An algorithm for retrospective NIHSS scoring was developed with written history and physical admission notes. Missing physical examination data were scored as normal. One investigator prospectively scored the admission NIHSS in 32 consecutive stroke patients. Two raters retrospectively scored the NIHSS by applying the algorithm to photocopied admission notes. Linear regression was used to assess interrater reliability and agreement between prospective and retrospective NIHSS scores. The Wilcoxon signed rank test was used to assess systematic scoring bias. Weighted kappa statistics were calculated to assess the level of agreement of individual NIHSS items. Results - Only 1 admission note was complete for all NIHSS elements. Interrater reliability was near perfect (r2=0.98, P<0.001). Agreement between prospective and retrospective NIHSS score was also excellent (r2=0.94, P<0.001) and there was no systematic bias in retrospective scores. Agreement for individual items was moderate to high for all items except level of consciousness. Conclusions - Retrospective NIHSS scoring with the algorithm is reliable and unbiased even when physical examination elements are missing from the written record. Stroke research using retrospective review of charts or of administrative databases should adjust for differences in stroke severity using such an algorithm.",
keywords = "Outcome, Prognosis, Stroke assessment",
author = "Linda Williams and Yilmaz, {Engin Y.} and Lopez-Yunez, {Alfredo M.}",
year = "2000",
month = "4",
language = "English",
volume = "31",
pages = "858--862",
journal = "Stroke",
issn = "0039-2499",
publisher = "Lippincott Williams and Wilkins",
number = "4",

}

TY - JOUR

T1 - Retrospective assessment of initial stroke severity with the NIH stroke scale

AU - Williams, Linda

AU - Yilmaz, Engin Y.

AU - Lopez-Yunez, Alfredo M.

PY - 2000/4

Y1 - 2000/4

N2 - Background and Purpose - It is important to adjust stroke outcomes for differences in initial stroke severity. The NIH Stroke Scale (NIHSS) is a commonly used stroke severity measure but has been validated for retrospective scoring only in a subset of stroke clinical trial participants. The purpose of this research was to assess the validity and reliability of an algorithm for retrospective NIHSS scoring in a setting with usual chart documentation. Methods - An algorithm for retrospective NIHSS scoring was developed with written history and physical admission notes. Missing physical examination data were scored as normal. One investigator prospectively scored the admission NIHSS in 32 consecutive stroke patients. Two raters retrospectively scored the NIHSS by applying the algorithm to photocopied admission notes. Linear regression was used to assess interrater reliability and agreement between prospective and retrospective NIHSS scores. The Wilcoxon signed rank test was used to assess systematic scoring bias. Weighted kappa statistics were calculated to assess the level of agreement of individual NIHSS items. Results - Only 1 admission note was complete for all NIHSS elements. Interrater reliability was near perfect (r2=0.98, P<0.001). Agreement between prospective and retrospective NIHSS score was also excellent (r2=0.94, P<0.001) and there was no systematic bias in retrospective scores. Agreement for individual items was moderate to high for all items except level of consciousness. Conclusions - Retrospective NIHSS scoring with the algorithm is reliable and unbiased even when physical examination elements are missing from the written record. Stroke research using retrospective review of charts or of administrative databases should adjust for differences in stroke severity using such an algorithm.

AB - Background and Purpose - It is important to adjust stroke outcomes for differences in initial stroke severity. The NIH Stroke Scale (NIHSS) is a commonly used stroke severity measure but has been validated for retrospective scoring only in a subset of stroke clinical trial participants. The purpose of this research was to assess the validity and reliability of an algorithm for retrospective NIHSS scoring in a setting with usual chart documentation. Methods - An algorithm for retrospective NIHSS scoring was developed with written history and physical admission notes. Missing physical examination data were scored as normal. One investigator prospectively scored the admission NIHSS in 32 consecutive stroke patients. Two raters retrospectively scored the NIHSS by applying the algorithm to photocopied admission notes. Linear regression was used to assess interrater reliability and agreement between prospective and retrospective NIHSS scores. The Wilcoxon signed rank test was used to assess systematic scoring bias. Weighted kappa statistics were calculated to assess the level of agreement of individual NIHSS items. Results - Only 1 admission note was complete for all NIHSS elements. Interrater reliability was near perfect (r2=0.98, P<0.001). Agreement between prospective and retrospective NIHSS score was also excellent (r2=0.94, P<0.001) and there was no systematic bias in retrospective scores. Agreement for individual items was moderate to high for all items except level of consciousness. Conclusions - Retrospective NIHSS scoring with the algorithm is reliable and unbiased even when physical examination elements are missing from the written record. Stroke research using retrospective review of charts or of administrative databases should adjust for differences in stroke severity using such an algorithm.

KW - Outcome

KW - Prognosis

KW - Stroke assessment

UR - http://www.scopus.com/inward/record.url?scp=0034117150&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034117150&partnerID=8YFLogxK

M3 - Article

C2 - 10753988

AN - SCOPUS:0034117150

VL - 31

SP - 858

EP - 862

JO - Stroke

JF - Stroke

SN - 0039-2499

IS - 4

ER -