Structured interview to improve the reliability and psychometric integrity of the disability rating scale

James F. Malec, Flora Hammond, Joseph T. Giacino, John Whyte, Jerry Wright

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

To (1) develop a standardized interview for telephone administration, (2) assess the psychometric properties of this interview format (Disability Rating ScalePostacute Interview [DRS-PI]), and (3) identify additional items to reduce skew. Prospective cohort assessment study. Not applicable. Participants (N=406; 287 individuals with traumatic brain injury [TBI], 119 caregivers) in the U.S. TBI Model Systems national database during 1- to 20-year telephone follow-up. Not applicable. Original Disability Rating Scale (DRS) and DRS-PI variations. DRS-PI questions were developed by consensus of the study investigators; item scores were derived from responses to questions by algorithm. Unnecessary questions were pruned. The DRS-PI correlated highly with the original DRS (intraclass correlation, .91) and demonstrated satisfactory construct validity and internal consistency (person separation/reliability, 2.51/.86; item separation/reliability, 16.72/1.00; Cronbach α=.83). Both versions showed substantial skew. For the original DRS, 42% of scores were 0 or 1; for DRS-PI, 44%. Adding several items to the DRS-PI including actual employment status further improved its psychometric properties (person separation/reliability, 3.10/.91; item separation/reliability, 21.42/1.00; Cronbach α=.92) and reduced skew. For the Expanded DRS-PI, 18% of scores were 0 or 1. The DRS-PI provides an efficient method to ensure standardized administration of, and correlates highly with, the original DRS. The addition of several new items including actual employment status mitigates skew in postacute samples.

Original languageEnglish
Pages (from-to)1603-1608
Number of pages6
JournalArchives of Physical Medicine and Rehabilitation
Volume93
Issue number9
DOIs
StatePublished - Sep 2012

Fingerprint

Psychometrics
Interviews
Telephone
Caregivers
Consensus
Cohort Studies
Research Personnel
Databases

Keywords

  • Brain injuries
  • Outcomes assessment
  • Rehabilitation

ASJC Scopus subject areas

  • Rehabilitation
  • Physical Therapy, Sports Therapy and Rehabilitation

Cite this

Structured interview to improve the reliability and psychometric integrity of the disability rating scale. / Malec, James F.; Hammond, Flora; Giacino, Joseph T.; Whyte, John; Wright, Jerry.

In: Archives of Physical Medicine and Rehabilitation, Vol. 93, No. 9, 09.2012, p. 1603-1608.

Research output: Contribution to journalArticle

Malec, James F. ; Hammond, Flora ; Giacino, Joseph T. ; Whyte, John ; Wright, Jerry. / Structured interview to improve the reliability and psychometric integrity of the disability rating scale. In: Archives of Physical Medicine and Rehabilitation. 2012 ; Vol. 93, No. 9. pp. 1603-1608.
@article{b03808f785d641f1b3c7aeaf90356977,
title = "Structured interview to improve the reliability and psychometric integrity of the disability rating scale",
abstract = "To (1) develop a standardized interview for telephone administration, (2) assess the psychometric properties of this interview format (Disability Rating ScalePostacute Interview [DRS-PI]), and (3) identify additional items to reduce skew. Prospective cohort assessment study. Not applicable. Participants (N=406; 287 individuals with traumatic brain injury [TBI], 119 caregivers) in the U.S. TBI Model Systems national database during 1- to 20-year telephone follow-up. Not applicable. Original Disability Rating Scale (DRS) and DRS-PI variations. DRS-PI questions were developed by consensus of the study investigators; item scores were derived from responses to questions by algorithm. Unnecessary questions were pruned. The DRS-PI correlated highly with the original DRS (intraclass correlation, .91) and demonstrated satisfactory construct validity and internal consistency (person separation/reliability, 2.51/.86; item separation/reliability, 16.72/1.00; Cronbach α=.83). Both versions showed substantial skew. For the original DRS, 42{\%} of scores were 0 or 1; for DRS-PI, 44{\%}. Adding several items to the DRS-PI including actual employment status further improved its psychometric properties (person separation/reliability, 3.10/.91; item separation/reliability, 21.42/1.00; Cronbach α=.92) and reduced skew. For the Expanded DRS-PI, 18{\%} of scores were 0 or 1. The DRS-PI provides an efficient method to ensure standardized administration of, and correlates highly with, the original DRS. The addition of several new items including actual employment status mitigates skew in postacute samples.",
keywords = "Brain injuries, Outcomes assessment, Rehabilitation",
author = "Malec, {James F.} and Flora Hammond and Giacino, {Joseph T.} and John Whyte and Jerry Wright",
year = "2012",
month = "9",
doi = "10.1016/j.apmr.2012.04.003",
language = "English",
volume = "93",
pages = "1603--1608",
journal = "Archives of Physical Medicine and Rehabilitation",
issn = "0003-9993",
publisher = "W.B. Saunders Ltd",
number = "9",

}

TY - JOUR

T1 - Structured interview to improve the reliability and psychometric integrity of the disability rating scale

AU - Malec, James F.

AU - Hammond, Flora

AU - Giacino, Joseph T.

AU - Whyte, John

AU - Wright, Jerry

PY - 2012/9

Y1 - 2012/9

N2 - To (1) develop a standardized interview for telephone administration, (2) assess the psychometric properties of this interview format (Disability Rating ScalePostacute Interview [DRS-PI]), and (3) identify additional items to reduce skew. Prospective cohort assessment study. Not applicable. Participants (N=406; 287 individuals with traumatic brain injury [TBI], 119 caregivers) in the U.S. TBI Model Systems national database during 1- to 20-year telephone follow-up. Not applicable. Original Disability Rating Scale (DRS) and DRS-PI variations. DRS-PI questions were developed by consensus of the study investigators; item scores were derived from responses to questions by algorithm. Unnecessary questions were pruned. The DRS-PI correlated highly with the original DRS (intraclass correlation, .91) and demonstrated satisfactory construct validity and internal consistency (person separation/reliability, 2.51/.86; item separation/reliability, 16.72/1.00; Cronbach α=.83). Both versions showed substantial skew. For the original DRS, 42% of scores were 0 or 1; for DRS-PI, 44%. Adding several items to the DRS-PI including actual employment status further improved its psychometric properties (person separation/reliability, 3.10/.91; item separation/reliability, 21.42/1.00; Cronbach α=.92) and reduced skew. For the Expanded DRS-PI, 18% of scores were 0 or 1. The DRS-PI provides an efficient method to ensure standardized administration of, and correlates highly with, the original DRS. The addition of several new items including actual employment status mitigates skew in postacute samples.

AB - To (1) develop a standardized interview for telephone administration, (2) assess the psychometric properties of this interview format (Disability Rating ScalePostacute Interview [DRS-PI]), and (3) identify additional items to reduce skew. Prospective cohort assessment study. Not applicable. Participants (N=406; 287 individuals with traumatic brain injury [TBI], 119 caregivers) in the U.S. TBI Model Systems national database during 1- to 20-year telephone follow-up. Not applicable. Original Disability Rating Scale (DRS) and DRS-PI variations. DRS-PI questions were developed by consensus of the study investigators; item scores were derived from responses to questions by algorithm. Unnecessary questions were pruned. The DRS-PI correlated highly with the original DRS (intraclass correlation, .91) and demonstrated satisfactory construct validity and internal consistency (person separation/reliability, 2.51/.86; item separation/reliability, 16.72/1.00; Cronbach α=.83). Both versions showed substantial skew. For the original DRS, 42% of scores were 0 or 1; for DRS-PI, 44%. Adding several items to the DRS-PI including actual employment status further improved its psychometric properties (person separation/reliability, 3.10/.91; item separation/reliability, 21.42/1.00; Cronbach α=.92) and reduced skew. For the Expanded DRS-PI, 18% of scores were 0 or 1. The DRS-PI provides an efficient method to ensure standardized administration of, and correlates highly with, the original DRS. The addition of several new items including actual employment status mitigates skew in postacute samples.

KW - Brain injuries

KW - Outcomes assessment

KW - Rehabilitation

UR - http://www.scopus.com/inward/record.url?scp=84865589964&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84865589964&partnerID=8YFLogxK

U2 - 10.1016/j.apmr.2012.04.003

DO - 10.1016/j.apmr.2012.04.003

M3 - Article

VL - 93

SP - 1603

EP - 1608

JO - Archives of Physical Medicine and Rehabilitation

JF - Archives of Physical Medicine and Rehabilitation

SN - 0003-9993

IS - 9

ER -