Reliability of individual diagnostic criterion items for psychoactive substance dependence and the impact on diagnosis

K. K. Bucholz, V. M. Hesselbrock, J. J. Shayka, John Nurnberger, M. A. Schuckit, I. Schmidt, T. Reich

Research output: Contribution to journalArticle

93 Citations (Scopus)

Abstract

Objective: Reliability of diagnostic criterion items for psychoactive substance dependence and the impact of each on the reliability for the diagnosis were analyzed. Method: As part of a reliability study for a new interview developed for the multisite Collaborative Study on the Genetics of Alcoholism (COGA), data were collected from both within-center and across centers. The impact of each diagnostic item on the reliability of the substance dependence diagnosis was studied by forcing each item to be reliable one at a time and recomputing the kappa statistic for the diagnosis. Results: Findings indicated that the majority of individual diagnostic criterion items were reliable; 87% and 81% were in the fair or better range of reliability for the within and cross-center studies, respectively. Individual kappa estimates were statistically similar for the two studies. Reliability findings for two classes of substance, alcohol and cocaine, were good, while those for stimulants were less satisfactory. Conclusions: Forcing items one at a time to be reliable did not affect reliability of the overall substance dependence diagnosis, because more than one criterion item changed from Time I to Time 2. Because no single item was influential, weighting criteria equally, as is done in the DSM and ICD classification systems, appears to be a reasonable approach.

Original languageEnglish (US)
Pages (from-to)500-505
Number of pages6
JournalJournal of Studies on Alcohol
Volume56
Issue number5
StatePublished - 1995
Externally publishedYes

Fingerprint

Substance-Related Disorders
diagnostic
Cocaine
Alcoholism
Alcohols
Interviews
weighting
alcoholism
alcohol
statistics
Statistics
time
interview

ASJC Scopus subject areas

  • Medicine (miscellaneous)
  • Psychology(all)

Cite this

Bucholz, K. K., Hesselbrock, V. M., Shayka, J. J., Nurnberger, J., Schuckit, M. A., Schmidt, I., & Reich, T. (1995). Reliability of individual diagnostic criterion items for psychoactive substance dependence and the impact on diagnosis. Journal of Studies on Alcohol, 56(5), 500-505.

Reliability of individual diagnostic criterion items for psychoactive substance dependence and the impact on diagnosis. / Bucholz, K. K.; Hesselbrock, V. M.; Shayka, J. J.; Nurnberger, John; Schuckit, M. A.; Schmidt, I.; Reich, T.

In: Journal of Studies on Alcohol, Vol. 56, No. 5, 1995, p. 500-505.

Research output: Contribution to journalArticle

Bucholz, KK, Hesselbrock, VM, Shayka, JJ, Nurnberger, J, Schuckit, MA, Schmidt, I & Reich, T 1995, 'Reliability of individual diagnostic criterion items for psychoactive substance dependence and the impact on diagnosis', Journal of Studies on Alcohol, vol. 56, no. 5, pp. 500-505.
Bucholz, K. K. ; Hesselbrock, V. M. ; Shayka, J. J. ; Nurnberger, John ; Schuckit, M. A. ; Schmidt, I. ; Reich, T. / Reliability of individual diagnostic criterion items for psychoactive substance dependence and the impact on diagnosis. In: Journal of Studies on Alcohol. 1995 ; Vol. 56, No. 5. pp. 500-505.
@article{f74e9a0c8fe147cbbbbfd035f3a17dc5,
title = "Reliability of individual diagnostic criterion items for psychoactive substance dependence and the impact on diagnosis",
abstract = "Objective: Reliability of diagnostic criterion items for psychoactive substance dependence and the impact of each on the reliability for the diagnosis were analyzed. Method: As part of a reliability study for a new interview developed for the multisite Collaborative Study on the Genetics of Alcoholism (COGA), data were collected from both within-center and across centers. The impact of each diagnostic item on the reliability of the substance dependence diagnosis was studied by forcing each item to be reliable one at a time and recomputing the kappa statistic for the diagnosis. Results: Findings indicated that the majority of individual diagnostic criterion items were reliable; 87{\%} and 81{\%} were in the fair or better range of reliability for the within and cross-center studies, respectively. Individual kappa estimates were statistically similar for the two studies. Reliability findings for two classes of substance, alcohol and cocaine, were good, while those for stimulants were less satisfactory. Conclusions: Forcing items one at a time to be reliable did not affect reliability of the overall substance dependence diagnosis, because more than one criterion item changed from Time I to Time 2. Because no single item was influential, weighting criteria equally, as is done in the DSM and ICD classification systems, appears to be a reasonable approach.",
author = "Bucholz, {K. K.} and Hesselbrock, {V. M.} and Shayka, {J. J.} and John Nurnberger and Schuckit, {M. A.} and I. Schmidt and T. Reich",
year = "1995",
language = "English (US)",
volume = "56",
pages = "500--505",
journal = "Journal of Studies on Alcohol and Drugs",
issn = "1937-1888",
publisher = "Alcohol Research Documentation, Inc.",
number = "5",

}

TY - JOUR

T1 - Reliability of individual diagnostic criterion items for psychoactive substance dependence and the impact on diagnosis

AU - Bucholz, K. K.

AU - Hesselbrock, V. M.

AU - Shayka, J. J.

AU - Nurnberger, John

AU - Schuckit, M. A.

AU - Schmidt, I.

AU - Reich, T.

PY - 1995

Y1 - 1995

N2 - Objective: Reliability of diagnostic criterion items for psychoactive substance dependence and the impact of each on the reliability for the diagnosis were analyzed. Method: As part of a reliability study for a new interview developed for the multisite Collaborative Study on the Genetics of Alcoholism (COGA), data were collected from both within-center and across centers. The impact of each diagnostic item on the reliability of the substance dependence diagnosis was studied by forcing each item to be reliable one at a time and recomputing the kappa statistic for the diagnosis. Results: Findings indicated that the majority of individual diagnostic criterion items were reliable; 87% and 81% were in the fair or better range of reliability for the within and cross-center studies, respectively. Individual kappa estimates were statistically similar for the two studies. Reliability findings for two classes of substance, alcohol and cocaine, were good, while those for stimulants were less satisfactory. Conclusions: Forcing items one at a time to be reliable did not affect reliability of the overall substance dependence diagnosis, because more than one criterion item changed from Time I to Time 2. Because no single item was influential, weighting criteria equally, as is done in the DSM and ICD classification systems, appears to be a reasonable approach.

AB - Objective: Reliability of diagnostic criterion items for psychoactive substance dependence and the impact of each on the reliability for the diagnosis were analyzed. Method: As part of a reliability study for a new interview developed for the multisite Collaborative Study on the Genetics of Alcoholism (COGA), data were collected from both within-center and across centers. The impact of each diagnostic item on the reliability of the substance dependence diagnosis was studied by forcing each item to be reliable one at a time and recomputing the kappa statistic for the diagnosis. Results: Findings indicated that the majority of individual diagnostic criterion items were reliable; 87% and 81% were in the fair or better range of reliability for the within and cross-center studies, respectively. Individual kappa estimates were statistically similar for the two studies. Reliability findings for two classes of substance, alcohol and cocaine, were good, while those for stimulants were less satisfactory. Conclusions: Forcing items one at a time to be reliable did not affect reliability of the overall substance dependence diagnosis, because more than one criterion item changed from Time I to Time 2. Because no single item was influential, weighting criteria equally, as is done in the DSM and ICD classification systems, appears to be a reasonable approach.

UR - http://www.scopus.com/inward/record.url?scp=0029127814&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0029127814&partnerID=8YFLogxK

M3 - Article

C2 - 7475029

AN - SCOPUS:0029127814

VL - 56

SP - 500

EP - 505

JO - Journal of Studies on Alcohol and Drugs

JF - Journal of Studies on Alcohol and Drugs

SN - 1937-1888

IS - 5

ER -