Quantification of accuracy and precision of multi-center DTI measurements: A diffusion phantom and human brain study

Tong Zhu, Rui Hu, Xing Qiu, Michael Taylor, Yuen Tso, Constantin Yiannoutsos, Bradford Navia, Susumu Mori, Sven Ekholm, Giovanni Schifitto, Jianhui Zhong

Research output: Contribution to journalArticle

72 Citations (Scopus)

Abstract

The inter-site and intra-site variability of system performance of MRI scanners (due to site-dependent and time-variant variations) can have significant adverse effects on the integration of multi-center DTI data. Measurement errors in accuracy and precision of each acquisition determine both the inter-site and intra-site variability. In this study, multiple scans of an identical isotropic diffusion phantom and of the brain of a traveling human volunteer were acquired at MRI scanners from the same vendor and with similar configurations at three sites. We assessed the feasibility of multi-center DTI studies by direct quantification of accuracy and precision of each dataset. Accuracy was quantified via comparison to carefully constructed gold standard datasets while precision (the within-scan variability) was estimated by wild bootstrap analysis. The results from both the phantom and human data suggest that the inter-site variation in system performance, although relatively small among scanners of the same vendor, significantly affects DTI measurement accuracy and precision and therefore the effectiveness for the integration of multi-center DTI measurements. Our results also highlight the value of a DTI-specific phantom in identifying and quantifying measurement errors due to site-dependent variations in the system performance, and its usefulness for quality assurance/quality control in multi-center DTI studies. In addition, we observed that the within-scan variability of each data acquisition, as assessed by wild bootstrap analysis, is of the same magnitude as the inter-site and intra-site variability. We propose that by weighing datasets based on their variability, as evaluated by wild bootstrap analysis, one can improve the quality of the dataset. This approach will provide a more effective integration of datasets from multi-center DTI studies.

Original languageEnglish
Pages (from-to)1398-1411
Number of pages14
JournalNeuroImage
Volume56
Issue number3
DOIs
StatePublished - Jun 1 2011

Fingerprint

Brain
Quality Control
Volunteers
Datasets

Keywords

  • Accuracy
  • DTI
  • Multi-center study
  • Precision
  • Weighting statistics
  • Wild-bootstrap analysis

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Neurology

Cite this

Quantification of accuracy and precision of multi-center DTI measurements : A diffusion phantom and human brain study. / Zhu, Tong; Hu, Rui; Qiu, Xing; Taylor, Michael; Tso, Yuen; Yiannoutsos, Constantin; Navia, Bradford; Mori, Susumu; Ekholm, Sven; Schifitto, Giovanni; Zhong, Jianhui.

In: NeuroImage, Vol. 56, No. 3, 01.06.2011, p. 1398-1411.

Research output: Contribution to journalArticle

Zhu, T, Hu, R, Qiu, X, Taylor, M, Tso, Y, Yiannoutsos, C, Navia, B, Mori, S, Ekholm, S, Schifitto, G & Zhong, J 2011, 'Quantification of accuracy and precision of multi-center DTI measurements: A diffusion phantom and human brain study', NeuroImage, vol. 56, no. 3, pp. 1398-1411. https://doi.org/10.1016/j.neuroimage.2011.02.010
Zhu, Tong ; Hu, Rui ; Qiu, Xing ; Taylor, Michael ; Tso, Yuen ; Yiannoutsos, Constantin ; Navia, Bradford ; Mori, Susumu ; Ekholm, Sven ; Schifitto, Giovanni ; Zhong, Jianhui. / Quantification of accuracy and precision of multi-center DTI measurements : A diffusion phantom and human brain study. In: NeuroImage. 2011 ; Vol. 56, No. 3. pp. 1398-1411.
@article{b1899b22656f4f7d8f0abd5351ad04c4,
title = "Quantification of accuracy and precision of multi-center DTI measurements: A diffusion phantom and human brain study",
abstract = "The inter-site and intra-site variability of system performance of MRI scanners (due to site-dependent and time-variant variations) can have significant adverse effects on the integration of multi-center DTI data. Measurement errors in accuracy and precision of each acquisition determine both the inter-site and intra-site variability. In this study, multiple scans of an identical isotropic diffusion phantom and of the brain of a traveling human volunteer were acquired at MRI scanners from the same vendor and with similar configurations at three sites. We assessed the feasibility of multi-center DTI studies by direct quantification of accuracy and precision of each dataset. Accuracy was quantified via comparison to carefully constructed gold standard datasets while precision (the within-scan variability) was estimated by wild bootstrap analysis. The results from both the phantom and human data suggest that the inter-site variation in system performance, although relatively small among scanners of the same vendor, significantly affects DTI measurement accuracy and precision and therefore the effectiveness for the integration of multi-center DTI measurements. Our results also highlight the value of a DTI-specific phantom in identifying and quantifying measurement errors due to site-dependent variations in the system performance, and its usefulness for quality assurance/quality control in multi-center DTI studies. In addition, we observed that the within-scan variability of each data acquisition, as assessed by wild bootstrap analysis, is of the same magnitude as the inter-site and intra-site variability. We propose that by weighing datasets based on their variability, as evaluated by wild bootstrap analysis, one can improve the quality of the dataset. This approach will provide a more effective integration of datasets from multi-center DTI studies.",
keywords = "Accuracy, DTI, Multi-center study, Precision, Weighting statistics, Wild-bootstrap analysis",
author = "Tong Zhu and Rui Hu and Xing Qiu and Michael Taylor and Yuen Tso and Constantin Yiannoutsos and Bradford Navia and Susumu Mori and Sven Ekholm and Giovanni Schifitto and Jianhui Zhong",
year = "2011",
month = "6",
day = "1",
doi = "10.1016/j.neuroimage.2011.02.010",
language = "English",
volume = "56",
pages = "1398--1411",
journal = "NeuroImage",
issn = "1053-8119",
publisher = "Academic Press Inc.",
number = "3",

}

TY - JOUR

T1 - Quantification of accuracy and precision of multi-center DTI measurements

T2 - A diffusion phantom and human brain study

AU - Zhu, Tong

AU - Hu, Rui

AU - Qiu, Xing

AU - Taylor, Michael

AU - Tso, Yuen

AU - Yiannoutsos, Constantin

AU - Navia, Bradford

AU - Mori, Susumu

AU - Ekholm, Sven

AU - Schifitto, Giovanni

AU - Zhong, Jianhui

PY - 2011/6/1

Y1 - 2011/6/1

N2 - The inter-site and intra-site variability of system performance of MRI scanners (due to site-dependent and time-variant variations) can have significant adverse effects on the integration of multi-center DTI data. Measurement errors in accuracy and precision of each acquisition determine both the inter-site and intra-site variability. In this study, multiple scans of an identical isotropic diffusion phantom and of the brain of a traveling human volunteer were acquired at MRI scanners from the same vendor and with similar configurations at three sites. We assessed the feasibility of multi-center DTI studies by direct quantification of accuracy and precision of each dataset. Accuracy was quantified via comparison to carefully constructed gold standard datasets while precision (the within-scan variability) was estimated by wild bootstrap analysis. The results from both the phantom and human data suggest that the inter-site variation in system performance, although relatively small among scanners of the same vendor, significantly affects DTI measurement accuracy and precision and therefore the effectiveness for the integration of multi-center DTI measurements. Our results also highlight the value of a DTI-specific phantom in identifying and quantifying measurement errors due to site-dependent variations in the system performance, and its usefulness for quality assurance/quality control in multi-center DTI studies. In addition, we observed that the within-scan variability of each data acquisition, as assessed by wild bootstrap analysis, is of the same magnitude as the inter-site and intra-site variability. We propose that by weighing datasets based on their variability, as evaluated by wild bootstrap analysis, one can improve the quality of the dataset. This approach will provide a more effective integration of datasets from multi-center DTI studies.

AB - The inter-site and intra-site variability of system performance of MRI scanners (due to site-dependent and time-variant variations) can have significant adverse effects on the integration of multi-center DTI data. Measurement errors in accuracy and precision of each acquisition determine both the inter-site and intra-site variability. In this study, multiple scans of an identical isotropic diffusion phantom and of the brain of a traveling human volunteer were acquired at MRI scanners from the same vendor and with similar configurations at three sites. We assessed the feasibility of multi-center DTI studies by direct quantification of accuracy and precision of each dataset. Accuracy was quantified via comparison to carefully constructed gold standard datasets while precision (the within-scan variability) was estimated by wild bootstrap analysis. The results from both the phantom and human data suggest that the inter-site variation in system performance, although relatively small among scanners of the same vendor, significantly affects DTI measurement accuracy and precision and therefore the effectiveness for the integration of multi-center DTI measurements. Our results also highlight the value of a DTI-specific phantom in identifying and quantifying measurement errors due to site-dependent variations in the system performance, and its usefulness for quality assurance/quality control in multi-center DTI studies. In addition, we observed that the within-scan variability of each data acquisition, as assessed by wild bootstrap analysis, is of the same magnitude as the inter-site and intra-site variability. We propose that by weighing datasets based on their variability, as evaluated by wild bootstrap analysis, one can improve the quality of the dataset. This approach will provide a more effective integration of datasets from multi-center DTI studies.

KW - Accuracy

KW - DTI

KW - Multi-center study

KW - Precision

KW - Weighting statistics

KW - Wild-bootstrap analysis

UR - http://www.scopus.com/inward/record.url?scp=79955364982&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79955364982&partnerID=8YFLogxK

U2 - 10.1016/j.neuroimage.2011.02.010

DO - 10.1016/j.neuroimage.2011.02.010

M3 - Article

C2 - 21316471

AN - SCOPUS:79955364982

VL - 56

SP - 1398

EP - 1411

JO - NeuroImage

JF - NeuroImage

SN - 1053-8119

IS - 3

ER -