Multi-Site Cross-Site Inter-Rater and Test-Retest Reliability and Construct Validity of the MarkVCID White Matter Hyperintensity Growth and Regression Protocol

J Alzheimers Dis. 2023;96(2):683-693. doi: 10.3233/JAD-230629.

Abstract

Background: White matter hyperintensities (WMH) that occur in the setting of vascular cognitive impairment and dementia (VCID) may be dynamic increasing or decreasing volumes or stable over time. Quantifying such changes may prove useful as a biomarker for clinical trials designed to address vascular cognitive-impairment and dementia and Alzheimer's Disease.

Objective: Conducting multi-site cross-site inter-rater and test-retest reliability of the MarkVCID white matter hyperintensity growth and regression protocol.

Methods: The NINDS-supported MarkVCID Consortium evaluated a neuroimaging biomarker developed to track WMH change. Test-retest and cross-site inter-rater reliability of the protocol were assessed. Cognitive test scores were analyzed in relation to WMH changes to explore its construct validity.

Results: ICC values for test-retest reliability of WMH growth and regression were 0.969 and 0.937 respectively, while for cross-site inter-rater ICC values for WMH growth and regression were 0.995 and 0.990 respectively. Word list long-delay free-recall was negatively associated with WMH growth (p < 0.028) but was not associated with WMH regression.

Conclusions: The present data demonstrate robust ICC validity of a WMH growth/regression protocol over a one-year period as measured by cross-site inter-rater and test-retest reliability. These data suggest that this approach may serve an important role in clinical trials of disease-modifying agents for VCID that may preferentially affect WMH growth, stability, or regression.

Keywords: Aging; Alzheimer’s disease; MarkVCID; cerebrovascular disease; dementia; longitudinal; small vessel ischemic disease; white matter hyperintensity.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Alzheimer Disease* / diagnostic imaging
  • Biomarkers
  • Cognitive Dysfunction* / diagnostic imaging
  • Dementia, Vascular*
  • Humans
  • Magnetic Resonance Imaging
  • Reproducibility of Results
  • White Matter* / diagnostic imaging

Substances

  • Biomarkers