The impact of conventional versus robust norming on cognitive characterization and clinical classification of MCI and dementia

J Neuropsychol. 2023 Mar;17(1):108-124. doi: 10.1111/jnp.12289. Epub 2022 Sep 19.

Abstract

We examined the impact of conventional versus robust normative approaches on cognitive characterization and clinical classification of MCI versus dementia. The sample included participants from the National Alzheimer's Coordinating Center Uniform Data Set. Separate demographically adjusted z-scores for cognitive tests were derived from conventional (n = 4273) and robust (n = 602) normative groups. To assess the impact of deriving scores from a conventional versus robust normative group on cognitive characterization, we examined likelihood of having a low score on each neuropsychological test. Next, we created receiver operating characteristic (ROC) curves for the ability of normed scores derived from each normative group to differentiate between MCI (n = 3570) and dementia (n = 1564). We examined the impact of choice of normative group on classification accuracy by comparing sensitivity and specificity values and areas under the curves (AUC). Compared with using a conventional normative group, using a robust normative group resulted in a higher likelihood of low cognitive scores for individuals classified with MCI and dementia. Comparison of the classification accuracy for distinguishing MCI from dementia did not suggest a statistically significant advantage for either normative approach (Z = -0.29, p = .77; AUC = 0.86 for conventional and AUC = 0.86 for robust). In summary, these results indicate that using a robust normative group increases the likelihood of characterizing cognitive performance as low. However, there is not a clear advantage of using a robust over a conventional normative group when differentiating between MCI and dementia.

Keywords: cognition; dementia; diagnosis; mild cognitive impairment; normative data; robust.

MeSH terms

  • Alzheimer Disease* / diagnosis
  • Cognition
  • Cognitive Dysfunction* / diagnosis
  • Cognitive Dysfunction* / psychology
  • Humans
  • Neuropsychological Tests
  • Sensitivity and Specificity