Reliability of Cognitive Measures in Individuals With a Chronic Spinal Cord Injury

PM R. 2019 Dec;11(12):1278-1286. doi: 10.1002/pmrj.12161. Epub 2019 Jun 13.

Abstract

Background: Following spinal cord injury (SCI), up to 64% of individuals experience cognitive deficit. However, the reliability of commonly used neuropsychological tests is currently unknown in this population.

Objectives: To evaluate the test-retest reliability of cognitive measures in individuals with SCI.

Design: Cross-sectional study.

Setting: Vancouver General Hospital.

Participants: Individuals with a chronic (>2 years) SCI (n = 22).

Methods: Across three visits (separated by ~16 days), 22 participants with chronic SCI completed a neuropsychological battery evaluating memory (Rey Auditory-Verbal Learning Test [RAVLT]), attention/concentration/psychomotor speed (Digit Span Task, Stroop Test), and executive function (Trail Making Test A&B, Symbol Digit Modalities Test, Controlled Oral Word Association Test). Coefficients of variation (CVintra ) and intraclass correlation coefficients (ICCs) were calculated to determine the reliability of each test between visits. Linear regressions were performed to assess the associations between variability (CVintra ) and participant characteristics, such as age or highest education level attained. Repeated-measures, one-way analysis of variance (ANOVA) was conducted to determine any significant practice effects, and smallest real differences (SRDs) were calculated.

Main outcome measurements: Repeated scores on aforementioned neuropsychological tests.

Results: ICCs ranged from 0.77 to 0.93, with the exception of RAVLT recognition score (ICC = 0.27). Age showed a moderate association with CVintra in RAVLT interference recall scores (r = 0.43, P = .047), but was not a confounding factor for other measures. Education was not associated with CVintra . Significant practice effects were noted for most of the cognitive tests assessed.

Conclusions: Other than the RAVLT recognition score, these cognitive measures demonstrated good-to-excellent reliability. Although this is encouraging, test-retest variability should be considered when interpreting the efficacy of various cognitive training strategies to mitigate cognitive decline in this population. Thus, the SRD values presented herein will allow researchers and clinicians to identify "true" changes in cognitive function with repeated testing.

Level of evidence: III.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Analysis of Variance
  • British Columbia
  • Chronic Disease
  • Cognition Disorders / diagnosis*
  • Cognition Disorders / etiology*
  • Cross-Sectional Studies
  • Executive Function / physiology*
  • Female
  • Follow-Up Studies
  • Hospitals, General
  • Humans
  • Incidence
  • Linear Models
  • Male
  • Memory and Learning Tests / standards*
  • Reproducibility of Results
  • Severity of Illness Index
  • Spinal Cord Injuries / complications*
  • Spinal Cord Injuries / psychology

Grants and funding