Examining independent and combined accuracy of embedded performance validity tests in the California Verbal Learning Test-II and Brief Visuospatial Memory Test-Revised for detecting invalid performance

Appl Neuropsychol Adult. 2022 Mar-Apr;29(2):252-261. doi: 10.1080/23279095.2020.1742718. Epub 2020 Mar 23.

Abstract

The California Verbal Learning Test-Second Edition (CVLT-II) Forced Choice Recognition (FC) and Brief Visuospatial Memory Test-Revised (BVMT-R) Recognition Discrimination Index (RD) are embedded performance validity tests (PVTs) assessing material-specific neuropsychological processes (i.e., verbal and visual memory, respectively). Prior research demonstrated the utility of these PVTs independently; however, no study has compared their diagnostic accuracy for identifying invalid performance relative to each other and in combination within a single sample. This cross-sectional study included an adult neuropsychiatric sample who underwent neuropsychological evaluation. Validity groups were determined via independent criterion PVT performance, and consisted of 103 participants with valid and 25 with invalid neurocognitive performance. FC and RD were not significantly correlated (r = .154), yet both differed between validity groups (ηp2 = .14-.19). Previously established FC (≤14) and RD (≤4) cutoffs evidenced 32-40% sensitivity/90-98% specificity, though receiver operating characteristic (ROC) analyses indicated a more liberal FC cutoff (≤15) was optimal. Logistic regression models utilizing both embedded PVTs indicated that FC did not significantly improve classification accuracy above and beyond RD. Results support the clinical utility of existing cutoffs for FC and RD for independently identifying invalid performance, though the latter showed relatively better ability to detect invalid performance when both are used together.

Keywords: Assessment; forensic; memory; performance validity; psychometrics.

MeSH terms

  • Adult
  • Cross-Sectional Studies
  • Humans
  • Memory and Learning Tests*
  • Neuropsychological Tests
  • Reproducibility of Results
  • Sensitivity and Specificity
  • Verbal Learning*