Reliability and validity of a widely-available AI tool for assessment of stress based on speech

Sci Rep. 2023 Nov 18;13(1):20224. doi: 10.1038/s41598-023-47153-1.

Abstract

Cigna's online stress management toolkit includes an AI-based tool that purports to evaluate a person's psychological stress level based on analysis of their speech, the Cigna StressWaves Test (CSWT). In this study, we evaluate the claim that the CSWT is a "clinical grade" tool via an independent validation. The results suggest that the CSWT is not repeatable and has poor convergent validity; the public availability of the CSWT despite insufficient validation data highlights concerns regarding premature deployment of digital health tools for stress and anxiety management.

MeSH terms

  • Artificial Intelligence*
  • Humans
  • Reproducibility of Results
  • Speech*