ChatGPT outperforms humans in emotional awareness evaluations

Zohar Elyoseph; Dorit Hadar-Shoval; Kfir Asraf; Maya Lvovsky

doi:10.3389/fpsyg.2023.1199058

ChatGPT outperforms humans in emotional awareness evaluations

Front Psychol. 2023 May 26:14:1199058. doi: 10.3389/fpsyg.2023.1199058. eCollection 2023.

Authors

Zohar Elyoseph^{1

2}, Dorit Hadar-Shoval¹, Kfir Asraf³, Maya Lvovsky³

Affiliations

¹ Department of Psychology and Educational Counseling, The Center for Psychobiological Research, Max Stern Yezreel Valley College, Emek Yezreel, Israel.
² Department of Brain Sciences, Faculty of Medicine, Imperial College London, London, England.
³ Psychology Department, Center for Psychobiological Research, Max Stern Yezreel Valley College, Emek Yezreel, Israel.

Abstract

The artificial intelligence chatbot, ChatGPT, has gained widespread attention for its ability to perform natural language processing tasks and has the fastest-growing user base in history. Although ChatGPT has successfully generated theoretical information in multiple fields, its ability to identify and describe emotions is still unknown. Emotional awareness (EA), the ability to conceptualize one's own and others' emotions, is considered a transdiagnostic mechanism for psychopathology. This study utilized the Levels of Emotional Awareness Scale (LEAS) as an objective, performance-based test to analyze ChatGPT's responses to twenty scenarios and compared its EA performance with that of the general population norms, as reported by a previous study. A second examination was performed one month later to measure EA improvement over time. Finally, two independent licensed psychologists evaluated the fit-to-context of ChatGPT's EA responses. In the first examination, ChatGPT demonstrated significantly higher performance than the general population on all the LEAS scales (Z score = 2.84). In the second examination, ChatGPT's performance significantly improved, almost reaching the maximum possible LEAS score (Z score = 4.26). Its accuracy levels were also extremely high (9.7/10). The study demonstrated that ChatGPT can generate appropriate EA responses, and that its performance may improve significantly over time. The study has theoretical and clinical implications, as ChatGPT can be used as part of cognitive training for clinical populations with EA impairments. In addition, ChatGPT's EA-like abilities may facilitate psychiatric diagnosis and assessment and be used to enhance emotional language. Further research is warranted to better understand the potential benefits and risks of ChatGPT and refine it to promote mental health.

Keywords: ChatGPT; LEAS; artificial intelligence; emotional awareness; emotional intelligence; psychological assessment; psychotherapy.