Usability Evaluation of a Knowledge Graph-Based Dementia Care Intelligent Recommender System: Mixed Methods Study

Abstract

Background: Knowledge graph-based recommender systems offer the possibility of meeting the personalized needs of people with dementia and their caregivers. However, the usability of such a recommender system remains unknown.

Objective: This study aimed to evaluate the usability of a knowledge graph-based dementia care intelligent recommender system (DCIRS).

Methods: We used a convergent mixed methods design to conduct the usability evaluation, including the collection of quantitative and qualitative data. Participants were recruited through social media advertisements. After 2 weeks of DCIRS use, feedback was collected with the Computer System Usability Questionnaire and semistructured interviews. Descriptive statistics were used to describe sociodemographic characteristics and questionnaire scores. Qualitative data were analyzed systematically using inductive thematic analysis.

Results: A total of 56 caregivers were recruited. Quantitative data suggested that the DCIRS was easy for caregivers to use, and the mean questionnaire score was 2.14. Qualitative data showed that caregivers generally believed that the content of the DCIRS was professional, easy to understand, and instructive, and could meet users' personalized needs; they were willing to continue to use it. However, the DCIRS also had some shortcomings. Functions that enable interactions between professionals and caregivers and that provide caregiver support and resource recommendations might be added to improve the system's usability.

Conclusions: The recommender system provides a solution to meet the personalized needs of people with dementia and their caregivers and has the potential to substantially improve health outcomes. The next step will be to optimize and update the recommender system based on caregivers' suggestions and evaluate the effect of the application.

Keywords: DCIRS; caregivers; dementia; dementia care intelligent recommender system; knowledge graph; recommender system; usability evaluation.