LifeSeeker: an interactive concept-based retrieval system for lifelog data

Multimed Tools Appl. 2023;82(24):37855-37876. doi: 10.1007/s11042-023-15317-w. Epub 2023 Aug 1.

Abstract

Lifelogging was introduced as the process of passively capturing personal daily events via wearable devices. It ultimately creates a visual diary encoding every aspect of one's life with the aim of future sharing or recollecting. In this paper, we present LifeSeeker, a lifelog image retrieval system participating in the Lifelog Search Challenge (LSC) for 3 years, since 2019. Our objective is to support users to seek specific life moments using a combination of textual descriptions, spatial relationships, location information, and image similarities. In addition to the LSC challenge results, a further experiment was conducted in order to evaluate the power retrieval of our system on both expert and novice users. This experiment informed us about the effectiveness of the user's interaction with the system when involving non-experts.

Keywords: Interactive retrieval system; Lifelog; Lifelog search challenge.