False memories when viewing overlapping scenes

PeerJ. 2022 Apr 6:10:e13187. doi: 10.7717/peerj.13187. eCollection 2022.

Abstract

Humans can memorize and later recognize many objects and complex scenes. In this study, we prepared large photographs and presented participants with only partial views to test the fidelity of their memories. The unpresented parts of the photographs were used as a source of distractors with similar semantic and perceptual information. Additionally, we presented overlapping views to determine whether the second presentation provided a memory advantage for later recognition tests. Experiment 1 (N = 28) showed that while people were good at recognizing presented content and identifying new foils, they showed a remarkable level of uncertainty about foils selected from the unseen parts of presented photographs (false alarm, 59%). The recognition accuracy was higher for the parts that were shown twice, irrespective of whether the same identical photograph was viewed twice or whether two photographs with overlapping content were observed. In Experiment 2 (N = 28), the memorability of the large image was estimated by a pre-trained deep neural network. Neither the recognition accuracy for an image part nor the tendency for false alarms correlated with the memorability. Finally, in Experiment 3 (N = 21), we repeated the experiment while measuring eye movements. Fixations were biased toward the center of the original large photograph in the first presentation, and this bias was repeated during the second presentation in both identical and overlapping views. Altogether, our experiments show that people recognize parts of remembered photographs, but they find it difficult to reject foils from unseen parts, suggesting that their memory representation is not sufficiently detailed to rule them out as distractors.

Keywords: False alarms; Overlapping content; Visual memory; Visual scenes.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Eye Movements
  • Humans
  • Memory*
  • Mental Recall
  • Recognition, Psychology*
  • Semantics

Grants and funding

This research was supported by Czech Science Foundation grants (GA 16-07983S and GA 20-06894S) and RVO68081740. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.