How the bimodal format of presentation affects working memory: an overview

Cogn Process. 2008 Mar;9(1):69-76. doi: 10.1007/s10339-007-0195-6. Epub 2007 Oct 12.

Abstract

The best format in which information that has to be recalled is presented has been investigated in several studies, which focused on the impact of bimodal stimulation on working memory performance. An enhancement of participant's performance in terms of correct recall has been repeatedly found, when bimodal formats of presentation (i.e., audiovisual) were compared to unimodal formats (i.e, either visual or auditory), in providing implications for multimedial learning. Several theoretical frameworks have been suggested in order to account for the bimodal advantage, ranging from those emphasizing early stages of processing (such as automatic alerting effects or multisensory integration processes) to those centred on late stages of processing (as postulated by the dual coding theory). The aim of this paper is to review previous contributions to this topic, providing a comprehensive theoretical framework, which is updated by the latest empirical studies.

Publication types

  • Review

MeSH terms

  • Association Learning*
  • Attention*
  • Auditory Perception*
  • Humans
  • Memory, Short-Term*
  • Pattern Recognition, Visual*
  • Problem Solving
  • Reaction Time
  • Reading
  • Retention, Psychology
  • Semantics
  • Speech
  • Speech Perception