Rapid runtime learning by curating small datasets of high-quality items obtained from memory

PLoS Comput Biol. 2023 Oct 4;19(10):e1011445. doi: 10.1371/journal.pcbi.1011445. eCollection 2023 Oct.

Abstract

We propose the "runtime learning" hypothesis which states that people quickly learn to perform unfamiliar tasks as the tasks arise by using task-relevant instances of concepts stored in memory during mental training. To make learning rapid, the hypothesis claims that only a few class instances are used, but these instances are especially valuable for training. The paper motivates the hypothesis by describing related ideas from the cognitive science and machine learning literatures. Using computer simulation, we show that deep neural networks (DNNs) can learn effectively from small, curated training sets, and that valuable training items tend to lie toward the centers of data item clusters in an abstract feature space. In a series of three behavioral experiments, we show that people can also learn effectively from small, curated training sets. Critically, we find that participant reaction times and fitted drift rates are best accounted for by the confidences of DNNs trained on small datasets of highly valuable items. We conclude that the runtime learning hypothesis is a novel conjecture about the relationship between learning and memory with the potential for explaining a wide variety of cognitive phenomena.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Computer Simulation
  • Humans
  • Machine Learning*
  • Mental Processes
  • Neural Networks, Computer*
  • Self Concept

Grants and funding

JSG was supported by an NSF NRT graduate training grant (NRT-1449828). This work was also supported by NSF research grants BCS-1824737 and IIS-1813709. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.