Fast adaptation to rule switching using neuronal surprise

PLoS Comput Biol. 2024 Feb 20;20(2):e1011839. doi: 10.1371/journal.pcbi.1011839. eCollection 2024 Feb.

Abstract

In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signal is extracted from an increase in neural activity after an imbalance of excitation and inhibition. The surprise signal modulates synaptic plasticity via a three-factor learning rule which increases plasticity at moments of surprise. The surprise signal remains small when transitions between sensory events follow a previously learned rule but increases immediately after rule switching. In a spiking network with several modules, previously learned rules are protected against overwriting, as long as the number of modules is larger than the total number of rules-making a step towards solving the stability-plasticity dilemma in neuroscience. Our model relates the subjective notion of surprise to specific predictions on the circuit level.

MeSH terms

  • Animals
  • Humans
  • Inhibition, Psychological*
  • Learning
  • Neural Networks, Computer
  • Neuronal Plasticity
  • Neurosciences*

Grants and funding

This research was supported by Swiss National Science Foundation grant No. 200020_184615 (to W.G., supported salary of M.L.L.B.) and 200020_207426 (to W.G), https://snf.ch/en. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.