Bio-inspired feedback-circuit implementation of discrete, free energy optimizing, winner-take-all computations

Biol Cybern. 2016 Jun;110(2-3):135-50. doi: 10.1007/s00422-016-0684-8. Epub 2016 Mar 29.

Abstract

Bayesian inference and bounded rational decision-making require the accumulation of evidence or utility, respectively, to transform a prior belief or strategy into a posterior probability distribution over hypotheses or actions. Crucially, this process cannot be simply realized by independent integrators, since the different hypotheses and actions also compete with each other. In continuous time, this competitive integration process can be described by a special case of the replicator equation. Here we investigate simple analog electric circuits that implement the underlying differential equation under the constraint that we only permit a limited set of building blocks that we regard as biologically interpretable, such as capacitors, resistors, voltage-dependent conductances and voltage- or current-controlled current and voltage sources. The appeal of these circuits is that they intrinsically perform normalization without requiring an explicit divisive normalization. However, even in idealized simulations, we find that these circuits are very sensitive to internal noise as they accumulate error over time. We discuss in how far neural circuits could implement these operations that might provide a generic competitive principle underlying both perception and action.

Keywords: Analog circuits; Bayesian inference; Competition; Free energy; Integration.

MeSH terms

  • Bayes Theorem*
  • Computer Simulation*
  • Cybernetics
  • Decision Making*
  • Electricity
  • Feedback*
  • Perception
  • Probability