Precision constrained stochastic resonance in a feedforward neural network

IEEE Trans Neural Netw. 2005 Jan;16(1):250-62. doi: 10.1109/TNN.2004.836195.

Abstract

Stochastic resonance (SR) is a phenomenon in which the response of a nonlinear system to a subthreshold information-bearing signal is optimized by the presence of noise. By considering a nonlinear system (network of leaky integrate-and-fire (LIF) neurons) that captures the functional dynamics of neuronal firing, we demonstrate that sensory neurons could, in principle harness SR to optimize the detection and transmission of weak stimuli. We have previously characterized this effect by use of signal-to-noise ratio (SNR). Here in addition to SNR, we apply an entropy-based measure (Fisher information) and compare the two measures of quantifying SR. We also discuss the performance of these two SR measures in a full precision floating point model simulated in Java and in a precision limited integer model simulated on a field programmable gate array (FPGA). We report in this study that stochastic resonance which is mainly associated with floating point implementations is possible in both a single LIF neuron and a network of LIF neurons implemented on lower resolution integer based digital hardware. We also report that such a network can improve the SNR and Fisher information of the output over a single LIF neuron.

Publication types

  • Comparative Study
  • Evaluation Study
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Action Potentials / physiology*
  • Animals
  • Biomimetics / methods*
  • Computer Simulation
  • Feedback
  • Humans
  • Models, Neurological*
  • Models, Statistical
  • Nerve Net*
  • Neural Networks, Computer*
  • Neurons / physiology*
  • Stochastic Processes
  • Synaptic Transmission / physiology*