Selection and Optimization of Temporal Spike Encoding Methods for Spiking Neural Networks

IEEE Trans Neural Netw Learn Syst. 2020 Feb;31(2):358-370. doi: 10.1109/TNNLS.2019.2906158. Epub 2019 Apr 12.

Abstract

Spiking neural networks (SNNs) receive trains of spiking events as inputs. In order to design efficient SNN systems, real-valued signals must be optimally encoded into spike trains so that the task-relevant information is retained. This paper provides a systematic quantitative and qualitative analysis and guidelines for optimal temporal encoding. It proposes a methodology of a three-step encoding workflow: method selection by signal characteristics, parameter optimization by error metrics between original and reconstructed signals, and validation by comparison of the original signal and the encoded spike train. Four encoding methods are analyzed: one stimulus estimation [Ben's Spiker algorithm (BSA)] and three temporal contrast [threshold-based, step-forward (SW), and moving-window (MW)] encodings. A short theoretical analysis is provided, and the extended quantitative analysis is carried out applying four types of test signals: step-wise signal, smooth (sinusoid) signal with added noise, trended smooth signal, and event-like smooth signal. Various time-domain and frequency spectrum properties are explored, and a comparison is provided. BSA, the only method providing unipolar spikes, was shown to be ineffective for step-wise signals, but it can follow smoothly changing signals if filter coefficients are scaled appropriately. Producing bipolar (positive and negative) spike trains, SW encoding was most effective for all types of signals as it proved to be robust and easy to optimize. Signal-to-noise ratio (SNR) can be recommended as the error metric for parameter optimization. Currently, only a visual check is available for final validation.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Action Potentials
  • Algorithms
  • Models, Neurological
  • Neural Networks, Computer*
  • Reproducibility of Results
  • Signal Processing, Computer-Assisted
  • Signal-To-Noise Ratio