Comparison of Pattern Discrimination Mechanisms of Hebbian and Spatiotemporal Learning Rules in Self-Organization

Hiromichi Tsukada; Minoru Tsukada

doi:10.3389/fnsys.2021.624353

Comparison of Pattern Discrimination Mechanisms of Hebbian and Spatiotemporal Learning Rules in Self-Organization

Front Syst Neurosci. 2021 Mar 29:15:624353. doi: 10.3389/fnsys.2021.624353. eCollection 2021.

Authors

Hiromichi Tsukada^{1

2}, Minoru Tsukada³

Affiliations

¹ College of Engineering, Chubu University, Kasugai, Japan.
² Neural Computation Unit, Okinawa Institute of Science and Technology Graduate University, Okinawa, Japan.
³ Brain Science Institute, Tamagawa University, Tokyo, Japan.

Abstract

The spatiotemporal learning rule (STLR) proposed based on hippocampal neurophysiological experiments is essentially different from the Hebbian learning rule (HEBLR) in terms of the self-organization mechanism. The difference is the self-organization of information from the external world by firing (HEBLR) or not firing (STLR) output neurons. Here, we describe the differences of the self-organization mechanism between the two learning rules by simulating neural network models trained on relatively similar spatiotemporal context information. Comparing the weight distributions after training, the HEBLR shows a unimodal distribution near the training vector, whereas the STLR shows a multimodal distribution. We analyzed the shape of the weight distribution in response to temporal changes in contextual information and found that the HEBLR does not change the shape of the weight distribution for time-varying spatiotemporal contextual information, whereas the STLR is sensitive to slight differences in spatiotemporal contexts and produces a multimodal distribution. These results suggest a critical difference in the dynamic change of synaptic weight distributions between the HEBLR and STLR in contextual learning. They also capture the characteristics of the pattern completion in the HEBLR and the pattern discrimination in the STLR, which adequately explain the self-organization mechanism of contextual information learning.

Keywords: Hebbian learning rule; STLR; context-dependent memory; contextual learning; pattern completion; pattern discrimination; self-organization; spetiotemporal learning rule.