Inhibitory synapses in neural networks with sigmoidal nonlinearities

F Palmieri; C Catello; G D'Orio

doi:10.1109/72.761723

Inhibitory synapses in neural networks with sigmoidal nonlinearities

IEEE Trans Neural Netw. 1999;10(3):635-44. doi: 10.1109/72.761723.

Authors

F Palmieri¹, C Catello, G D'Orio

Affiliation

¹ Dipartimento di Ing. Elettronica e delle Telecomunicazioni, Università degli Studi di Napoli, Federico II, 80125 Napoli, Italy.

PMID: 18252564
DOI: 10.1109/72.761723

Abstract

We study the behavior of anti-Hebbian synapses at a neural node that contains the standard sigmoidal nonlinearity. The criterion generalizes the idea already discussed by one of the authors for linear networks and consists in removing the correlation between the input to the synapse, and the node output. We show how the solution, just as for the linear case, is unique and can be learned with a standard anti-Hebbian rule.We suggest how these synapses can be embedded in fully self-organizing networks to generate orthogonal nonlinear components and be used for multidimensional approximation.