Implementation of Dropout Neuronal Units Based on Stochastic Memristive Devices in Neural Networks with High Classification Accuracy

Abstract

Neural networks based on memristive devices have achieved great progress recently. However, memristive synapses with nonlinearity and asymmetry seriously limit the classification accuracy. Moreover, insufficient number of training samples in many cases also have negative effect on the classification accuracy of neural networks due to overfitting. In this work, dropout neuronal units are developed based on stochastic volatile memristive devices of Ag/Ta₂O₅:Ag/Pt. The memristive neural network using the dropout neuronal units effectively solves the problem of overfitting and mitigates the negative effects of the nonideality of memristive synapses, eventually achieves a classification accuracy comparable to the theoretical limit. The stochastic and volatile switching performances of the Ag/Ta₂O₅:Ag/Pt device are attributed to the stochastical rupture of the Ag filament under high electrical stress in the Ta₂O₅ layer, according to the TEM observation and the kinetic Monte Carlo simulation.

Keywords: artificial synapses; dropout neuronal units; memristive neural networks; sample classification; stochastic memristive devices.