Efficient design of neural networks for the classification of acoustic spectra

JASA Express Lett. 2023 Sep 1;3(9):094802. doi: 10.1121/10.0020990.

Abstract

A previous paper by Paul and Nelson [(2021). J. Acoust. Soc. Am. 149(6), 4119-4133] presented the application of the singular value decomposition (SVD) to the weight matrices of multilayer perceptron (MLP) networks as a pruning strategy to remove weight parameters. This work builds on the previous technique and presents a method of reducing the size of a hidden layer by applying a similar SVD algorithm. Results show that by reducing the neurons in the hidden layer, a significant amount of training time is saved compared to the algorithm presented in the previous paper while no or little accuracy is being lost compared to the original MLP model.