Estimates of the Number of Hidden Units and Variation with Respect to Half-Spaces

Neural Netw. 1997 Aug;10(6):1061-1068. doi: 10.1016/s0893-6080(97)00028-2.

Abstract

We estimate variation with respect to half-spaces in terms of "flows through hyperplanes". Our estimate is derived from an integral representation for smooth compactly supported multivariable functions proved using properties of the Heaviside and delta distributions. Consequently we obtain conditions which guarantee approximation error rate of order O by one-hidden-layer networks with n sigmoidal perceptrons. Copyright 1997 Elsevier Science Ltd.