We discuss the interplay between the degree of dynamical stochasticity, memory persistence, and violation of the self-averaging property in the aging kinetics of quenched ferromagnets. We show that, in general, the longest possible memory effects, which correspond to the slowest possible temporal decay of the correlation function, are accompanied by the largest possible violation of self-averaging and a quasideterministic descent into the ergodic components. This phenomenon is observed in different systems, such as the Ising model with long-range interactions, including the mean-field, and the short-range random-field Ising model.