Ordinary quantum mechanics is formulated on the basis of the existence of an ideal classical clock external to the system under study. This is clearly an idealization. As emphasized originally by Salecker and Wigner and more recently by others, there exist limits in nature to how "classical" even the best possible clock can be. With realistic clocks, quantum mechanics ceases to be unitary and a fundamental mechanism of decoherence of quantum states arises. We estimate the rate of the universal loss of unitarity using optimal realistic clocks. In particular, we observe that the rate is rapid enough to eliminate the black hole information puzzle: all information is lost through the fundamental decoherence before the black hole can evaporate. This improves on a previous calculation we presented with a suboptimal clock in which only part of the information was lost by the time of evaporation.