The manifold of coupling constants parametrizing a quantum Hamiltonian is equipped with a natural Riemannian metric with an operational distinguishability content. We argue that the singularities of this metric are in correspondence with the quantum phase transitions featured by the corresponding system. This approach provides a universal conceptual framework to study quantum critical phenomena which is differential geometric and information theoretic at the same time.