Previous studies of the flexibility of ancestral proteins suggest that proteins evolve their function by altering their native state ensemble. Here, we propose a more direct method to analyze such changes during protein evolution by comparing thermally activated vibrations at frequencies below 6 THz, which report on the dynamics of collective protein modes. We analyzed the backbone vibrational density of states of ancestral and extant β-lactamases and thioredoxins and observed marked changes in the vibrational spectrum in response to evolution. Coupled with previously observed changes in protein flexibility, the observed shifts of vibrational mode densities suggest that protein dynamics and dynamical allostery are critical factors for the evolution of enzymes with specialized catalytic and biophysical properties.