In this paper, the measured Raman spectra of YVO4 and Nd: YVO4 crystals were reported. These results give a clear information on the phonon energy spectra, these are several discrete phonons in low energy region, then nothing shows up in a large space from 500-800 cm-1 and main portion of phonon spectra is distributed in the region of 800-900 cm-1. Based on the group theory, the symmetries for Raman lines can be deduced, and they are almost due to the vibration of VO(4)3- ion. The effect of uneven distribution for phonon spectra on the optical transition and laser performance are discussed. The restraint action of doped ion on the high energy phonon is found.