An optical voice recorder capable of recording and reproducing propagating sound waves by using off-axis digital holography, as well as quantitative visualization, is presented. Propagating sound waves temporally modulate the phase distribution of an impinging light wave via refractive index changes. This temporally modulated phase distribution is recorded in the form of digital holograms by a high-speed image sensor. After inverse propagation using Fresnel diffraction of a series of the recorded holograms, the temporal phase profile of the reconstructed object wave at each three-dimensional position can be used to reproduce the original sound wave. Experimental results using a tuning fork vibrating at 440 Hz and a human voice are presented to show the feasibility of the proposed method.