Note: Sound recovery from video using SVD-based information extraction

Dashan Zhang; Jie Guo; Xiujun Lei; Chang'an Zhu

doi:10.1063/1.4961979

Note: Sound recovery from video using SVD-based information extraction

Rev Sci Instrum. 2016 Aug;87(8):086111. doi: 10.1063/1.4961979.

Authors

Dashan Zhang¹, Jie Guo¹, Xiujun Lei¹, Chang'an Zhu¹

Affiliation

¹ Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei, Anhui 230026, People's Republic of China.

PMID: 27587182
DOI: 10.1063/1.4961979

Abstract

This note reports an efficient singular value decomposition (SVD)-based vibration extraction approach that recovers sound information in silent high-speed video. A high-speed camera of which frame rates are in the range of 2 kHz-10 kHz is applied to film the vibrating objects. Sub-images cut from video frames are transformed into column vectors and then reconstructed to a new matrix. The SVD of the new matrix produces orthonormal image bases (OIBs) and image projections onto specific OIB can be recovered as understandable acoustical signals. Standard frequencies of 256 Hz and 512 Hz tuning forks are extracted offline from their vibrating surfaces and a 3.35 s speech signal is recovered online from a piece of paper that is stimulated by sound waves within 1 min.