A quantum memory with the performances of low noise, high efficiency, and high bandwidth is of crucial importance for developing practical quantum information technologies. However, the excess noises generated during the highly efficient processing of quantum information inevitably destroy quantum state. Here, we present a quantum memory with built-in excess-noise eraser by integrating a photon-correlated quantum interferometry in quantum memory, where the memory efficiency can be enhanced and the excess noises can be suppressed to the vacuum level via destructive interference. This quantum memory is demonstrated in a rubidium vapor cell with a 10-ns-long photonics signal. We observe ∼80% noise suppression, the write-in efficiency enhancement from 87% to 96.2% without and with interferometry, and the corresponding memory efficiency excluding the noises from 70% to 77%. The fidelity is 93.7% at the single-photon level, significantly exceeding the no-cloning limit. Such interferometry-integrated quantum memory, the first expansion of quantum interference techniques to quantum information processing, simultaneously enables low noise, high bandwidth, high efficiency, and easy operation.