Stimulated adiabatic passage utilizes radiation pulses to efficiently and selectively transfer population between quantum states, via an intermediate state that is normally decaying. In this Letter, we propose the analog of stimulated adiabatic passage in an acoustic system. It is realized with cavities that correlate through adiabatically time-varying couplings, where the cavities and time-varying couplings mimic discrete states and radiation pulses, respectively. With appropriate arrangements of coupling actions, an acoustic wave can be efficiently transferred from the initial excited cavity to the target cavity in the forward direction, immune to the intermediate dark cavity. On the other hand, for the backward propagation, the acoustic energy is perfectly localized in the intermediate dark cavity and completely dissipated. We analytically, numerically, and experimentally demonstrate such unidirectional sound localization and unveil the essential role of zero-eigenvalue eigenstates in the adiabatic passage process.