This paper reviews the applications of accelerometers on the detection of physiological acoustic signals such as heart sounds, respiratory sounds, and gastrointestinal sounds. These acoustic signals contain a rich reservoir of vital physiological and pathological information. Accelerometer-based systems enable continuous, mobile, low-cost, and unobtrusive monitoring of physiological acoustic signals and thus can play significant roles in the emerging mobile healthcare. In this review, we first briefly explain the operation principle of accelerometers and specifications that are important for mobile healthcare. Applications of accelerometer-based monitoring systems are then presented. Next, we review a variety of accelerometers which have been reported in literatures for physiological acoustic sensing, including both commercial products and research prototypes. Finally, we discuss some challenges and our vision for future development.