We propose using a piezoelectric adaptive secondary mirror (PASM) in the medium-sized adaptive telescopes with a 2-4 m aperture for structure and control simplification by utilizing the piezoelectric actuators in contrast with the voice-coil adaptive secondary mirror. A closed-loop experimental setup was built for on-sky demonstration of the 73-element PASM developed by our laboratory. In this Letter, the PASM and the closed-loop adaptive optics system are introduced. High-resolution stellar images were obtained by using the PASM to correct high-order wavefront errors in May 2016. To the best of our knowledge, this is the first successful on-sky demonstration of the PASM. The results show that with the PASM as the deformable mirror, the angular resolution of the 1.8 m telescope can be effectively improved.