Traditional Chinese medicine (TCM) reference standards plays an important role in the quality control of Chinese herbal pieces. This paper overviewed the development of TCM reference standards. By analyzing the 2010 edition of Chinese pharmacopoeia, the application of TCM reference standards in the quality control of Chinese herbal pieces was summarized, and the problems exiting in the system were put forward. In the process of improving the quality control level of Chinese herbal pieces, various kinds of advanced methods and technology should be used to research the characteristic reference standards of Chinese herbal pieces, more and more reasonable reference standards should be introduced in the quality control system of Chinese herbal pieces. This article discussed the solutions in the aspect of TCM reference standards, and future development of quality control on Chinese herbal pieces is prospected.