The quality of Chinese medicinal materials relates greatly to the clinical curative effect and security. In order to ensure the quality and safety of Chinese medicinal materials, a systematic and operable traceability system needs to be established. It can realize the whole process of quality and safety management of Chinese medicinal materials "from production to consumption" through recording and inquiring information and recalling defective products, which is an important direction for the future development of traditional Chinese medicine. But it is still at the exploration and trial stage. In this paper, a framework of Chinese medicinal materials' quality and safety traceability system was established on the basis of the domestic and international experience about the construction of food and agricultural products traceability systems. The relationship between traceability system of Chinese medicinal materials' quality and GAP, GMP, GSP was analyzed, and the possible problems and the corresponding solutions were discussed.