Rhubarb (official Da-huang) is an important medicinal herb in Asia. Many adulterants of official Da-huang have been discovered in Chinese markets in recent years, which has resulted in adverse effects in medicinal treatment. Here, novel molecular markers based on a short maturase K (matK) gene were developed for authenticating official Da-huang. This study showed that all the species from official Da-huang were clustered together in one clade in the polygenetic trees based on short matK. Two highly conserved single nucleotide polymorphisms of short matK were mined in the species from official Da-huang. Based on these polymophisms, four improved specific primers of official Da-huang were successfully developed that generated reproducible specific bands. These results suggest that the short matK sequence can be considered as a favorable candidate for distinguishing official Da-huang from its adulterants. The established multiplex allele-specific PCR was determined to be simple and accurate and may serve as a preferable tool for authentication of official Da-huang. In addition, we suggest that short-sized specific bands be developed to authenticate materials used in traditional Chinese medicine.