Experiential and sensory evaluation is an ancient method that remains important in the current quality control system of Traditional Chinese Medicines (TCMs). The process is rapid and convenient when evaluating the quality of crude materials in TCM markets. However, sensory evaluation has been met with skepticism because it is mainly based on experience and lacks a scientific basis. In this study, rhubarb was selected to demonstrate how color-based sensory evaluation could differentiate the quality of herbal medicines objectively. The colors of the rhubarb samples, expressed as RGB values, were obtained from different parts and forms of the plant, including the plant's surface, fracture surface color, and a powdered form with or without treatment with a color-developing reagent. We first divided the rhubarb samples into three grades based on the total content of five hydroxyanthraquinone derivatives, the major pharmacological components in rhubarb. Then, a three-layer back-propagation artificial neural network (BP-ANN), calibrated with selected training samples, was used to correlate the quality of the rhubarb with its color. The color of the rhubarb powder after coloration attained the highest accuracy (92.3%) in predicting the quality grade of the test samples with the established artificial neural networks. Finally, a standardized colorimetric grading scale was created based on the spatial distribution of the rhubarb samples in a two-dimensional chromaticity diagram according to the colors of the powdered rhubarb after color enhancement. By comparing the color between the scale and the tested samples, similar to performing a pH test with indicator paper, subjects without sensory evaluation experience could quickly determine the quality grade of rhubarb. This work illustrates the technical feasibility of the color-based grading of rhubarb quality and offers references for quantifying and standardizing the sensory evaluation of TCMs, foods and other products.