A nuclear magnetic resonance- (NMR-) based metabolomics method was used to identify differential metabolites of methanol extracts obtained from six parts of Peganum harmala L. (P. harmala), namely, the root, stem, leaf, flower, testa, and seed. Two multivariate statistical analysis methods, principal component analysis (PCA) and partial least squares-discriminant analysis (PLS-DA), were combined to clearly distinguish among the P. harmala samples from the six different parts. Eleven differential components were screened by the PLS-DA loading plot, and the relative contents were calculated by univariate analysis of variance. Chemometric results showed significant differences in the metabolites of the different parts of P. harmala. The seeds contained large amounts of harmaline, harmine, and vasicine compared to other organs. The acetic acid, proline, lysine, and sucrose contents of the roots were significantly higher than those of the other parts. In the testa, the vasicine, asparagine, choline, and 4-hydroxyisoleucine contents were clearly dominant. The obtained data revealed the distribution characteristics of the metabolomes of the different P. harmala parts and provided fundamental knowledge for the rational development of its medicinal parts.