Toxic pyrrolizidine alkaloids (PAs) are found in tea samples, which pose a threat to human health. However, the source and route of PA contamination in tea samples have remained unclear. In this work, an adsorbent method combined with UPLC-MS/MS was developed to determine 15 PAs in the weed Ageratum conyzoides L., A. conyzoides rhizospheric soil, fresh tea leaves, and dried tea samples. The average recoveries ranged from 78%-111%, with relative standard deviations of 0.33%-14.8%. Fifteen pairs of A. conyzoides and A. conyzoides rhizospheric soil samples and 60 fresh tea leaf samples were collected from the Jinzhai tea garden in Anhui Province, China, and analyzed for the 15 PAs. Not all 15 PAs were detected in fresh tea leaves, except for intermedine-N-oxide (ImNO) and senecionine (Sn). The content of ImNO (34.7 µg/kg) was greater than that of Sn (9.69 µg/kg). In addition, both ImNO and Sn were concentrated in the young leaves of the tea plant, while their content was lower in the old leaves. The results indicated that the PAs in tea were transferred through the path of PA-producing weeds-soil-fresh tea leaves in tea gardens.