Botanicals and botanical preparations, including plant food supplements (PFS), are widely used in Western diets. The growing use of PFS is accompanied by an increasing concern because the safety of these PFS is not generally assessed before they enter the market. Regulatory bodies have become more aware of this and are increasing their efforts to ensure the safety of PFS. The present review describes an overview of the general framework for the safety assessment of PFS, focusing on the different approaches currently in use to assess the safety of botanicals and/or botanical compounds, including their history of safe use, the tiered approach proposed by the European Food Safety Authority (EFSA), the Threshold of Toxicological Concern (TTC) and the Margin of Exposure (MOE) concept. Moreover, some examples of botanical compounds in PFS that may be of concern are discussed. Altogether, it is clear that "natural" does not equal "safe" and that PFS may contain compounds of concern at levels far above those found in the regular diet. In addition, the traditional use of a PFS compound as a herb or tea does not guarantee its safety when used as a supplement. This points at a need for stricter regulation and control of botanical containing products, especially given their expanding market volume.