Skin fibrosis is mainly characterized by excessive collagen deposition. Studies have recently identified a number of flavonoids with variable structures that have the potency of inhibiting collagen synthesis and thus attenuating organ fibrosis. In this study, we found that flavones with 5, 7, 3', 4' hydroxy substitution reduced collagen expression most efficiently. Among those flavones, luteolin, quercetin, and myricetin were selected for follow-up. In vivo, the three compounds ameliorated skin fibrosis and reduced collagen deposition. Further analysis showed the compounds had significant inhibition on the proliferation, activation and contractile ability of dermal fibroblasts in vitro and in vivo. More importantly, we revealed that luteolin, quercetin, and myricetin selectively downregulated the phosphorylation of Smad2/3 in TGF-β/Smads signaling via binding to activin receptor-like kinase 5 (ALK5) and impairing its catalytic activity. We also found flavones with 5, 7, 3', 4' hydroxy substitution showed stronger affinity with ALK5 compared with other flavonoids. Herein, we identified at least in part the underlying molecular basis as well as the critical structures that contribute to the antifibrotic bioactivity of flavones, which might benefit drug design and modification.