In this work, we discovered a novel series of prolyl hydroxylase 2 (PHD2) inhibitors with improved metabolic properties based on a preferred conformation-guided drug design strategy. Piperidinyl-containing linkers with preferred metabolic stability were designed to match the dihedral angle of the desired docking conformation in the PHD2 binding site with the lowest energy conformation. Based on the piperidinyl-containing linkers, a series of PHD2 inhibitors with high PHD2 affinity and favorable druggability were obtained. Remarkably, compound 22, with an IC50 of 22.53 nM toward PHD2, significantly stabilized hypoxia-inducible factor α (HIF-α) and upregulated the expression of erythropoietin (EPO). Furthermore, oral administration of 22 dose-dependently stimulated erythropoiesis in vivo. Preliminary preclinical studies showed that 22 has good pharmacokinetic properties and an excellent safety profile, even at 10 times the efficacious dose (200 mg/kg). Taken together, these results indicate that 22 is a promising candidate for anemia treatment.