Many biologically active peptides are protected from general proteolytic degradation by evolutionary conserved prolines (Pro), due to conformational constraints imposed by the Pro residue. Thus the biological importance of prolyl-specific peptidases points to a high potential for drug discovery for this family of enzymes. Panels of inhibitors have been synthesized and their effects, determined in biological models, suggest the inhibition of families of enzymes with similar activities. Prolyl-specific aminodipeptidases include dipeptidyl-aminodipeptidase IV (DPP IV)/CD26, DPP8, DPP9 and fibroblast activation protease-alpha (FAP-alpha)/seprase, able to release X-Pro dipeptides from the N-terminus of peptides. DPP IV inhibitors are in clinical use for type 2 diabetes. In this review, the expression and the potential functions of prolyl-aminodipeptidases are reviewed in diseases, and the inhibitors developed for these enzymes are discussed, with a specific focus on inhibitors able to discriminate between DPP IV and fibroblast activation protease-alpha (FAPalpha)/seprase as potential leads for the treatment of fibrogenic diseases.