Dipeptidyl peptidase IV (DPP-IV) inhibitors have attracted attention as potential drugs for use in the treatment of type 2 diabetes because they prevent degradation of glucagon-like peptide-1 (GLP-1) and extend its duration of action. A series of 2-cyanopyrrolidines are among the most potent of DPP-IV inhibitors. We focused our attention on substitutions at the 3- or 4-position of 2-cyanopyrrolidines and synthesized and evaluated various derivatives. Among them, the 4-fluoro derivative was found to exhibit better DPP-IV inhibitory activity and higher plasma drug concentrations after oral administration to rats than the 4-unsubstituted derivative. We report here on the synthesis and biological data of the aforementioned derivatives.