To better understand the hypoglycemic potential of wheat gluten (WG), we screened dipeptidyl peptidase IV (DPP-4) inhibitory active peptides from WG hydrolysates. WG hydrolysates prepared by ginger protease were found to have the highest DPP-4 inhibitory activity among the five enzymatic hydrolysates, from which a 1-3 kDa fraction was isolated by ultrafiltration. Further characterization of the fraction with nano-HPLC-MS/MS revealed 1133 peptides. Among them, peptides with P'2 (the second position of the N-terminal) and P2 (the second position of the C-terminal) as proline residues (Pro) accounted for 12.44% and 43.69%, respectively. The peptides including Pro-Pro-Phe-Ser (PPFS), Ala-Pro-Phe-Gly-Leu (APFGL), and Pro-Pro-Phe-Trp (PPFW) exhibited the most potent DPP-4 inhibitory activity with IC50 values of 56.63, 79.45, and 199.82 μM, respectively. The high inhibitory activity of PPFS, APFGL, and PPFW could be mainly attributed to their interaction with the S2 pocket (Glu205 and Glu206) and the catalytic triad (Ser630 and His740) of DPP-4, which adopted competitive, mixed, and mixed inhibitory modes, respectively. After comparative analysis of PPFS, PPFW, and PPF, Ser was found to be more conducive to enhancing the DPP-4 inhibitory activity. Interestingly, peptides with P2 as Pro also exhibited good DPP-4 inhibitory activity. Meanwhile, DPP-4 inhibitory peptides from WG showed excellent stability, suggesting a potential application in type 2 diabetes (T2DM) therapy or in the food industry as functional components.