Pectin is a non-fiber carbohydrate (NFC) that exists in forages, but it is not clear how pectin exerts its effect on populations of either known microbial species or uncultured ruminal bacteria. PCR-denaturing gradient gel electrophoresis (PCR-DGGE) and real-time PCR analysis were used in the present study to investigate the effects of pectin on microbial communities in an in vitro rumen fermentation system. The fermentations were conducted using forage (corn stover or alfalfa), an NFC source (pectin or corn starch), or their combination as the substrates. Addition of pectin increased acetate (P < 0.05), whereas inclusion of starch increased butyrate production (P < 0.05). The pectate lyase activity was higher with alfalfa than with corn straw, or with pectin than with corn starch (P < 0.05), while the amylase activity was higher in corn starch-included treatments than the others (P < 0.05). The cluster analysis of the bacterial 16S rRNA gene showed that the DGGE banding patterns differed significantly between the treatments and led to the identification of three groups that were highly associated with the NFC sources. The specific bands associated with pectin-rich treatments were identified to be dominated by members of the Treponema genus. The growth of the Treponema genus was remarkably supported by the inclusion of pectin, highlighting their specific ability to degrade pectin. The results from the present study expand our knowledge of the microbial populations associated with pectin digestion, which may not only facilitate future research on utilization of pectin in feeds, but also improve our understanding of pectin digestion with respect to the rumen micro-ecosystem.