In the present paper, we investigated the effects of afforestation on nitrogen fractions and microbial communities. A total of 24 soil samples were collected from farmland (FL) and three afforested lands, namely Robinia pseudoacacia L (RP), Caragana korshinskii Kom (CK), and abandoned land (AL), which have been arable for the past 40 years. Quantitative PCR and Illumina sequencing of 16S rRNA genes were used to analyze soil bacterial abundance, diversity, and composition. Additionally, soil nitrogen (N) stocks and fractions were estimated. The results showed that soil N stock, N fractions, and bacterial abundance and diversity increased following afforestation. Proteobacteria, Acidobacteria, and Actinobacteria were the dominant phyla of soil bacterial compositions. Overall, soil bacterial compositions generally changed from Actinobacteria (Acidobacteria)-dominant to Proteobacteria-dominant following afforestation. Soil N fractions, especially for dissolved organic nitrogen (DON), were significantly correlated with most bacterial groups and bacterial diversity, while potential competitive interactions between Proteobacteria (order Rhizobiales) and Cyanobacteria were suggested. In contrast, nitrate nitrogen (NO3(-)-N) influenced soil bacterial compositions less than other N fractions. Therefore, the present study demonstrated that bacterial diversity and specific species respond to farmland-to-forest conversion and hence have the potential to affect N dynamic processes in the Loess Plateau.