The security and socioeconomic development of China's border areas are of great significance to the nation and the wider world. Using census, statistical, digital elevation model (DEM) and network data, this paper employs visual analysis to capture population distribution patterns in China's 131 border counties from 1982 to 2010. Multiple stepwise regression is carried out to identify the influencing factors of population dynamics in border regions. The main findings include: China's most heavily populated border areas are primarily in the northeast, northwest, and the Guangxi-Yunnan region, while rapid growth of population is found in western Inner Mongolia, southwest Xinjiang, northwest Tibet, and southern Yunnan. Given the increasingly market-oriented migration mechanism, the national reclamation policy has been no longer effective in population attraction in the new century. Education has significantly lowered and will continuously lower the fertility rate in remote border areas. The factors influencing population growth show a remarkable regional heterogeneity along China's long border.