Catalyst-free methods are important for the fabrication of pure nanowires (NWs). However, the growth mechanism remains elusive due to the lack of crucial information on the growth dynamics at atomic level. Here, the noncatalytic growth process of ZnO NWs is studied through in situ high resolution transmission electron microscopy. We observe the layer-by-layer growth of ZnO nanopillars along the polar [0001] direction under electron beam irradiation, while no growth is observed along the radial directions, indicating an anisotropic growth mechanism. The source atoms are mainly from the electron beam induced damage of the sample and the growth is assisted by subsequent absorption and then diffusion of atoms along the side surface to the top (0002) surface. The different binding energy on different ZnO surface is the main origin for the anisotropic growth. Additionally, the coalescence of ZnO nanocrystals related to the nucleation stage is uncovered to realize through the rotational motions and recrystallization. Our in situ results provide atomic-level detailed information about the dynamic growth and coalescence processes in the noncatalytic synthesis of ZnO NW and are helpful for understanding the vapor-solid mechanism of catalyst-free NW growth.