Attention shapes what we see and what we act upon by allocating limited resources to certain parts of visual display in a selective and adaptive manner. While most previous studies in visual attention mainly focused on the attentional distribution over space or features, recent studies have revealed that temporal dynamics also plays a crucial function in visual attention. This paper reviews the representation, function and neural mechanism of temporal dynamics in visual attention from the following four aspects: (1) Tracking dynamic structure of external stimulus by attention; (2) Intrinsic dynamic characteristics of attention; (3) Time-based multiple object representation; (4) Relationship between visual dynamics and classical attentional phenomena. We propose that the dynamic structure and temporal organization are fundamental to visual attention, and the research on it might provide new solutions to many unresolved issues in visual attention research.