External fields are commonly applied to accelerate colloidal crystallization; however, accelerated self-assembly kinetics can negatively impact the quality of crystal structures. We show that cyclically applied electric fields can produce high quality colloidal crystals by annealing local disorder. We find that the optimal off-duration for maximum annealing is approximately one-half of the characteristic melting half lifetime of the crystalline phase. Local six-fold bond orientational order grows more rapidly than global scattering peaks, indicating that local restructuring leads global annealing. Molecular dynamics simulations of cyclically activated systems show that the ratio of optimal off-duration for maximum annealing and crystal melting time is insensitive to particle interaction details. This research provides a quantitative relationship describing how the cyclic application of fields produces high quality colloidal crystals by cycling at the fundamental time scale for local defect rearrangements; such understanding of dynamics and kinetics can be applied for reconfigurable colloidal assembly.