Polarizable colloids are expected to form crystalline equilibrium phases when exposed to a steady, uniform field. However, when colloids become localized this field-induced phase transition arrests and the suspension persists indefinitely as a kinetically trapped, percolated structure. We anneal such gels formed from magneto-rheological fluids by toggling the field strength at varied frequencies. This processing allows the arrested structure to relax periodically to equilibrium--colloid-rich, cylindrical columns. Two distinct growth regimes are observed: one in which particle domains ripen through diffusive relaxation of the gel, and the other where the system-spanning structure collapses and columnar domains coalesce apparently through field-driven interactions. There is a stark boundary as a function of magnetic field strength and toggle frequency distinguishing the two regimes. These results demonstrate how kinetic barriers to a colloidal phase transition are subverted through measured, periodic variation of driving forces. Such directed assembly may be harnessed to create unique materials from dispersions of colloids.