Quantitative understanding the kinetics of toxic ion reactions with various heterogeneous ferrihydrite binding sites is crucial for accurately predicting the dynamic behavior of contaminants in environment. In this study, kinetics of As(V), Cr(VI), Cu(II), and Pb(II) adsorption and desorption on ferrihydrite was studied using a stirred-flow method, which showed that metal adsorption/desorption kinetics was highly dependent on the reaction conditions and varied significantly among four metals. High resolution scanning transmission electron microscopy coupled with energy-dispersive X-ray spectroscopy showed that all four metals were distributed within the ferrihydrite aggregates homogeneously after adsorption reactions. Based on the equilibrium model CD-MUSIC, we developed a novel unified kinetics model applicable for both cation and oxyanion adsorption and desorption on ferrihydrite, which is able to account for the heterogeneity of ferrihydrite binding sites, different binding properties of cations and oxyanions, and variations of solution chemistry. The model described the kinetic results well. We quantitatively elucidated how the equilibrium properties of the cation and oxyanion binding to various ferrihydrite sites and the formation of various surface complexes controlled the adsorption and desorption kinetics at different reaction conditions and time scales. Our study provided a unified modeling method for the kinetics of ion adsorption/desorption on ferrihydrite.