Using video microscopy, we measure the long-time diffusion coefficients of colloidal particles at different concentrations. The measured diffusion coefficients start to deviate from theoretical predictions based on random collision models upon entering the supercooled regime. The theoretical diffusion relation is recovered by assigning an effective mass proportional to the size of structurally correlated clusters to the diffusing particles, providing an indirect method to probe the growth of static correlation length scales approaching the glass transition. This method is tested and validated in the crystallization of mono-disperse colloids in quasi-two-dimensional experiments. The correlation length obtained for a binary colloidal liquid increases by a power law toward a critical packing fraction of ∼0.79. The system relaxation time exhibits a power-law dependence on the correlation length in agreement with dynamical facilitation theories.