Properly designed colloidal semiconductor quantum dots (QDs) have already been shown to exhibit high sensitivity to external electric fields via the quantum confined Stark effect (QCSE). Yet, detection of the characteristic spectral shifts associated with the effect of the QCSE has traditionally been painstakingly slow, dramatically limiting the sensitivity of these QD sensors to fast transients. We experimentally demonstrate a new detection scheme designed to achieve shot-noise-limited sensitivity to emission wavelength shifts in QDs, showing feasibility for their use as local electric field sensors on the millisecond time scale. This regime of operation is already potentially suitable for detection of single action potentials in neurons at a high spatial resolution.