We propose a simple single-shot spatiotemporal measurement technique called coherent modulation imaging for the spatio-spectrum (CMISS), which reconstructs the full three-dimensional high-resolution characteristics of ultrashort pulses based on frequency-space division and coherent modulation imaging. We demonstrated it experimentally by measuring the spatiotemporal amplitude and phase of a single pulse with a spatial resolution of 44 µm and a phase accuracy of 0.04 rad. CMISS has good potential for high-power ultrashort-pulse laser facilities and can measure even spatiotemporally complicated pulses with important applications.