Understanding the limits of spatiotemporal carrier dynamics, especially in III-V semiconductors, is key to designing ultrafast and ultrasmall optoelectronic components. However, identifying such limits and the properties controlling them has been elusive. Here, using scanning ultrafast electron microscopy, in bulk n-GaAs and p-InAs, we simultaneously measure picosecond carrier dynamics along with three related quantities: subsurface band bending, above-surface vacuum potentials, and surface trap densities. We make two unexpected observations. First, we uncover a negative-time contrast in secondary electrons resulting from an interplay among these quantities. Second, despite dopant concentrations and surface state densities differing by many orders of magnitude between the two materials, their carrier dynamics, measured by photoexcited band bending and filling of surface states, occur at a seemingly common timescale of about 100 ps. This observation may indicate fundamental kinetic limits tied to a multitude of material and surface properties of optoelectronic III-V semiconductors and highlights the need for techniques that simultaneously measure electro-optical kinetic properties.