Spin and orbital angular momenta are two of the most fundamental physical quantities that describe the complex dynamic behaviors of optical fields. A strong coupling between these two quantities leads to many intriguing spatial topological phenomena, where one remarkable example is the generation of a helicity-dependent optical vortex that converts spin to orbital degrees of freedom. The spin-to-orbit conversion occurs inherently in lots of optical processes and has attracted increasing attention due to its crucial applications in spin-orbit photonics. However, current researches in this area are mainly focused on the monochromatic optical fields whose temporal properties are naturally neglected. In this work, we demonstrate an intriguing temporal evolution of the spin-to-orbit conversion induced by tightly-focused femtosecond optical fields. The results indicate that the conversion in such a polychromatic focused field obviously depends on time. This temporal effect originates from the superposition of local fields at the focus with different frequencies and is sensitive to the settings of pulse width and central wavelength. This work can provide fundamental insights into the spin-orbit dynamics within ultrafast wave packets, and possesses the potential for applications in spin-controlled manipulations of light.