Ultrashort deep ultraviolet (DUV) pulses serve as indispensable tools for investigating molecular dynamics on the femtosecond scale. Nonlinear frequency upconversion of near-infrared (NIR) light sources in a sequence of nonlinear crystals is a common method for their generation. However, preserving the temporal duration of the starting source encounters challenges owing to phase-matching bandwidth limitations within the harmonic generation process. Here we propose an approach for circumventing this limitation and demonstrate it for the case of generation of the third harmonic of 800 nm pulses in a two-stage scheme (second harmonic generation succeeded by sum-frequency mixing of the fundamental and second harmonic pulses). Expanding the bandwidth of the DUV pulse involves the utilization for the last mixing process of two nonlinear crystals, detuned to convert opposite sides of the spectrum. The implementation of this approach yields 20 µJ, 263 nm DUV pulses as short as 19 fs after compression. The setup is very compact and extremely stable due to the common-path scheme, which makes it very interesting for a variety of advanced ultrafast spectroscopy applications.