We demonstrate the existence of a critical behavior of a single electromagnetic mode propagating in a tapered dielectric structure. This behavior is described in terms of a critical phase velocity in the case of an adiabatic tapering. In the vicinity of this critical phase velocity, the tapered structure no longer confines the radiation and a significant fraction of the power escapes transversely.