We propose and demonstrate a novel approach to obtaining small-core polysilicon waveguides from the silicon fiber platform. The fibers were fabricated via a conventional drawing tower method and, subsequently, tapered down to achieve silicon core diameters of ∼1 μm, the smallest optical cores for this class of fiber to date. Characterization of the material properties have shown that the taper process helps to improve the local crystallinity of the silicon core, resulting in a significant reduction in the material loss. By exploiting the combination of small cores and low losses, these tapered fibers have enabled the first observation of nonlinear transmission within a polycrystalline silicon waveguide of any type. As the fiber drawing method is highly scalable, it opens a route for the development of low-cost and flexible nonlinear silicon photonic systems.