We demonstrate that a simple, unscanned polarization-sensitive optical coherence tomography needle probe can be used to perform layer identification in biological tissues. Broadband light from a laser centered at 1310 nm was sent through a fiber that was embedded into a needle, and analysis of the polarization state of the returning light after interference coupled with Doppler-based tracking allowed the calculation of phase retardation and optic axis orientation at each needle location. Proof-of-concept phase retardation mapping was shown in Atlantic salmon tissue, while axis orientation mapping was demonstrated in white shrimp tissue. The needle probe was then tested on the ex vivo porcine spine, where mock epidural procedures were performed. Our imaging results demonstrate that unscanned, Doppler-tracked polarization-sensitive optical coherence tomography imaging successfully identified the skin, subcutaneous tissue, and ligament layers, before successfully reaching the target of the epidural space. The addition of polarization-sensitive imaging into the bore of a needle probe therefore allows layer identification at deeper locations in the tissue.