Polarization-related image artifacts are frequently observed in optical coherence tomography (OCT) data. As most modern OCT layouts rely on polarized light sources, only the co-polarized component of the light scattered from within a sample can be detected after interference with the reference beam. Cross-polarized sample light does not interfere with the reference beam and thus produces artifacts ranging from a reduction to the full absence of OCT signals. Here we present a simple yet effective technique to prevent polarization artifacts. By partly depolarizing the light source at the interferometer entrance, we achieve OCT signals regardless of the sample polarization state. We demonstrate the performance of our approach in a defined retarder as well as in birefringent dura mater tissue. This simple and cost-effective technique can be applied to obviate cross-polarization artifacts in virtually any OCT layout.