A wavelength-routing optical switch uses a wavelength-tunable laser at each input port, and this transmitter implements output port selection by tuning the wavelength that is associated with each output port. With coherent transmission, loopback modulation of a local oscillator (LO) carrier generated at the output port can eliminate the need for a wavelength-tunable laser. However, loopback modulation can be unstable since the power fluctuates because fiber traversal by the light creates polarization rotation. Here, we propose a simple polarization-alignment circuit and verify its effectiveness in creating a high-port-count optical switch system. The proposed circuit consists of passive components and aligns the polarization state of the supplied LO carrier to be linearly polarized along the x-direction of a TE-input dual-polarization (DP) IQ modulator. The circuit is shown to yield stable modulation with Q-variation of less than 0.8 dB, regardless of any birefringence along the transmission path. The proposal's effectiveness is verified in optical switch system experiments with DP-QPSK signals; 1,856 × 1,856 switch scale is achieved with loopback modulation.