Strong scattering of high-power millimeter waves at 140 GHz has been shown to take place in heating and current-drive experiments at TEXTOR when a tearing mode is present in the plasma. The scattering signal is at present supposed to be generated by the parametric decay instability. Here we describe the heterodyne detection system used to characterize the newly discovered signal measured at TEXTOR, and we present spectral shapes in which the signal can appear under different conditions. The radiation is collected by the receiver through a quasi-optical transmission line that is independent of the electron cyclotron resonance heating transmission line, and so the scattering geometry is variable. The signal is detected with 42 frequency channels ranging from 136 to 142 GHz. We demonstrate that the large signal does not originate from gyrotron spurious radiation. The measured signal agrees well with independent backscattering radiometer data.