A method for calibration of vignetting coefficient is proposed in this paper to solve the distortion of temperature measurement using a CCD-based pyrometer. On this basis, a hybrid temperature measurement system, which comprises of an array CCD camera with high resolution and a single spot colorimetric thermometer, is introduced to eliminate the influences of surface striped iron oxide scale, dust, and emissivity on temperature measurement for casting billets. Currently, the system has been successfully applied and verified in some continuous casting production lines. The vignetting estimation error of 0.052 and the maximum temperature measurement fluctuation of 5 °C were achieved in these measurements.