Gloss is a feature of visual appearance that arises from the directionally selective reflection of light incident on a surface. Especially when a distinct reflected image is perceptible, the luminance distribution of the illumination scene above the sample can strongly influence the gloss perception. For this reason, industrial glossmeters do not provide a satisfactory gloss estimation of high-gloss surfaces. In this study, the influence of the conditions of illumination on specular gloss perception was examined through a magnitude estimation experiment in which 10 observers took part. A light booth with two light sources was utilized: the mirror image of only one source being visible in reflection by the observer. The luminance of both the reflected image and the adjacent sample surface could be independently varied by separate adjustment of the intensity of the two light sources. A psychophysical scaling function was derived, relating the visual gloss estimations to the measured luminance of both the reflected image and the off-specular sample background. The generalization error of the model was estimated through a validation experiment performed by 10 other observers. In result, a metric including both surface and illumination properties is provided. Based on this metric, improved gloss evaluation methods and instruments could be developed.