Glossiness can be increased by adding chromatic information to the object images. However, the mechanisms that create color-induced glossiness enhancement are unclear. In this study, we psychophysically measured the glossiness of object images to which various hue chromaticities were added to elucidate the perceptual and image factors that explain the color-induced glossiness enhancement effect. Two types of coloring conditions were tested: the both-colored (BC) condition, in which both specular and diffuse components were colored with the same chromaticity, and the diffuse-colored (DC) condition, in which only diffuse components were colored while specular components remained achromatic. The results showed that glossiness enhancement was more prominent in the BC than in the DC condition, and the dependency of glossiness enhancement on the stimulus color direction was similar to that of the Helmholtz-Kohlrausch (H-K) effect. Furthermore, we performed a regression analysis with a linear mixed model based on image features and an additional experiment in which an H-K effect-based increase in perceived brightness was imitated on achromatic stimuli by manipulating luminance. The results demonstrated that the H-K effect-based brightness enhancement in the highlight regions explains the glossiness enhancement effect well. These results suggest that the H-K effect, especially around the highlight region, is a dominant factor that creates the color-induced glossiness enhancement, although other color-related factors could also be partly involved.