A single-pixel optical system, equipped with a multicolor filter, is proposed for the screening inspection of the surfaces of objects in manufacturing processes. The optical system can identify sub-microscale roughness and detect a microscale defect in a focus-free setting through the color-mapping of reflectance direction fields, as validated by experiments.