Van der Waals heterobilayers of transition metal dichalcogenides with spin-valley coupling of carriers in different layers have emerged as a new platform for exploring spin/valleytronic applications. The interlayer coupling was predicted to exhibit subtle changes with the interlayer atomic registry. Manually stacked heterobilayers, however, are incommensurate with the inevitable interlayer twist and/or lattice mismatch, where the properties associated with atomic registry are difficult to access by optical means. Here, we unveil the distinct polarization properties of valley-specific interlayer excitons using epitaxially grown, commensurate WSe2/MoSe2 heterobilayers with well-defined (AA and AB) atomic registry. We observe circularly polarized photoluminescence from interlayer excitons, but with a helicity opposite to the optical excitation. The negative circular polarization arises from the quantum interference imposed by interlayer atomic registry, giving rise to distinct polarization selection rules for interlayer excitons. Using selective excitation schemes, we demonstrate the optical addressability for interlayer excitons with different valley configurations and polarization helicities.