We study spatially isolated, individual gold nanorods placed at a planar interface between two dielectric media using confocal interference scattering microscopy in combination with higher order laser modes. Approaching refractive index matching conditions, we observe that the elastic scattering patterns of individual nanorods exhibit an exponential increase of both the scattering intensity and the signal-to-background ratio. In case refractive index matching conditions are fullfilled, the data acquisition rates are maximized and suitable for in-vivo biological measurements. In all cases, the characteristic two-lobe shape of the scattering patterns of single nanorods remains unchanged while the sign of the image contrast is a direct consequence of the refractive index variation occurring at the interface.