In this paper we present an extension to the ICP algorithm to eliminate false matches in image registration. We define proximity and closeness constraints to be used with structured image data in conjunction with geometric constraints in an ICP, based algorithm. The proposed method can be uniformly initialized without pre-processing of images, and experiments with real range image data demonstrate accurate and robust registration.