Spatial-spectral approach with spatially adaptive classification of hyperspectral images is proposed. The rotation-invariant spatial texture information for each object is exploited and incorporated into the classifier by using the modified local Gabor binary pattern to distinguish different types of classes of interest. The proposed method can effectively suppress anisotropic texture in spatially separate classes as well as improve the discrimination among classes. Moreover, it becomes more robust with the within-class variation. Experimental results on the classification of three real hyperspectral remote sensing images demonstrate the effectiveness of the proposed approach.