Gastroenterology imaging is a diagnostic procedure that incorporates various computer vision challenges for the design of assisted diagnostic systems. The most typical challenge is the design of more adequate visual descriptors that can assist the classification algorithms in getting good diagnostic results. Literature shows that most of the texture descriptors for feature extraction from gastric lesions are based on Gabor filters or local binary patterns (LBP). Although good results are obtained, these techniques have their shortcomings. In this paper, we aim to explore the use of fusion of Gabor filters and LBPs for characterizing gastric lesions. The images are first subjected to Gabor filtering using isotropic Gabor filters, followed by extracting LBPs from the filtered images. We validate the performance of the descriptor on a novel gastroenterology dataset: the Post-MAPS dataset. Our results show that the proposed feature set outperforms the other methods that have been considered in this paper.