Multimodal optical imaging of tissue has significant potential to become an indispensable diagnostic tool in clinical pathology. Conventional bright-field microscopy provides contrast based on attenuation or reflectance of light, having no depth-related information and no molecular specificity. Recent developments in biomedical optics have introduced a variety of optical modalities, such as Raman spectroscopy (RS), fluorescence lifetime imaging microscopy (FLIM) of endogenous fluorophores, optical coherence tomography (OCT), and others, which provide a distinct characteristic, i.e., molecular, chemical, and morphological information, of the sample. To harvest the full analytical potential of those modalities, we have developed a novel multimodal imaging system, which allows the co-registered acquisition of OCT/FLIM/RS on a single device. The present implementation allows the investigation of biological tissues in the mesoscale range, 0.1-5 mm in a correlated manner. Due to the co-registered acquisition of the modalities, it is possible to directly compare and evaluate the corresponding information between the three modalities. Moreover, by additionally preparing and characterizing entire pathological hematoxylin and eosin (H&E) slides of head and neck biopsies, it is also possible to correlate the multimodal spectroscopic information to any location of the ground truth H&E information. To the best of our knowledge, this is the first development and implementation of a compact and clinically applicable multimodal scanning microscope, which combines OCT, FLIM, and RS together with the possibility for co-registering H&E information for a morpho-chemical tissue characterization and a correlation with the pathological ground truth (H&E) of the underlying signal origin directly in a clinical environment.