The molecular composition of mycobacteria and Gram-negative bacteria cell walls is structurally different. In this work, Raman microspectroscopy was applied to discriminate mycobacteria and Gram-negative bacteria by assessing specific characteristic spectral features. Analysis of Raman spectra indicated that mycobacteria and Gram-negative bacteria exhibit different spectral patterns under our experimental conditions due to their different biochemical components. Fourier transform infrared (FTIR) spectroscopy, as a supplementary vibrational spectroscopy, was also applied to analyze the biochemical composition of the representative bacterial strains. As for co-cultured bacterial mixtures, the distribution of individual cell types was obtained by quantitative analysis of Raman and FTIR spectral images and the spectral contribution from each cell type was distinguished by direct classical least squares analysis. Coupled atomic force microscopy (AFM) and Raman microspectroscopy realized simultaneous measurements of topography and spectral images for the same sampled surface. This work demonstrated the feasibility of utilizing a combined Raman microspectroscopy, FTIR, and AFM techniques to effectively characterize spectroscopic fingerprints from bacterial Gram types and mixtures.