This minireview reports the recent advances in surface-enhanced Raman scattering (SERS)-based assay devices for the diagnosis of infectious diseases. SERS-based detection methods have shown promise in overcoming the low sensitivity and multiplex detection problems inherent to fluorescence detection. Therefore, it is interesting to investigate the current status, challenges, and applications associated with SERS-based microdevices for the point-of-care (POC) diagnosis of infectious diseases. The majority of this review highlights three different types of microdevices, namely microfluidic channels, lateral flow assay strips, and three-dimensional nanostructured substrates. Furthermore, the integration of portable Raman spectrophotometry with microdevices provides an ideal platform for the diagnosis of various infectious diseases in the field. Integrated SERS-based assay systems also enable measurements in minimal sample volumes and at low analyte concentrations of viral or bacterial samples. A significant number of studies using the SERS-based assay system have been performed recently to realize POC diagnostics, especially under resource-limited conditions. This portable SERS sensor is expected to be a next-generation POC assay system that could overcome the limitations of current fluorescence-based assay systems. This minireview summarizes recent advances in the development of SERS-based microdevices for the diagnosis of infectious diseases. Lastly, challenges to overcome and future perspectives are discussed.