With the continuous development in nanoscience and nanotechnology, analytical techniques like surface-enhanced Raman spectroscopy (SERS) render structural and chemical information of a variety of analyte molecules in ultra-low concentration. Although this technique is making significant progress in various fields, the reproducibility of SERS measurements and sensitivity towards small molecules are still daunting challenges. In this regard, microfluidic surface-enhanced Raman spectroscopy (MF-SERS) is well on its way to join the toolbox of analytical chemists. This review article explains how MF-SERS is becoming a powerful tool in analytical chemistry. We critically present the developments in SERS substrates for microfluidic devices and how these substrates in microfluidic channels can improve the SERS sensitivity, reproducibility, and detection limit. We then introduce the building materials for microfluidic platforms and their types such as droplet, centrifugal, and digital microfluidics. Finally, we enumerate some challenges and future directions in microfluidic SERS. Overall, this article showcases the potential and versatility of microfluidic SERS in overcoming the inherent issues in the SERS technique and also discusses the advantage of adding SERS to the arsenal of microfluidics.