Traditional micro-Raman spectroscopy technology has the disadvantages of a weak signal and low signal-to-noise ratio. To fix these issues, a cost-effective and rigorous design method is proposed in this paper, whereby a confocal micro-Raman spectroscopy system is designed and built, and a low-cost reflector and high-pass filter are introduced into the Raman signal-receiving module. The Raman light incident is fully perpendicular to the coupling lens by adjusting the reflection angle of the mirror, making the focus of the coupling lens highly conjugate with the focus of the microscope objective, to enhance the intensity of the Raman signal and improve the signal-to-noise ratio. In order to better apply this technology to the detection and study of microplastics in offshore sediments, a reflective illumination light path is used to avoid the visual interference caused by the capillary structure and opacity of the glass cellulose filter membrane. The detection and analysis of the microplastics on the glass cellulose filter membrane have been carried out by the confocal micro-Raman system designed, which is low cost and capable of obtaining good detection results and meeting the requirements of microplastics detection. The system designed in this paper is expected to be applied to the research and development of Raman detection equipment for microplastics in marine sediments, which is beneficial to promote the development of marine microplastic monitoring technology in the world.