In the present study, a nanoparticle-multilayer metal film substrate was presented with silver nanoparticles (Ag NPs) assembled on a multilayer gold (Au) film by employing alumina (Al2O3) as a spacer. The SERS performance of the proposed structures was determined. It was suggested that the SERS effect was improved with the increase in the number of layers, which was saturated at four layers. The SERS performance of the structures resulted from the mutual coupling of multiple plasmon modes [localized surface plasmons (LSPs), surface plasmon polaritons (SPPs), as well as bulk plasmon polaritons (BPPs)] generated by the Ag NP-multilayer Au film structure. Furthermore, the electric field distribution of the hybrid system was studied with COMSOL Multiphysics software, which changed in almost consistency with the experimentally achieved results. For this substrate, the limit of detection (LOD) was down to 10-13 M for the rhodamine 6G (R6G), and the proposed SERS substrate was exhibited prominently quantitatively detected capability and high reproducibility. Moreover, a highly sensitive detection was conducted on toluidine blue (TB) molecules. As revealed from the present study, the Ag NP-multilayer Au film structure can act as a dependable SERS substrate for its sensitive molecular sensing applications in the medical field.