We report a facile method to prepare polymer-grafted plasmonic metal nanoparticles (NPs) that exhibit pH-responsive surface-enhanced Raman scattering (SERS). The concept is based on the use of pH-responsive polymers, such as poly(acrylic acid) (PAA) and poly(allylamine hydrochloride) (PAH), as multidentate ligands to wrap around the surface of NPs instead of forming polymer brushes. Upon changing the solvent quality, the grafted pH-responsive polymers would drive reversible aggregation of NPs, leading to a decreased interparticle distance. This creates numerous hot spots, resulting in a secondary enhancement of SERS as compared to the SERS from discrete NPs. For negatively charged PAA-grafted NPs, the SERS response at pH 2.5 showed a secondary enhancement of up to 104-fold as compared to the response for discrete NPs at pH 12. Similarly, positively charged PAH-grafted AuNPs showed an opposite response to pH. We demonstrated that enhanced SERS with thiol-containing and charged molecular probes was indeed from the pH-driven solubility change of polymer ligands. Our method is different from the conventional SERS sensors in the solid state. With pH-responsive polymer-grafted NPs, SERS can be performed in solution with high reproducibility and sensitivity but without the need for sample pre-concentration. These findings could pave the way for innovative designs of polymer ligands for metal NPs where polymer ligands do not compromise interparticle plasmon coupling.