Simple, sensitive, and rapid detection of trace levels of extensively used and highly toxic pesticides are in urgent demand for public health. Surface-enhanced Raman scattering (SERS)-based sensor was designed to achieve ultrasensitive and simple pesticide sensing. We developed a portable sensor system composed of high performance and reliable gold nanofinger sensor strips and a custom-built portable Raman spectrometer. Compared to the general procedure and previously reported studies that are limited to laboratory settings, our analytical method is simple, sensitive, rapid, and cost-effective. Based on the SERS results, the chemical interaction of two pesticides, chlorpyrifos (CPF) and thiabendazole (TBZ), with gold nanofingers was studied to determine a fingerprint for each pesticide. The portable SERS-sensor system was successfully demonstrated to detect CPF and TBZ pesticides within 15 min with a detection limit of 35 ppt in drinking water and 7 ppb on apple skin, respectively.