Residues of sulfadimethoxine (SDM) in animal-derived foods have attracted widespread public concern. Herein, we propose an aptamer-based colorimetric/SERS dual-mode sensing strategy for the determination of SDM based on hexadecyl trimethyl ammonium bromide (CTAB) induced aggregation of nanoparticles. In the absence of SDM, the SDM aptamer formed a supramolecular composite with CTAB, and the 4-mercaptopyrimidine functionalized gold nanoparticles (AuNPs@4-MPY) remained dispersed due to the lack of CTAB. Upon the addition of SDM, the SDM aptamer preferentially combined with SDM, resulting in the release of CTAB and subsequent aggregation of AuNPs@4-MPY, and the solution color changed from red to blue and presented a dynamic UV-absorbance curve based on different aggregation states. On the other hand, when, gold-silver core-shell nanoparticles (Au@AgNPs) were added additionally, the released CTAB narrowed the nanogap between AuNPs@4-MPY and Au@AgNPs, thus exhibiting enhanced SERS intensity of 4-MPY. This strategy achieved colorimetric detection of SDM with a linear range of 4.00-200.00 ng mL-1 and a detection limit of 2.41 ng mL-1, while SERS had a detection range of 1.20-120.00 ng mL-1 with a detection limit of 0.89 ng mL-1. This strategy is simple and cost-effective for the rapid detection of SDM within 20 minutes. It was further applied for the detection of SDM in spiked milk and honey samples with satisfactory recoveries. Therefore, it exhibits great potential for fast and on-site SDM detection.