Coupled plasmonic/chromophore systems are of interest in applications ranging from fluorescent biosensors to solar photovoltaics and photoelectrochemical cells because near-field coupling to metal nanostructures can dramatically alter the optical performance of nearby materials. We show that CdSe quantum dots (QDs) near single silver nanoprisms can exhibit photoluminescence lifetimes and quantum yields that depend on the excitation wavelength, in apparent violation of the Kasha-Vavilov rule. We attribute the variation in QD lifetime with excitation wavelength to the wavelength-dependent coupling of higher-order plasmon modes to different spatial subpopulations of nearby QDs. At the QD emission wavelength, these subpopulations are coupled to far-field radiation with varying efficiency by the nanoprism dipolar resonance. These results offer an easily accessible new route to design metachromophores with tailored optical properties.