Plexcitons, that is, mixed plasmon-exciton states, are currently gaining broad interest to control the flux of energy at the nanoscale. Several promising properties of plexcitonic materials have already been revealed, but the debate about their ultrafast dynamic properties is still vibrant. Here, pump-probe spectroscopy is used to characterize the ultrafast dynamics of colloidal nanohybrids prepared by coupling gold nanoparticles and porphyrin dyes, where one or two sets of plexcitonic resonances can be selectively activated. We found that these dynamics are strongly affected by the presence of a reservoir of states including plasmon resonances and dark states. The time constants regulating the plexciton relaxations are significantly longer than the typical values found in the literature and can be modulated over more than 1 order of magnitude, opening possible interesting perspectives to modify rates of chemically relevant molecular processes.