Understanding how the dynamics of a given quantum system with many degrees of freedom is altered by the presence of a generic perturbation is a notoriously difficult question. Recent works predict that, in the overwhelming majority of cases, the unperturbed dynamics is just damped by a simple function, e.g., exponentially as expected from Fermi's golden rule. While these predictions rely on random-matrix arguments and typicality, they can only be verified for a specific physical situation by comparing to the actual solution or measurement. Crucially, it also remains unclear how frequent and under which conditions counterexamples to the typical behavior occur. In this work, we discuss this question from the perspective of projection-operator techniques, where exponential damping of a density matrix occurs in the interaction picture but not necessarily in the Schrödinger picture. We show that a nontrivial damping in the Schrödinger picture can emerge if the dynamics in the unperturbed system possesses rich features, for instance due to the presence of strong interactions. This suggestion has consequences for the time dependence of correlation functions. We substantiate our theoretical arguments by large-scale numerical simulations of charge transport in the extended Fermi-Hubbard chain, where the nearest-neighbor interactions are treated as a perturbation to the integrable reference system.