We study experimentally and theoretically the phenomenon of "persistent response" in ultrastrongly driven membrane resonators. The term persistent response denotes the development of a vibrating state with nearly constant amplitude over an extreme wide frequency range. We reveal the underlying mechanism by directly imaging the vibrational state using advanced optical interferometry. We argue that this state is related to the nonlinear interaction between higher-order flexural modes and higher-order overtones of the driven mode. Finally, we propose a stability diagram for the different vibrational states that the membrane can adopt.