The time evolution of a bistable Ginzburg-Landau model (GL) with a non-Markovian memory term of strength lambda is studied. Due to the nonlinear feedback coupling, the two branches of the stationary solution are not only controlled by the sign of the initial condition P(0), but also by the strength and the sign of lambda. Whereas in case of a positive lambda the stationary solution is ever reduced through the memory, it may be increasing for lambda<0. In that case the system is also able to switch over between both branches of the stationary solution. Such an ability is exclusively achieved for a negative lambda within an interval -u<lambda<lambda(c), where lambda(c) is a critical memory strength and u is the strength of the conventional nonlinear term within the GL. The complete phase diagram is presented in the P(0)-lambda plane analytically and numerically.