Spin-valves had empowered the giant magnetoresistance (GMR) devices to have memory. The insertion of thin antiferromagnetic (AFM) films allowed two stable magnetic field-induced switchable resistance states persisting in remanence. In this letter, we show that, without the deliberate introduction of such an AFM layer, this functionality is transferred to multiferroic tunnel junctions (MFTJ) allowing us to create a four-state resistive memory device. We observed that the ferroelectric/ferromagnetic interface plays a crucial role in the stabilization of the exchange bias, which ultimately leads to four robust electro tunnel electro resistance (TER) and tunnel magneto resistance (TMR) states in the junction.