A post-synthesis thermal treatment of metastable phases in the high-pressure stabilised perovskite BiFe1-yScyO3 system results in the irreversible formation of polymorphs which represent novel polar and antipolar structures with interesting magnetic properties. Such annealing-stimulated polymorphism is believed to be a general phenomenon which can be found in other systems.