Alkaline earth Rydberg atoms are very promising tools for quantum technologies. Their highly excited outer electron provides them with the remarkable properties of Rydberg atoms and, notably, with a huge coupling to external fields or to other Rydberg atoms while the ionic core retains an optically active electron. However, low angular-momentum Rydberg states suffer almost immediate autoionization when the core is excited. Here, we demonstrate that strontium circular Rydberg atoms with a core excited in a 4D metastable level are impervious to autoionization over more than a few millisecond time scale. This makes it possible to trap and laser-cool Rydberg atoms. Moreover, we observe singlet to triplet transitions due to the core optical manipulations, opening the way to a microwave to optical quantum interface.