In situ Raman spectroscopy shows the simultaneous incorporation of small amounts of Bi3+ and Yb3+ into the lattice of BaTiO3 to break the average symmetry inferred from X-ray powder diffraction analysis and permittivity measurements. In particular, Bi3+ with a stereochemically active lone-pair of electrons induces severe lattice strain and the coexistence of different local crystal symmetries over a wide temperature range, effectively controlling the physical properties, such as the temperature dependence of the permittivity and the Curie temperature. These results show that compositional gradients based in small variations of these two dopants could successfully explain the enhanced thermal stability of the permittivity in core-shell type ceramics, whereas the lower capacitance of the shell can also cap the maximum permittivity at the Curie temperature.