Electron heating is a fundamental and multidisciplinary phenomenon in partially ionized gases, from the planet's ionosphere to laboratory-scale plasmas. Plasmas produced at ambient or reduced pressures have recently shown potential for scientific and industrial applications. However, electron heating, which is strongly coupled to the physicochemical properties of these plasmas, has been poorly understood. We experimentally found the rapid structural transition from non-local to local electron heating in collisional radio-frequency discharges at atmospheric-to-subatmospheric pressures. As the gas pressure decreased from 760 to 200 Torr, the time-averaged electron density increased from 1.3 × 1012 to 1.3 × 1013 cm-3, and the electron temperature decreased from 2.5 to 1.1 eV at the maximum allowable discharge current in the abnormal α-mode in the plasma bulk. The spatiotemporal evolution of the electron temperature clearly shows that the electron temperature increases uniformly throughout the bulk plasma region during sheath expansion and collapse at 760 Torr, but the electron heating weakens with sheath collapse as the gas pressure decreases.