The prolific lithium battery electrode material lithium iron phosphate (LiFePO4) stores and releases lithium ions by undergoing a crystallographic phase change. Nevertheless, it performs unexpectedly well at high rate and exhibits good cycling stability. We investigate here the ultrafast charging reaction to resolve the underlying mechanism while avoiding the limitations of prevailing electrochemical methods by using a gaseous oxidant to deintercalate lithium from the LiFePO4 structure. Oxidizing LiFePO4 with nitrogen dioxide gas reveals structural changes through in situ synchrotron X-ray diffraction and electronic changes through in situ UV/vis reflectance spectroscopy. This study clearly shows that ultrahigh rates reaching 100% state of charge in 10 s does not lead to a particle-wide union of the olivine and heterosite structures. An extensive solid solution phase is therefore not a prerequisite for ultrafast charge/discharge.