The spins of atoms and atom-like systems are among the most coherent objects in which to store quantum information. However, the need to address them using oscillating magnetic fields hinders their integration with quantum electronic devices. Here, we circumvent this hurdle by operating a single-atom "flip-flop" qubit in silicon, where quantum information is encoded in the electron-nuclear states of a phosphorus donor. The qubit is controlled using local electric fields at microwave frequencies, produced within a metal-oxide-semiconductor device. The electrical drive is mediated by the modulation of the electron-nuclear hyperfine coupling, a method that can be extended to many other atomic and molecular systems and to the hyperpolarization of nuclear spin ensembles. These results pave the way to the construction of solid-state quantum processors where dense arrays of atoms can be controlled using only local electric fields.