The controlled assembly of colloid particles on a solid substrate has always been a major challenge in colloid and surface science. Here we provide an overview of electrophoretic deposition (EPD) of single charge-stabilized nanoparticles. We demonstrate that surface templated EPD (STEPD) assembly, which combines EPD with top-down nanofabrication, allows a wide range of nanoparticles to be built up into arbitrary structures with high speed, scalability, and excellent fidelity. We will also discuss some of the current colloid chemical limitations and challenges in STEPD assembly for sub-10 nm nanoparticles and for the fabrication of densely packed single particle arrays.