Over the past decade, lead halide perovskites (LHPs) have emerged as new promising materials in the fields of photovoltaics and light emission due to their facile syntheses and exciting optical properties. The enthusiasm generated by LHPs has inspired research in perovskite-related materials, including the so-called "zero-dimensional cesium lead halides", which will be the focus of this Perspective. The structure of these materials is formed of disconnected lead halide octahedra that are stabilized by cesium ions. Their optical properties are dominated by optical transitions that are localized within the individual octahedra, hence the title "'zero-dimensional perovskites". Controversial results on their physical properties have recently been reported, and the true nature of their photoluminescence is still unclear. In this Perspective, we will take a close look at these materials, both as nanocrystals and as bulk crystals/thin films, discuss the contrasting opinions on their properties, propose potential applications, and provide an outlook on future experiments.