All-inorganic halide perovskites are promising materials for optoelectronic applications. The surface or interface structure of the perovskites plays a crucial role in determining the optoelectronic conversion efficiency, as well as the material stability. A thorough understanding of surface atomic structures of the inorganic perovskites and their contributions to their optoelectronic properties and stability is lacking. Here we show a scanning tunneling microscopy investigation on the atomic and electronic structure of CsPbBr3 perovskite. Two different surface structures with a stripe and an armchair domain are identified, which originates from a complex interplay between Cs cations and Br anions. Our findings are further supported and correlated with density functional theory calculations and photoemission spectroscopy measurements. The stability evaluation of photovoltaic devices indicates a higher stability for CsPbBr3 in comparison with MAPbBr3, which is closely related to the low volatility of Cs from the perovskite surface.