Cesium lead iodide (CsPbI3) perovskite nanocrystals (NCs) suffer from a known transformation at room temperature from their red-emitting (black) to non-emitting (yellow) phase, induced by the tilting of PbI6 octahedra. While the reported attempts to stabilize CsPbI3 NCs mainly involve Pb2+-site doping as well as compositional and/or NC surface engineering, the black phase stability in relation only to the variation of the reaction temperature of CsPbI3 NCs is surprisingly overlooked. We report a holistic study of the phase stability of CsPbI3 NCs, encompassing dispersions, films, and even devices by tuning the hot-injection temperature between 120-170 °C. Our findings suggest that the transition from the black to the yellow phase occurs after over a month for NCs synthesized at 150 °C (150@NCs). Structural refinement studies attribute the enhanced stability of 150@NCs to their observed lowest octahedral distortion. The 150@NCs also lead to stable unencapsulated solar cells with unchanged performance upon 26 days of shelf storage in dry air. Our study underlines the importance of scrutinizing synthesis parameters for designing stable perovskite NCs towards long-lasting optoelectronic devices.