The unique optoelectronic properties of lead halide perovskites have triggered a new wave of excitement in materials chemistry during the past five years. Electrochemistry, spectroelectrochemistry, and photoelectrochemistry could be viable tools both for analyzing the optoelectronic features of these materials and for assembling them into hybrid architectures (e.g., solar cells). At the same time, the instability of these materials limits the pool of solvents and electrolytes that can be employed in such experiments. The focus of our study is to establish a stability window for electrochemical tests for all-inorganic CsPbBr3 and hybrid organic-inorganic MAPbI3 perovskites. In addition, we aimed to understand the reduction and oxidation events that occur and to assess the damage done during these processes at extreme electrochemical conditions. In this vein, we demonstrated the chemical, structural, and morphological changes of the films in both reductive and oxidative environments. Taking all these results together as a whole, we propose a set of boundary conditions and protocols for how electrochemical experiments with lead halide perovskites should be carried out and interpreted. The presented results will contribute to the understanding of the electrochemical response of these materials and lead to a standardization of results in the literature so that comparisons can more easily be made.