Colloidal lead-halide perovskite nanocrystals (LHP NCs) have emerged over the past decade as leading candidates for efficient next-generation optoelectronic devices, but their properties and performance critically depend on how they are purified. While antisolvents are widely used for purification, a detailed understanding of how the polarity of the antisolvent influences the surface chemistry and composition of the NCs is missing in the field. Here, we fill this knowledge gap by studying the surface chemistry of purified CsPbBrxI3-x NCs as the model system, which in itself is considered a promising candidate for pure-red light-emitting diodes and top-cells for tandem photovoltaics. Interestingly, we find that as the polarity of the antisolvent increases (from methyl acetate to acetone to butanol), there is a blueshift in the photoluminescence (PL) peak of the NCs along with a decrease in PL quantum yield (PLQY). Through transmission electron microscopy and X-ray photoemission spectroscopy measurements, we find that these changes in PL properties arise from antisolvent-induced iodide removal, which leads to a change in halide composition and, thus, the bandgap. Using detailed nuclear magnetic resonance (NMR) and Fourier-transform infrared spectroscopy (FTIR) measurements along with density functional theory calculations, we propose that more polar antisolvents favor the detachment of the oleic acid and oleylamine ligands, which undergo amide condensation reactions, leading to the removal of iodide anions from the NC surface bound to these ligands. This work shows that careful selection of low-polarity antisolvents is a critical part of designing the synthesis of NCs to achieve high PLQYs with minimal defect-mediated phase segregation.