Two-dimensional (2D) halide perovskites exhibit unique structural and optical properties because large organic molecular cations distort the perovskite structure and the excitons confined in the 2D layers are stable. Here, we report the temperature dependences of the absorption spectra, second harmonic generation (SHG) intensity, and lattice constants of 2D perovskite (BA)2(EA)2Pb3I10 single crystals, where BA is n-butylammonium and EA is ethylammonium. We found that the Urbach tail of the absorption spectrum significantly changes at around 200 K and that the change is correlated with the SHG intensity and the in-plane lattice distortion. We concluded that a random distribution of spontaneous polarizations in the ferroelectric phase modifies the linewidth of the band-edge exciton transition and is the cause of the anomalous temperature dependence of the steepness parameter of the Urbach tail.