Quantum key distribution with polarized qubits has not yet been realized over the aerial fiber, due to rapid polarization changes. Here, we report our recent work towards quantum communication through an aerial fiber channel. We designed a fast polarization feedback module featuring high efficiency, fast speed, and good stability. With this module, we implemented long-distance quantum key distribution over different types of aerial fiber links based on polarization encoding. Our work takes a significant step towards the application of quantum communications in complex environments.