An adaptive Fourier neural operator (AFNO)-transformer model was developed to retrieve land surface temperature (LST) data from infrared atmospheric sounding interferometer (IASI) observations. A weight selection scheme based on linearization of the radiative transfer equation was proposed to solve the hyperspectral data channel redundancy problem. The IASI brightness temperatures and Advanced Very High Resolution Radiometer onboard MetOp (AVHRR/MetOp) LST product were selected to construct the training and test datasets. The AFNO-transformer performed effective token mixing through self-attention and effectively solved the global convolution problem in the Fourier domain, which can better learn complex nonlinear equations and achieve time-series forecasting. The root mean square error indicated that the LST in Eastern Spain and North Africa could be retrieved with an error of less than 2.5 K compared with the AVHRR/MetOp LST product. Moreover, the validation results from other time period data showed that the retrieval accuracy of this model can be less than 3 K. The proposed model provides a novel approach for hyperspectral LST retrieval.