We consider the asymmetric simple exclusion process with Langmuir kinetics in the closed boundary condition. We analytically obtain the exact stationary state and a series of excited states of the system in the limit where Langmuir kinetics is infinitesimally small. Based on this result, we propose an analytical formula for the time evolution of physical quantities of the system.