Scrub typhus, caused by Orientia tsutsugamushi infection, has been a serious public health issue in the Asia-Pacific region, with rising incidence and sporadic outbreaks. However, human protective immunity against specific antigens has been poorly characterized for this bacterium. In addition, immunity produced in early vaccine trials or even after natural infections, did not last long and had poor cross-reactivity among various genotypes. Here, we systematically investigated the kinetics and magnitude of specific adaptive immunity against two membrane antigens, 56 kDa type-specific antigen (TSA56) and surface cell antigen A (ScaA), that are involved in bacterial adhesion and invasion of the host in 64 recovered scrub typhus patients. Antibody responses to the bacterial antigens in patients were generally short-lived and waned to baseline levels 2 years after recovery. The anti-TSA56 IgG responses were predominantly composed of the IgG1 and IgG3 subclasses and persisted for up to 1 year after recovery, whereas IgG specific to ScaA primarily consisted of more transient IgG1, with limited responses by other subclasses. Cellular immunity, including CD4 and CD8 T-cells specific to membrane antigens, also rapidly declined from 1 year after infection, as measured by enzyme-linked immunospot (ELISPOT) assays and flow cytometry. The short longevity of antigen-specific adaptive immunity might be attributable to limited memory responses, as observed in earlier vaccine studies using whole bacterial antigens. Finally, we identified HLA-A*0201-restricted and highly conserved CD8 T-cell epitopes in the TSA56 antigen, which may be valuable tools for assessing cellular immunity against O. tsutsugamushi and developing an effective scrub typhus vaccine.