The complex interplay between the host immune response and HIV has been the subject of intense research over the last 25 years. HIV and simian immunodeficiency virus (SIV) CD8 T cells have been of particular interest since they were demonstrated to be temporally associated with reduction in virus load shortly following transmission. Here, we briefly review the phenotypic and functional properties of HIV-specific and SIV-specific CD8 T-cell subsets during HIV infection and consider the influence of viral variation with specific responses that are associated with disease progression or control. The development of an effective HIV/AIDS vaccine combined with existing successful prevention and treatment strategies is essential for preventing new infections. In the context of previous clinical HIV/AIDS vaccine trials, we consider the challenges faced by therapeutic and vaccine strategies designed to elicit effective HIV-specific CD8 T cells.