Retroviruses have an intricate life cycle. There is much to be learned from studying retrovirus-host interactions. Among retroviruses, the primate lentiviruses have one of the more complex genome structures with three categories of viral genes: structural, regulatory, and accessory genes. Over time, we have gained increasing understanding of the lentivirus life cycle from studying host factors that support virus replication. Similarly, studies on host restriction factors that inhibit viral replication have also made significant contributions to our knowledge. Here, we review recent progress on the rapidly growing field of restriction factors, focusing on the antiretroviral activities of APOBEC3G, TRIM5, tetherin, SAMHD1, MOV10, and cellular microRNAs (miRNAs), and the counter-activities of Vif, Vpu, Vpr, Vpx, and Nef.