HIV-1 employs its structural proteins to orchestrate assembly and budding at the plasma membrane of host cells. The Gag polyprotein is sufficient to form virus-like particles in the absence of other viral proteins and provides a platform to interact with numerous cellular factors that regulate Gag trafficking to the site of assembly and budding. Notably endosomal sorting complexes required for transport have attained much attention over the last decade because of their essential role in virion release. Here we review recent advances in understanding the role of host cell factors recruited by Gag during HIV-1 assembly and budding.