Transcription elongation factors associate with RNA polymerase II and aid its translocation through chromatin. One such factor is the conserved Paf1 complex (Paf1C), which regulates gene expression through several mechanisms, including the stimulation of cotranscriptional histone modifications. Previous studies revealed a prominent role for the Rtf1 subunit in tethering Paf1C to the RNA polymerase II elongation machinery. Here, we investigated the mechanism by which Rtf1 couples Paf1C to active chromatin. We show that a highly conserved domain of Rtf1 is necessary and sufficient for mediating a physical interaction between Rtf1 and the essential transcription elongation factor Spt5. Mutations that alter this Rtf1 domain or delete the Spt5 C-terminal repeat domain (CTR) disrupt the interaction between Rtf1 and Spt5 and release Paf1C from chromatin. When expressed in cells as the only source of Rtf1, the Spt5-interacting domain of Rtf1 can associate independently with active genes in a pattern similar to that of full-length Rtf1 and in a manner dependent on the Spt5 CTR. In vitro experiments indicate that the interaction between the Rtf1 Spt5-interacting domain and the Spt5 CTR is direct. Collectively, our results provide molecular insight into a key attachment point between Paf1C and the RNA polymerase II elongation machinery.