Mammalian target of rapamycin complex 1 (mTORC1) is a master regulator of cell growth and autophagy. Its activity is regulated by the availability of amino acids and growth factors. The activation of mTORC1 by growth factors, such as insulin and insulin-like growth factor-1 (IGF-1), is mediated by tuberous sclerosis complex (TSC) 1 and 2 and Rheb GTPase. Relative to the growth factor-regulated mTORC1 pathway, the evolutionarily ancient amino acid-mTORC1 pathway remains not yet clearly defined. The amino acid-mTORC1 pathway is mediated by Rag GTPase heterodimers. Several binding proteins of Rag GTPases were discovered in recent studies. Here, we discuss the functions and mechanisms of the newly-identified binders of Rag GTPases. In particular, this review focuses on SH3 binding protein 4 (SH3BP4), the protein recently identifed as a negative regulator of Rag GTPases.