In many plant species, roots maintain specific growth angles relative to the direction of gravity, known as gravitropic set point angles (GSAs). These contribute to the efficient acquisition of water and nutrients. AtLAZY1/LAZY1-LIKE (LZY) genes are involved in GSA control by regulating auxin flow toward the direction of gravity in Arabidopsis. Here, we demonstrate that RCC1-like domain (RLD) proteins, identified as LZY interactors, are essential regulators of polar auxin transport. We show that interaction of the CCL domain of LZY with the BRX domain of RLD is important for the recruitment of RLD from the cytoplasm to the plasma membrane by LZY. A structural analysis reveals the mode of the interaction as an intermolecular β-sheet in addition to the structure of the BRX domain. Our results offer a molecular framework in which gravity signal first emerges as polarized LZY3 localization in gravity-sensing cells, followed by polar RLD1 localization and PIN3 relocalization to modulate auxin flow.