Restriction factors are important components of intrinsic cellular defense mechanisms against viral pathogens. TRIM5α is a restriction factor that intercepts the incoming capsid cores of retroviruses such as HIV and provides an effective species-specific barrier to retroviral infection. The TRIM5α SPRY domain directly binds the capsid with only very weak, millimolar-level affinity, and productive capsid recognition therefore requires both TRIM5α dimerization and assembly of the dimers into a multivalent hexagonal lattice to promote avid binding. Here, we explore the important unresolved question of whether the SPRY domains are flexibly linked to the TRIM lattice or more precisely positioned to maximize avidity. Biochemical and biophysical experiments indicate that the linker segment connecting the SPRY domain to the coiled-coil domain adopts an α-helical fold, and that this helical portion mediates interactions between the two domains. Targeted mutations were generated to disrupt the putative packing interface without affecting dimerization or higher-order assembly, and we identified mutant proteins that were nevertheless deficient in capsid binding in vitro and restriction activity in cells. Our studies therefore support a model wherein substantial avidity gains during assembly-mediated capsid recognition by TRIM5α come in part from tailored spacing of tethered recognition domains.