Evolved properties of Adeno-Associated Virus (AAV), such as broad tropism and immunogenicity in humans, are barriers to AAV-based gene therapy. Previous efforts to re-engineer these properties have focused on variable regions near AAV’s 3-fold protrusions and capsid protein termini. To comprehensively survey AAV capsids for engineerable hotspots, we determined multiple AAV fitness phenotypes upon insertion of large, structured protein domains into the entire AAV-DJ capsid protein VP1. This is the largest and most comprehensive AAV domain insertion dataset to date. Our data revealed a surprising robustness of AAV capsids to accommodate large domain insertions. There was strong positional, domain-type, and fitness phenotype dependence of insertion permissibility, which clustered into correlated structural units that we could link to distinct roles in AAV assembly, stability, and infectivity. We also identified new engineerable hotspots of AAV that facilitate the covalent attachment of binding scaffolds, which may represent an alternative approach to re-direct AAV tropism.