Organic color centers are an emergent class of quantum emitters that hold vast potential for applications in bioimaging, chemical sensing, and quantum information processing. Here, we show that these synthetic color centers follow interesting structure-property relationships through comparative spectral studies of 14 purified single-walled carbon nanotube chiralities and 30 different functional groups that vary in electron-withdrawing capability and bonding configurations. The defect emission is tunable by as much as 400 meV in the near-infrared as a function of host structure and the chemical nature of the color centers. However, the emission energy is nearly free from chiral angle and family patterns of the nanotube host (although this strongly depends on the nanotube diameter), suggesting that a trapped exciton at the organic color centers to some degree electronically decouples from the one-dimensional semiconductor host. Our findings provide important insights for designing and controlling this new family of synthetic color centers.