We investigated the N2 adsorption behavior of bimetallic rhodium-iron cluster cations [RhiFej(N2)m]+ by means of InfraRed MultiplePhotoDissociation (IR-MPD) spectroscopy in comparison with density functional theory (DFT) modeling. This approach allows us to refine our kinetic results [Ehrhard et al., J. Chem. Phys. (in press)] to enhance our conclusions. We focus on a selection of cluster adsorbate complexes within the ranges of i = j = 3-8 and m = 1-10. For i = j = 3, 4, DFT suggests alloy structures in the case of i = j = 4 of high (D2d) symmetry: Rh-Fe bonds are preferred instead of Fe-Fe bonds or Rh-Rh bonds. N2 adsorption and IR-MPD studies reveal strong evidence for preferential adsorption to Rh sites and mere secondary adsorption to Fe. In some cases, we observe adsorption isomers. With the help of modeling the cluster adsorbate complex [Rh3Fe3(N2)7]+, we find clear evidence that the position of IR bands allows for an element specific assignment of an adsorption site. We transfer these findings to the [Rh4Fe4(N2)m]+ cluster adsorbate complex where the first four N2 molecules are exclusively adsorbed to the Rh atoms. The spectra of the larger adsorbates reveal N2 adsorption onto the Fe atoms. Thus, the spectroscopic findings are well interpreted for the smaller clusters in terms of computed structures, and both compare well to those of our accompanying kinetic study [Ehrhard et al., J. Chem. Phys. (in press)]. In contrast to our previous studies of bare rhodium clusters, the present investigations do not provide any indication for a spin quench in [RhiFej(N2)m]+ upon stepwise N2 adsorption.