Sugars, together with amino acids and nucleobases, are the fundamental building blocks of a cell. They are involved in many fundamental processes and they especially play relevant roles as part of the immune system. The latter is connected to their ability to establish a collection of intermolecular interactions, depending on the position of their hydroxyl groups. Here we explore how the position of the OH in C4, the anomeric conformation and the nature substituent affect the interaction with phenol, which serves as a probe of the preferred site for the interaction. Using mass-resolved excitation spectroscopy and density functional calculations, we unravel the structure of the dimers and compare their conformation with those found for similar systems. The main conclusion is that the hydroxymethyl group has a very strong influence, guiding the whole aggregation process and that the position of the substituent in C4 has a stronger influence on the final structure of the dimer than the anomeric conformation.