We propose a novel probabilistic framework to merge information from DWI tractography and resting-state fMRI correlations. In particular, we model the interaction of latent anatomical and functional connectivity templates between brain regions and present an intuitive extension to population studies. We employ a mean-field approximation to fit the new model to the data. The resulting algorithm identifies differences in latent connectivity between the groups. We demonstrate our method on a study of normal controls and schizophrenia patients.