We applied fMRI and diffusion-weighted MRI to study the segregation of cognitive and motor functions in the human cerebro-cerebellar system. Our fMRI results show that a load increase in a nonverbal auditory working memory task is associated with enhanced brain activity in the parietal, dorsal premotor, and lateral prefrontal cortices and in lobules VII-VIII of the posterior cerebellum, whereas a sensory-motor control task activated the motor/somatosensory, medial prefrontal, and posterior cingulate cortices and lobules V/VI of the anterior cerebellum. The load-dependent activity in the crus I/II had a specific relationship with cognitive performance: This activity correlated negatively with load-dependent increase in RTs. This correlation between brain activity and RTs was not observed in the sensory-motor task in the activated cerebellar regions. Furthermore, probabilistic tractography analysis of the diffusion-weighted MRI data suggests that the tracts between the cerebral and the cerebellar areas exhibiting cognitive load-dependent and sensory-motor activity are mainly projected via separated pontine (feed-forward tracts) and thalamic (feedback tracts) nuclei. The tractography results also indicate that the crus I/II in the posterior cerebellum is linked with the lateral prefrontal areas activated by cognitive load increase, whereas the anterior cerebellar lobe is not. The current results support the view that cognitive and motor functions are segregated in the cerebellum. On the basis of these results and theories of the function of the cerebellum, we suggest that the posterior cerebellar activity during a demanding cognitive task is involved with optimization of the response speed.