The brain is constantly monitoring and integrating both cues from the external world and signals generated intrinsically. These extrinsically and intrinsically-driven neural processes are thought to engage anatomically distinct regions, which are thought to constitute the extrinsic and intrinsic systems of the brain. While the specialization of extrinsic and intrinsic system is evident in primary and secondary sensory cortices, a systematic mapping of the whole brain remains elusive. Here, we characterized the extrinsic and intrinsic functional activities in the brain during naturalistic movie-viewing. Using a novel inter-subject functional correlation (ISFC) analysis, we found that the strength of ISFC shifts along the hierarchical organization of the brain. Primary sensory cortices appear to have strong inter-subject functional correlation, consistent with their role in processing exogenous information, while heteromodal regions that attend to endogenous processes have low inter-subject functional correlation. Those brain systems with higher intrinsic tendency show greater inter-individual variability, likely reflecting the aspects of brain connectivity architecture unique to individuals. Our study presents a novel framework for dissecting extrinsically- and intrinsically-driven processes, as well as examining individual differences in brain function during naturalistic stimulation.