The neural mechanism of steady-state visual evoked potentials (SSVEP) is still not clearly understood. Especially, only certain frequency stimuli can evoke SSVEP. Our previous network study reveals that 8 Hz stimulus that can evoke strong SSVEP response shows the enhanced linkage strength between frontal and visual cortex. To further probe the directed information flow between the two cortex areas for various frequency stimuli, this paper develops a causality analysis based on the inversion of double columns model using particle swarm optimization (PSO) to characterize the directed information flow between visual and frontal cortices with the intracranial rat electroencephalograph (EEG). The estimated model parameters demonstrate that the 8 Hz stimulus shows the enhanced directional information flow from visual cortex to frontal lobe facilitates SSVEP response, which may account for the strong SSVEP response for 8 Hz stimulus. Furthermore, the similar finding is replicated by data-driven causality analysis. The inversion of neural mass model proposed in this study may be helpful to provide the new causality analysis to link the physiological model and the observed datasets in neuroscience and clinical researches.