In this paper, we investigate the hydrodynamic permeance of water through graphene-based membranes, inspired by recent experimental findings on graphene-oxide membranes. We consider the flow across multiple graphene layers having nanoslits in a staggered alignment, with an inter-layer distance ranging from sub-nanometer to a few nanometers. We compare results for the permeability obtained by means of molecular dynamics simulations to continuum predictions obtained by using the lattice Boltzmann calculations and hydrodynamic modelization. This highlights that, in spite of extreme confinement, the permeability across the graphene-based membrane is quantitatively predicted on the basis of a continuum expression, taking properly into account entrance and slippage effects of the confined water flow. Our predictions refute the breakdown of hydrodynamics at small scales in these membrane systems. They constitute a benchmark to which we compare published experimental data.