Extending recent modeling efforts for emulsions, we propose a nonlocal fluidity relation for flowing granular materials, capturing several known finite-size effects observed in steady flow. We express the local Bagnold-type granular flow law in terms of a fluidity ratio and then extend it with a particular Laplacian term that is scaled by the grain size. The resulting model is calibrated against a sequence of existing discrete element method data sets for two-dimensional annular shear, where it is shown that the model correctly describes the divergence from a local rheology due to the grain size as well as the rate-independence phenomenon commonly observed in slowly flowing zones. The same law is then applied in two additional inhomogeneous flow geometries, and the predicted velocity profiles are compared against corresponding discrete element method simulations utilizing the same grain composition as before, yielding favorable agreement in each case.