We discuss the existence of nonlinear modes sustained by graphene layers in dielectric waveguides. Taking advantage of the almost two dimensional nature of graphene, we introduce the nonlinear effect as a parameter in the continuity equations. We then apply our modeling to a simple slab waveguide to enlighten how graphene can be used to induce huge nonlinear phase shifts at easily accessible power levels.