An in situ thermally reduced graphene/polyethylene conductive composite with a segregated structure was fabricated, which achieved a high electromagnetic interference shielding effectiveness of up to 28.3-32.4 dB at an ultralow graphene loading of 0.660 vol.%. Our work suggests a new way of effectively using graphene.