Orthopedic implants provide an avascular surface for microbial attachment and biofilm formation, impeding the entry of immune cells and the diffusion of antibiotics. The above is an important cause of dental and orthopedic implant-associated infection (IAI). For the prevention and treatment of IAI, the drawbacks of antibiotic resistance and surgical treatment are increasingly apparent. Due to their outstanding biological properties such as biocompatibility, immunomodulatory effects, and antibacterial properties, graphene-based nanomaterials (GBNs) have been applied to bone tissue engineering to deal with IAI, and in particular have great potential application in drug/gene carriers, multi-functional platforms, and coating forms. Here we review the latest research progress and achievements in GBNs for the prevention and treatment of IAI, mainly including their biomedical applications for antibacterial and immunomodulation effects, and for inducing osteogenesis. Furthermore, the biosafety of graphene family materials in bone tissue regeneration and the feasibility of clinical application are critically analyzed and discussed.