Fiber optic communication is becoming the central pillar of modern high-speed communication technology, which involves the abundant fiber components. Currently, most of photodetectors are fabricated on the silicon chip, so mass fiber-to-chip interfaces increase the complexity of advanced optoelectronic system, and also grow the risk of optical information loss. Here, we report an all-fiber organic phototransistor by employing rubrene single crystal and few-layer graphene to realize the "plug-to-play" operation. The device shows a broadband photoresponse from the ultraviolet to visible range, with fast response times of approximately 130/170 µs and reasonable specific detectivity of 6 × 109 Jones, which is close to the level of commercial on-chip device. Finally, several imaging applications are successfully demonstrated by deploying this all-fiber device. Our work provided an efficient strategy for fabricating all-fiber organic devices, and confirmed their significant potential in future optical fiber optoelectronics.