We calculate the Casimir interaction between isotropic plates (gold or graphene) and black phosphorus (BP) sheets with Lifshitz theory. It is found that the Casimir force with BP sheets is of the order of α times the perfect metal limit, and α is the fine structure constant. Strong anisotropy of the BP conductivity gives rise to a difference in the Casimir force contribution between the two principal axis. Furthermore, increasing the doping concentration both in BP sheets and graphene sheets can enhance the Casimir force. Moreover, introducing substrate and increased temperature can also enhance the Casimir force, by this way we reveal that the Casimir interaction can be doubled. The controllable Casimir force opens a new avenue for designing next generation devices in micro- and nano-electromechanical systems.