Solid-state electrolytes (SSEs) are the key materials in the new generation of all-solid-state lithium ion/metal batteries. Metal-organic frameworks (MOFs) are ideal materials for developing solid electrolytes because of their structural diversity and porous properties. However, there are several significant issues and obstacles involved, such as lower ion conductivity, a smaller ion transport number, a narrower electrochemical stability window and poor interface contact. In this review, a comprehensive analysis and summary of the unique ion-conducting behavior of MOF-based electrolytes in rechargeable batteries are presented, and the different design principles of MOF-based SSEs are classified and emphasized. Accordingly, four design principles for achieving these MOF-based SSEs are presented and the influence of SSEs combined with MOFs on the electrochemical performance of the batteries is described. Finally, the challenges in the application of MOF materials in lithium ion/metal batteries are explored, and directions for future research on MOF-based electrolytes are proposed. This review will deepen the understanding of MOF-based electrolytes and promote the development of high-performance solid-state lithium ion/metal batteries. This review not only provides theoretical guidance for research on new MOF-based SSE systems, but also contributes to further development of MOFs applied to rechargeable batteries.