Virtual exhibits with haptic feedback offer greater flexibility in diversifying content and providing digital affordance, even at a lower cost, than physical exhibits. However, few studies addressed the value of such haptics-enabled educational systems in informal learning environments. In this study, we investigated the feasibility of a haptic exhibit as an alternative or supplement for a traditional physical exhibit in a science museum. We developed a two-degree-of-freedom cable-driven haptic device to simulate physical interactions on a large visual display. Choosing a seesaw-like physical exhibit available in a local museum, we designed and implemented a virtual lever simulation closely embodying the physics principles that the physical exhibit showcased. Then, we conducted an observational user study with children to compare the exhibit-visitor interaction behaviors, learning effects, and self-reported motivation and enjoyment between the physical and virtual exhibits. The results revealed that the visitors well-received and engaged with the haptic exhibit, instantiating its potential application in diverse learning settings. We hope that our research encourages further exploration of innovative haptic exhibits that enhance users' learning experiences across various environments.