Advances in accelerator technologies have enabled the continuous development of synchrotron radiation and X-ray free electron laser (XFEL) sources. At the same time, it has been critical to perform in-situ wavefront sensing to aid delivery of high-quality X-ray beams to the end users of these facilities. The speckle-based scanning technique has obtained popularity due to its high spatial resolution and superior sensitivity compared to other wavefront sensing methods. However, these advantages often come at the expense of longer data acquisition times since multiple images have to be collected to derive the necessary wavefront information. Whereas initial speckle tracking techniques could obtain wavefront information relatively quickly, the installation of additional hardware was routinely required to do so. Here, we propose a novel speckle-based approach, termed Alternating Speckle Tracking (AST), to perform fast wavefront sensing within a conventional beamline setup. The wavefront information derived from the new technique has proven to be valuable for many applications that require temporal resolution. Importantly, both horizontal and vertical wavefront information can be simultaneously derived by moving the speckle generator along the diagonal direction. We expect this method will be widely used by the synchrotron radiation and XFEL community in the future.