Shot-to-shot electron beam pointing instability in the plasma bubble, defined here as electron beam pointing jitter (EBJ), is a long-standing problem that limits the potential of the laser wakefield accelerator (LWFA) in a range of demanding applications. In general, EBJ is caused by variations in laser and plasma parameters from shot to shot, although the exact physical mechanism by which EBJ grows in the plasma wave remains unclear. In this work we theoretically investigate the fundamental physics of EBJ inside the plasma bubble and show how the intrinsic betatron oscillation can act as an amplifier to enhance EBJ growth. The analytical formulas for electron trajectory, pointing angle, and EBJ are derived from the basic momentum equation of an electron and verified numerically. It is shown that the shot-to-shot fluctuations of the laser and plasma parameters, such as laser strength, focus, and carrier-envelope phase, as well as the ambient plasma density and profile, lead to EBJ. The evolution of EBJ is dictated by the dynamics of the plasma bubble. Two amplification processes of the betatron oscillation are found in the rapidly evolving bubbles and play important roles in EBJ growth. The first is driven by a linear resonance in the wobbling bubble due to the coupling of the betatron oscillation and the bubble centroid oscillation. The second is a parametric resonance seen in the breathing bubble, where EBJ grows exponentially due to the strong frequency modulation of the betatron oscillation. Their characteristic functions, growth rates, and resonance conditions are deduced analytically and validated numerically. Finally, we also studied how radiation reaction affects EBJ. Our research provides a clear understanding of the basics of EBJ dynamics in LWFA and will help improve the use of LWFA in demanding applications.