Carrier-envelope (CE) phase stabilization of a two-stage chirped pulse amplifier laser system with regenerative amplification as the preamplifier is demonstrated. The CE phase stability of this laser system is found to have a 90 mrad rms error averaged over 50 laser shots for a locking period of 4.5 h. The CE phase locking was confirmed unambiguously by experimental observation of the 2pi periodicity of the high-order harmonic spectrum generated by double optical gating.