In this work we demonstrate the development of a complete analog feedback loop for the control of the carrier-envelope phase (CEP) of a high-average power (20 W) laser operating at 10 kHz repetition rate. The proposed method combines a detection scheme working on a single-shot basis at the full-repetition-rate of the laser system with a fast actuator based either on an acousto-optic or on an electro-optic crystal. The feedback loop is used to correct the CEP fluctuations introduced by the amplification process demonstrating a CEP residual noise of 320 mrad measured on a single-shot basis. The comparison with a feedback loop operating at a lower sampling rate indicates an improvement up to 45% in the residual noise. The measurement of the CEP drift for different integration times clearly evidences the importance of the single-shot characterization of the residual CEP drift. The demonstrated scheme could be efficiently applied for systems approaching the 100 kHz repetition rate regime.