We propose and numerically demonstrate a scheme for physical-layer security based on chaotic phase encryption, where the transmitted carrier signal is used as the common injection for chaos synchronization, so there is no need for additional common driving. To ensure privacy, two identical optical scramblers consisting of a semiconductor laser and a dispersion component are used to observe the carrier signal. The results show that the responses of the optical scramblers are highly synchronized but are not synchronized with the injection. By properly setting the phase encryption index, the original message can be well encrypted and decrypted. Moreover, the legal decryption performance is sensitive to the parameter mismatch, since it can degrade the synchronization quality. A slight drop in synchronization induces an evident deterioration in decryption performance. Therefore, without perfectly reconstructing the optical scrambler, the original message cannot be decoded by an eavesdropper.