We appreciate the comment by He et al. [Opt. Lett.38, 4044 (2013)] in the sense that it allows us to clarify our methodology of constructing an optical asymmetric cryptosystem, especially the relationship of the public encryption keys and private decryption keys. We also take this opportunity to provide a more detailed discussion to promote the research about the optical encryption schemes with asymmetric keys into a more correct direction.