Acetylserotonin methyltransferase (ASMT) in plant species, one of the most important enzymes in melatonin biosynthesis, plays a rate-limiting role in the melatonin production. In this study, based on the whole genome sequence, we performed a systematic analysis for the ASMT gene family in pepper (Capsicum annuum L.) and analyzed their expression profiles during growth and development, as well as abiotic stresses. The results showed that at least 16 CaASMT genes were identified in the pepper genome. Phylogenetic analyses of all the CaASMTs were divided into three groups (group I, group II, and group III) with a high bootstrap value. Through the online MEME tool, six distinct motifs (motif 1 to motif 6) were identified. Chromosome location found that most CaASMT genes were mapped in the distal ends of the pepper chromosomes. In addition, RNA-seq analysis revealed that, during the vegetative and reproductive development, the difference in abundance and distinct expression patterns of these CaASMT genes suggests different functions. The qRT-PCR analysis showed that high abundance of CaASMT03, CaASMT04, and CaASMT06 occurred in mature green fruit and mature red fruit. Finally, using RNA-seq and qRT-PCR technology, we also found that several CaASMT genes were induced under abiotic stress conditions. The results will not only contribute to elucidate the evolutionary relationship of ASMT genes but also ascertain the biological function in pepper plant response to abiotic stresses.