Spermatogonial stem cells (SSCs) play fundamental roles in spermatogenesis. Although a handful of genes have been discovered as key regulators of SSC self-renewal and differentiation, the regulatory network responsible for SSC function remains unclear. In particular, small RNA signatures during mouse spermatogenesis are not yet systematically investigated. Here, using next generation sequencing, we compared small RNA signatures of in vitro expanded SSCs, testis-derived somatic cells (Sertoli cells), developing germ cells, mouse embryonic stem cells (ESCs), and mouse mesenchymal stem cells among mouse embryonic stem cells (ESCs) to address small RNA transition during mouse spermatogenesis. The results manifest that small RNA transition during mouse spermatogenesis displays overall declined expression profiles of miRNAs and endo-siRNAs, in parallel with elevated expression profiles of piRNAs, resulting in the normal biogenesis of sperms. Meanwhile, several novel miRNAs were preferentially expressed in mouse SSCs, and further investigation of their functional annotation will allow insights into the mechanisms involved in the regulation of SSC activities. We also demonstrated the similarity of miRNA signatures between SSCs and ESCs, thereby providing a new clue to understanding the molecular basis underlying the easy conversion of SSCs to ESCs.