The pivotal role of androgen receptor (AR) in regulating male fertility has attracted much research attention in the past two decades. Previous studies have shown that total AR knockout would lead to incomplete spermatogenesis and lowered serum testosterone levels in mice, resulting in azoospermia and infertility. However, the precise physiological role of ar in controlling fertility of male fish is still poorly understood. In this study, we have established an ar knockout zebrafish line by transcription activator-like effectors nucleases. Homozygous ar mutant male fish with smaller testis size were found to be infertile when tested by natural mating. Intriguingly, a small amount of mature spermatozoa was observed in the ar mutant fish. These mature spermatozoa could fertilize healthy oocytes, albeit with a lower fertilization rate, by in vitro fertilization. Moreover, the expression levels of most steroidogenic genes in the testes were significantly elevated in the ar mutants. In contrast, the levels of estradiol and 11-ketotestosterone (11-KT) were significantly decreased in the ar mutants, indicating that steroidogenesis was defective in the mutants. Furthermore, the protein level of LHβ in the serum decreased markedly in the ar mutants when compared with wild-type fish, probably due to the positive feedback from the diminished steroid hormone levels.