Differential gene expression in two sexes is widespread throughout the animal kingdom, giving rise to sex-dimorphic gene activities and sex-dependent adaptability to environmental cues, diets, growth and development as well as susceptibility to diseases. Here, we present a study using a toxicogenomic approach to investigate metabolic genes that show sex-dimorphic expression in the zebrafish liver triggered by several chemicals. Our analysis revealed that, besides the known genes for xenobiotic metabolism, many functionally diverse metabolic genes, such as ELOVL fatty acid elongase, DNA-directed RNA polymerase, and hydroxysteroid dehydrogenase, were also sex-dimorphic in their response to chemical treatments. Moreover, sex-dimorphic responses were also observed at the pathway level. Pathways belonging to xenobiotic metabolism, lipid metabolism, and nucleotide metabolism were enriched with sex-dimorphically expressed genes. We also observed temporal differences of the sex-dimorphic responses, suggesting that both genes and pathways are differently correlated during different periods of chemical perturbation. The ubiquity of sex-dimorphic activities at different biological hierarchies indicate the importance and the need of considering the sex factor in many areas of biological researches, especially in toxicology and pathology.