Rapeseed (Brassica napus L.) is an important oil crop worldwide and exhibits significant heterosis. Effective pollination control systems, which are closely linked to anther development, are a prerequisite for utilizing heterosis. The anther, which is the male organ in flowering plants, undergoes many metabolic processes during development. Although the gene expression patterns underlying pollen development are well studied in model plant Arabidopsis, the regulatory networks of genome-wide gene expression during rapeseed anther development is poorly understood, especially regarding metabolic regulations. In this study, we systematically analyzed metabolic processes occurring during anther development in rapeseed using ultrastructural observation and global transcriptome analysis. Anther ultrastructure exhibited that numerous cellular organelles abundant with metabolic materials, such as elaioplast, tapetosomes, plastids (containing starch deposits) etc. appeared, accompanied with anther structural alterations during anther development, suggesting many metabolic processes occurring. Global transcriptome analysis revealed dynamic changes in gene expression during anther development that corresponded to dynamic functional alterations between early and late anther developmental stages. The early stage anthers preferentially expressed genes involved in lipid metabolism that are related to pollen extine formation as well as elaioplast and tapetosome biosynthesis, whereas the late stage anthers expressed genes associated with carbohydrate metabolism to form pollen intine and to accumulate starch in mature pollen grains. Finally, a predictive gene regulatory module responsible for early pollen extine formation was generated. Taken together, this analysis provides a comprehensive understanding of dynamic gene expression programming of metabolic processes in the rapeseed anther, especially with respect to lipid and carbohydrate metabolism during pollen development.