The establishment of inflorescence architecture is critical for the reproduction of flowering plant species. The maize plant generates two types of inflorescences, the tassel and the ear, and their architectures have a large effect on grain yield and yield-related traits that are genetically controlled by quantitative trait loci (QTLs). Since ear and tassel architecture are deeply affected by the activity of inflorescence meristems, key QTLs and genes regulating meristematic activity have important impacts on inflorescence development and show great potential for optimizing grain yield. Isolation of yield trait-related QTLs is challenging, but these QTLs have direct application in maize breeding. Additionally, characterization and functional dissection of QTLs can provide genetic and molecular knowledge of quantitative variation in inflorescence architecture. In this review, we summarize currently identified QTLs responsible for the establishment of ear and tassel architecture and discuss the potential genetic control of four ear-related and four tassel-related traits. In recent years, several inflorescence architecture-related QTLs have been characterized at the gene level. We review the mechanisms of these characterized QTLs.