The eukaryotic nucleus is a highly compartmentalized and dynamic environment. Chromosome territories are arranged nonrandomly within the nucleus and numerous studies have indicated that a gene's position in the nucleus can impact its transcriptional activity. Here, we focus on recent advances in our understanding of the influence of specific nuclear neighborhoods on gene expression or repression. Nuclear neighborhoods associated with transcriptional repression include the inner nuclear membrane/nuclear lamina and perinucleolar chromatin, whereas neighborhoods surrounding the nuclear pore complex, PML nuclear bodies, and nuclear speckles seem to be transcriptionally permissive. While nuclear position appears to play an important role in gene expression, it is likely to be only one piece of a flexible puzzle that incorporates numerous parameters. We are still at a very early, yet exciting stage in our journey toward deciphering the mechanism(s) that govern(s) the permissiveness of gene expression/repression within different nuclear neighborhoods.