Aneuploidy, a near ubiquitous genetic feature of tumors, is a context-dependent driver of cancer evolution; however, the mechanistic basis of this role remains unclear. Here, by inducing heterogeneous aneuploidy in non-transformed human colon organoids (colonoids), we investigate how the effects of aneuploidy on cell growth and differentiation may promote malignant transformation. Single-cell RNA sequencing reveals that the gene expression signature across over 100 unique aneuploid karyotypes is enriched with p53 responsive genes. The primary driver of p53 activation is karyotype complexity. Complex aneuploid cells with multiple unbalanced chromosomes activate p53 and undergo G1 cell-cycle arrest, independent of DNA damage and without evidence of senescence. By contrast, simple aneuploid cells with 1-3 chromosomes gained or lost continue to proliferate, demonstrated by single cell tracking in colonoids. Notably, simple aneuploid cells exhibit impaired differentiation when niche factors are withdrawn. These findings suggest that while complex aneuploid cells are eliminated from the normal epithelium due to p53 activation, simple aneuploid cells can escape this checkpoint and may contribute to niche factor-independent growth of cancer-initiating cells.