Polycomb repressive complex 1 (PRC1) is an essential chromatin-modifying complex that monoubiquitinates histone H2A and is involved in maintaining the repressed chromatin state. Emerging evidence suggests PRC1 activity in various cancers, rationalizing the need for small-molecule inhibitors with well-defined mechanisms of action. Here, we describe the development of compounds that directly bind to RING1B-BMI1, the heterodimeric complex constituting the E3 ligase activity of PRC1. These compounds block the association of RING1B-BMI1 with chromatin and inhibit H2A ubiquitination. Structural studies demonstrate that these inhibitors bind to RING1B by inducing the formation of a hydrophobic pocket in the RING domain. Our PRC1 inhibitor, RB-3, decreases the global level of H2A ubiquitination and induces differentiation in leukemia cell lines and primary acute myeloid leukemia (AML) samples. In summary, we demonstrate that targeting the PRC1 RING domain with small molecules is feasible, and RB-3 represents a valuable chemical tool to study PRC1 biology.