High oxidative phosphorylation (OXPHOS) happens in some tumors, which depends on OXPHOS for energy supply, particularly in slow-cycling tumor cells. Therefore, targeting human mitochondrial RNA polymerase (POLRMT) to inhibit mitochondrial gene expression emerges as a potential therapeutic strategy to eradicate tumor cells. In this work, exploration and optimization of the first-in-class POLRMT inhibitor IMT1B and its SAR led to the identification of a novel compound D26, which exerted a strong antiproliferative effect on several cancer cells and decreased mitochondrial-related genes expression. In addition, mechanism studies demonstrated that D26 arrested cell cycle at the G1 phase and had no effect on apoptosis, depolarized mitochondria, or reactive oxidative stress generation in A2780 cells. Importantly, D26 exhibited more potent anticancer activity than the lead IMT1B in A2780 xenograft nude mice and had no observable toxic effect. All results suggest that D26 deserves to be further investigated as a potent and safe antitumor candidate.