Signal transducer and activator of transcription 3 (STAT3) is hyper-activated in diversiform human tumors and has been validated as an attractive therapeutic target. Current research showed that a natural product, shikonin, along with its synthetic analogues, is able to inhibit the activity of STAT3 potently. The potential space of shikonin in developing novel anti-cancer agents encouraged us to carry out the investigation of the probable binding mode with STAT3. From this foundation, we have designed new types of STAT3 SH2 inhibitors. Combined simulations were performed to filter for the lead compound, which was then substituted, synthesized and evaluated by a variety of bioassays. Among the entities, PMM-172 exhibited the best anti-proliferative activity against MDA-MB-231 cells with IC50 value 1.98 ± 0.49 μM. Besides, it was identified to decrease luciferase activity, induce cell apoptosis and reduce mitochondrial transmembrane potential in MDA-MB-231 cells. Also, PMM-172 inhibited constitutive/inducible STAT3 activation without affecting STAT1 and STAT5 in MDA-MB-231 cells, and had no effect in non-tumorigenic MCF-10A cells. Moreover, PMM-172 suppressed STAT3 nuclear localization and STAT3 downstream target genes expression. Overall, these results indicate that the antitumor activity of PMM-172 is at least partially due to inhibition of STAT3 in breast cancer cells.