The development of drug delivery systems with high drug loading capacity, low leakage at physiological pH, and rapid release at the lesion sites remains an ongoing challenge. In this work, core-shell poly(6-O-methacryloyl-D-galactose)@poly(tert-butyl methacrylate) (PMADGal@PtBMA) nanoparticles (NPs) of sub-50 nm are facilely synthesized by reversible addition-fragmentation chain transfer (RAFT) soap-free emulsion polymerization with the assistance of 12-crown-4. A hydrophilic poly(methacrylic acid) (PMAA) core can then be revealed after deprotection of the tert-butyl groups, which is negatively charged and can adsorb nearly 100% of incubated doxorubicin (DOX) from a solution at pH 7.4. The physical shrinkage of PMAA chains below pH 6.0 endows the core with the squeezing effect, therefore realizing rapid drug release. It is demonstrated that the DOX release rate of PMADGal@PMAA NPs at pH 5 was 4 times that at pH 7.4. Cellular uptake experiments confirm the high targeting ability of the galactose modified PMADGal shell to human hepatocellular carcinoma (HepG2) cells. The fluorescence intensity of DOX in HepG2 cells is 4.86 times that of HeLa cells after 3 h incubation. Moreover, 20% cross-linked NPs show the highest uptake efficiency by HepG2 cells due to their moderate surface charge, size and hardness. In summary, both the core and the shell of PMADGal@PMAA NPs promise the rapid site-specific release of DOX in HepG2 cells. This work provides a facile and an effective strategy to synthesize core-shell NPs for hepatocellular carcinoma targeting therapy.