We investigate microgels synthesized from N-isopropylacrylamide (NIPAM) copolymerized with a large mol% of acrylic acid, finding that when the acid groups are partially ionized at high temperatures, competition between ion-induced swelling and hydrophobic deswelling of poly(NIPAM) chains results in microphase separation. In cross-linked microgels, this manifests as a dramatic decrease in the ratio between the radius of gyration and the hydrodynamic radius to ∼0.2, indicating that almost all the mass of the microgel is concentrated near the particle center. We also observe a concurrent decrease of the polymer network length scale via small-angle neutron scattering, confirming the presence of a dense, deswollen core surrounded by a diffuse, charged periphery. We compare these results to those obtained for a system of charged ultralow-cross-linked microgels; the form factor shows a distinct peak at high q when the temperature exceeds a threshold value. We successfully fit the form factor to theory developed to describe scattering from weakly charged gels in poor solvents, and we tie this behavior to charge segregation in the case of the cross-linked microgels.