Nanoparticles of acenes exhibit highly efficient intermolecular singlet fission (SF). Recent reports indicate that altering the morphology of 6,13-bis-(triisopropylsilylethynyl)pentacene (TIPS-Pn) nanoparticles has a profound influence on their SF dynamics. Here, we show that poly(vinyl alcohol) (PVA) induces a phase transition in preformed TIPS-Pn nanoparticles. These nanoparticles are amorphous when initially formed but crystalline after addition of PVA. Surface characterization indicates that a diffuse PVA layer surrounds the nanoparticles. We propose that a periodic interaction between the hydroxyl groups of PVA and TIPS groups of TIPS-Pn on the nanoparticle surface induces a large-scale structural rearrangement to yield crystalline TIPS-Pn. Such reorganization in preformed organic nanoparticles is unprecedented, and we believe that this is the first report of such an effect induced by polymer adsorption. Transient absorption spectroscopic results reveal that SF within these nanoparticles is accelerated by an order of magnitude upon structural rearrangement.