The interplay between excitons and phonons governs the optical and electronic properties of transition metal dichalcogenides (TMDs). Even though a number of linear and nonlinear optical-, electron-, and photoelectron-based approaches have been developed and/or adopted to characterize excitons and phonons in single/few-layer TMDs and their heterostructures, no existing method is capable of directly probing ultralow-frequency and interlayer phonons on the nanoscale. To this end, we developed ultralow-frequency tip-enhanced Raman spectroscopy, which allows spectrally and spatially resolved chemical and structural nanoimaging of WSe2/WS2 heterostructures. In this work, we apply this method to analyze phonons in nanobubbles that are sustained in these heterobilayers. Our method is capable of directly probing interlayer (de)coupling using our novel structurally sensitive nano-optical probe and the interplay between excitons and interlayer/intralayer phonons through correlation analysis of the recorded spectral images.