Nanoscale heat transport is of increasing importance as it often defines performance of modern processors and thermoelectric nanomaterials, and affects functioning of chemical sensors and biosensors. Scanning thermal microscopy (SThM) is the leading tool for nanoscale mapping of thermal properties, but it is often negatively affected by unstable tip-surface thermal contacts. While operating SThM in-liquid environment may allow unimpeded thermal contact and open new application areas, it has so far been regarded as impossible due to increased heat dissipation into the liquid, and the perceived reduced spatial thermal resolution. Nevertheless, in this paper we show that such liquid immersion SThM (iSThM) is fully feasible and, while its thermal sensitivity and spatial resolution is somewhat below that of in-air SThM, it has sufficient thermal contrast to detect thermal conductivity variations in few tens of nm thick graphite nanoflake and metal-polymer nanostructured interconnects. Our results confirm that thermal sensing in iSThM can provide nanoscale resolution on the order of 30 nm, that, coupled with the absence of tip snap-in due to the elimination of capillary forces, opens the possibility for nanoscale thermal mapping in liquids, including thermal phenomena in energy storage devices, catalysts and biosystems.