Imaging and characterization of surface plasmon polaritons (SPPs) are crucial for the research and development of the plasmonic devices and circuits. Here, we report on direct imaging of SPPs propagation on SiO2/metal interface with subwavelength spatial resolution using up-conversion fluorescence microscopy, that exploits rare-earth ions, such as Er3+, Yb3+, and Nd3+, doped nanoparticles as the fluorophores. We demonstrated that by further taking the intensity ratio of the image obtained with fluorescent emission at different wavelengths, we are able to substantially enhance the features associated to the SPP wavefronts in the image for quantitative analysis, such as the wavevector and propagation direction of the SPPs. Our results agree with the theoretic prediction of the SPP wavelengths quantitatively. We further demonstrate the evolution of the SPP wavefronts due to refraction SPPs, and reproduced the experiment with finite difference time domain (FDTD) method simulations. The relative refractive index of SPP estimated from the experiment also agrees quantitatively with those extracted from the theory and the simulation.