Surface plasmon polaritons (SPPs) are electromagnetic surface waves that travel along the boundary of a metal and a dielectric medium. They can be generated when freely propagating light is scattered by structural metallic features such as gratings or slits. In plasmonics, SPPs are manipulated, amplified, or routed before being converted back into light by a second scattering event. In this process, the light acquires a dynamic phase and perhaps an additional geometric phase associated with polarization changes. We examine the possibility that SPPs mediate the Pancharatnam-Berry phase, which follows from a closed path of successive in-phase polarization-state transformations on the Poincaré sphere and demonstrate that this is indeed the case. The geometric phase is shown to survive the light→SPP→light process and, moreover, its magnitude agrees with Pancharatnam's rule. Our findings are fundamental in nature and highly relevant for photonics applications.